Jun 24 04:50:42 devstack cinder-volume[82292]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 24 04:50:42 devstack cinder-volume[82292]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 24 04:50:42 devstack cinder-volume[82292]: we strongly recommend against using it for new projects. Jun 24 04:50:42 devstack cinder-volume[82292]: If you are already using Eventlet, we recommend migrating to a different Jun 24 04:50:42 devstack cinder-volume[82292]: framework. For more detail see Jun 24 04:50:42 devstack cinder-volume[82292]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 24 04:50:42 devstack cinder-volume[82292]: import eventlet # noqa Jun 24 04:50:45 devstack cinder-volume[82292]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82292) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 24 04:50:45 devstack cinder-volume[82292]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82292) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 24 04:50:45 devstack cinder-volume[82292]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82292) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 24 04:50:45 devstack cinder-volume[82292]: INFO dbcounter [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] Registered counter for database cinder Jun 24 04:50:46 devstack cinder-volume[82292]: DEBUG oslo_db.sqlalchemy.engines [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82292) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 04:50:46 devstack cinder-volume[82292]: DEBUG dbcounter [-] [82292] Writer thread running {{(pid=82292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 24 04:50:46 devstack cinder-volume[82292]: INFO cinder.rpc [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 24 04:50:46 devstack cinder-volume[82292]: INFO cinder.rpc [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 24 04:50:46 devstack cinder-volume[82292]: DEBUG oslo_db.sqlalchemy.engines [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82292) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 04:50:46 devstack cinder-volume[82292]: INFO cinder.volume.manager [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] Determined volume DB was empty at startup. Jun 24 04:50:46 devstack cinder-volume[82292]: DEBUG cinder.volume.manager [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82292) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 24 04:50:46 devstack cinder-volume[82292]: INFO cinder.volume.manager [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 24 04:50:46 devstack cinder-volume[82292]: WARNING stevedore.named [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 24 04:50:46 devstack cinder-volume[82292]: WARNING castellan.key_manager [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 24 04:50:46 devstack cinder-volume[82292]: WARNING cinder.keymgr.conf_key_mgr [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 24 04:50:46 devstack cinder-volume[82292]: DEBUG cinder.volume.drivers.lvm [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=82292) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jun 24 04:50:46 devstack cinder-volume[82292]: DEBUG oslo_concurrency.processutils [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=82292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_concurrency.processutils [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] CMD "cinder-rtstool verify" returned: 0 in 0.514s {{(pid=82292) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_db.sqlalchemy.engines [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82292) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 04:50:47 devstack cinder-volume[82292]: INFO cinder.rpc [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jun 24 04:50:47 devstack cinder-volume[82292]: INFO cinder.rpc [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jun 24 04:50:47 devstack cinder-volume[82292]: WARNING stevedore.named [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 24 04:50:47 devstack cinder-volume[82292]: WARNING castellan.key_manager [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 24 04:50:47 devstack cinder-volume[82292]: INFO cinder.volume.manager [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_db.sqlalchemy.engines [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82292) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 04:50:47 devstack cinder-volume[82292]: INFO oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] Starting 1 workers Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] Started child 82458 {{(pid=82292) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] Full set of CONF: {{(pid=82292) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] ******************************************************************************** {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] Configuration options gathered from: {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] ================================================================================ {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] allow_availability_zone_fallback = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] allow_compression_on_image_upload = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] allowed_direct_url_schemes = [] {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] api_rate_limit = True {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] auth_strategy = keystone {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] az_cache_duration = 3600 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_availability_zone = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_host = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82458]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_name = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_stats_polling_interval = 60 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backup_api_class = cinder.backup.api.API {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backup_name_template = backup-%s {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backup_use_same_host = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backup_use_temp_snapshot = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] chap_password = **** {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] chap_username = {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cinder_internal_tenant_project_id = d6793bc8cb294ac88b8e1843c05ce080 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cinder_internal_tenant_user_id = 4a7eec64cfa74dc0b05eac602ff5b378 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cloned_volume_same_az = True {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cluster = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] compression_format = gzip {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] compute_api_class = cinder.compute.nova.API {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] config_dir = [] {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] config_source = [] {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] control_exchange = openstack {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] debug = True {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] default_availability_zone = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] default_group_type = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] default_volume_type = lvmdriver-1 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] disk_geometry = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] driver_client_cert = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] driver_client_cert_key = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] driver_data_namespace = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] driver_ssl_cert_path = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] driver_ssl_cert_verify = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] driver_use_ssl = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] enable_force_upload = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] enable_new_services = True {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] enable_unsupported_driver = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] enabled_backends = ['lvmdriver-1'] {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] enforce_multipath_for_image_xfer = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] filter_function = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] glance_api_insecure = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] glance_api_servers = ['http://192.168.122.25/image'] {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] glance_api_ssl_compression = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] glance_ca_certificates_file = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] glance_catalog_info = image:glance:publicURL {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] glance_certfile = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] glance_keyfile = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] glance_num_retries = 3 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] glance_request_timeout = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] goodness_function = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] graceful_shutdown_timeout = 5 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] group_api_class = cinder.group.api.API {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] host = devstack {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] image_compress_on_upload = True {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] image_conversion_address_space_limit = 1 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] image_conversion_cpu_limit = 60 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] image_conversion_disable = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] image_upload_use_cinder_backend = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] image_upload_use_internal_tenant = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] image_volume_cache_enabled = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] image_volume_cache_max_count = 0 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] image_volume_cache_max_size_gb = 0 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] init_host_max_objects_retrieval = 0 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] instance_format = [instance: %(uuid)s] {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] iscsi_target_flags = {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] iscsi_write_cache = on {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] iser_helper = tgtadm {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] iser_ip_address = 192.168.122.25 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] iser_port = 3260 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] log_color = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] log_config_append = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] log_dir = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] log_file = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] log_options = True {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] log_rotate_interval = 1 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] log_rotate_interval_type = days {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] log_rotation_type = none {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82458]: INFO cinder.volume.manager [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Starting volume driver LVMVolumeDriver (3.0.0) Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] max_age = 0 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] max_logfile_count = 30 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] max_logfile_size_mb = 200 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] max_over_subscription_ratio = 20.0 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] message_reap_interval = 86400 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] message_ttl = 2592000 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] migration_create_volume_timeout_secs = 300 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] monkey_patch = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] monkey_patch_modules = [] {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] my_ip = 192.168.122.25 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] no_snapshot_gb_quota = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] num_iser_scan_tries = 3 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] num_shell_tries = 3 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] num_volume_device_scan_tries = 3 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] nvmeof_conn_info_version = 1 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] nvmet_ns_id = 10 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] nvmet_port_id = 1 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] osapi_max_limit = 1000 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] osapi_volume_ext_list = [] {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] osapi_volume_listen_port = 8776 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] osapi_volume_use_ssl = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] osapi_volume_workers = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] per_volume_size_limit = -1 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] periodic_fuzzy_delay = 60 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] periodic_interval = 60 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] public_endpoint = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] publish_errors = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] quota_backup_gigabytes = 1000 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] quota_backups = 10 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] quota_gigabytes = 1000 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] quota_groups = 10 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] quota_snapshots = 10 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] quota_volumes = 10 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] rate_limit_burst = 0 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] rate_limit_except_level = CRITICAL {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] rate_limit_interval = 0 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] reinit_driver_count = 3 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] replication_device = **** {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] report_discard_supported = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] report_interval = 120 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] reservation_clean_interval = 86400 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] reservation_expire = 86400 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] reserved_image_namespaces = [] {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] reserved_percentage = 0 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] rpc_response_timeout = 120 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] run_external_periodic_tasks = True {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] scst_target_driver = iscsi {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] scst_target_iqn_name = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] service_down_time = 720 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] shell_completion = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] snapshot_name_template = snapshot-%s {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] snapshot_same_host = True {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] split_loggers = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] state_path = /opt/stack/data/cinder {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] storage_availability_zone = nova {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] storage_protocol = iSCSI {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] syslog_log_facility = LOG_USER {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.044s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] target_helper = lioadm {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] target_ip_address = 192.168.122.25 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] target_port = 3260 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] target_protocol = iscsi {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] target_secondary_ip_addresses = [] {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] trace_flags = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] transport_url = **** {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] until_refresh = 0 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] use_chap_auth = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] use_default_quota_class = True {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] use_journal = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] use_json = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] use_multipath_for_image_xfer = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] use_stderr = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] use_syslog = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] verify_glance_signatures = enabled {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] volume_api_class = cinder.volume.api.API {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] volume_backend_name = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] volume_clear = zero {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] volume_clear_ionice = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] volume_clear_size = 0 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] volume_copy_bps_limit = 0 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] volume_dd_blocksize = 1M {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] volume_name_template = volume-%s {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] volume_service_inithost_offload = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] volume_usage_audit_period = month {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] zoning_mode = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_concurrency.disable_process_locking = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] keystone_authtoken.auth_section = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] keystone_authtoken.auth_type = password {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] keystone_authtoken.auth_version = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] keystone_authtoken.cache = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] keystone_authtoken.certfile = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] keystone_authtoken.include_service_catalog = True {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] keystone_authtoken.insecure = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] keystone_authtoken.interface = public {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] keystone_authtoken.keyfile = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] keystone_authtoken.memcache_password = {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.046s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] keystone_authtoken.memcache_username = {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] keystone_authtoken.region_name = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] keystone_authtoken.service_token_roles_required = True {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] keystone_authtoken.service_type = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.25/identity {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cache.backend = dogpile.cache.null {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cache.backend_argument = **** {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cache.backend_expiration_time = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cache.config_prefix = cache.oslo {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cache.debug_cache_backend = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cache.enable_retry_client = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cache.enable_socket_keepalive = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cache.enabled = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cache.expiration_time = 600 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cache.hashclient_retry_attempts = 2 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cache.memcache_dead_retry = 300 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cache.memcache_pool_maxsize = 10 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cache.memcache_sasl_enabled = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cache.password = **** {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cache.proxies = [] {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cache.redis_db = 0 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cache.redis_server = localhost:6379 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cache.retry_attempts = 2 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cache.retry_delay = 0.0 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cache.socket_keepalive_count = 1 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cache.socket_keepalive_idle = 1 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cache.socket_keepalive_interval = 1 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cache.socket_timeout = 1.0 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cache.tls_allowed_ciphers = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cache.tls_cafile = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cache.tls_certfile = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cache.tls_enabled = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cache.tls_keyfile = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cache.username = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] coordination.backend_url = **** {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] database.asyncio_connection = **** {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] database.asyncio_slave_connection = **** {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] database.backend = sqlalchemy {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] database.connection = **** {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] database.connection_debug = 0 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] database.connection_parameters = {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] database.connection_recycle_time = 3600 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] database.connection_trace = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] database.db_inc_retry_interval = True {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] database.db_max_retries = 20 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] database.db_max_retry_interval = 10 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] database.db_retry_interval = 1 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] database.max_overflow = 50 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] database.max_pool_size = 5 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] database.max_retries = 10 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] database.mysql_wsrep_sync_wait = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] database.pool_timeout = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] database.retry_interval = 10 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] database.slave_connection = **** {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] database.sqlite_synchronous = True {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] database.synchronous_reader = True {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] database.use_db_reconnect = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] profiler.connection_string = messaging:// {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] profiler.enabled = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] profiler.es_doc_type = notification {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] profiler.es_scroll_size = 10000 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] profiler.es_scroll_time = 2m {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] profiler.filter_error_trace = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] profiler.hmac_keys = **** {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] profiler.sentinel_service_name = mymaster {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] profiler.socket_timeout = 0.1 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack sudo[82463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jun 24 04:50:47 devstack sudo[82463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] profiler.trace_requests = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] profiler.trace_sqlalchemy = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] profiler_jaeger.process_tags = {} {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] profiler_jaeger.service_name_prefix = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] profiler_otlp.service_name_prefix = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_policy.enforce_new_defaults = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: WARNING oslo_config.cfg [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_policy.enforce_scope = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_policy.policy_default_rule = default {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_policy.policy_file = policy.yaml {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] privsep_osbrick.group = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] privsep_osbrick.helper_command = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] privsep_osbrick.user = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cinder_sys_admin.group = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cinder_sys_admin.helper_command = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] cinder_sys_admin.user = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] service_user.auth_section = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] service_user.auth_type = password {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] service_user.cafile = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] service_user.certfile = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] service_user.collect_timing = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] service_user.insecure = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] service_user.keyfile = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] service_user.send_service_user_token = True {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] service_user.split_loggers = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] service_user.timeout = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] glance.auth_section = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] glance.auth_type = password {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] glance.certfile = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] glance.collect_timing = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] glance.insecure = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] glance.keyfile = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] glance.region_name = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] glance.split_loggers = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] glance.timeout = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.backend_availability_zone = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.chap_password = **** {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.chap_username = {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.disk_geometry = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.driver_client_cert = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.driver_client_cert_key = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.driver_data_namespace = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.driver_use_ssl = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.extra_capabilities = {} {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.filter_function = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.goodness_function = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.iscsi_target_flags = {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.iscsi_write_cache = on {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.iser_helper = tgtadm {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.iser_ip_address = 192.168.122.25 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.iser_port = 3260 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.lvm_mirrors = 0 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.lvm_share_target = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.lvm_type = auto {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.num_shell_tries = 3 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.replication_device = **** {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.report_discard_supported = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.reserved_percentage = 0 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.target_helper = tgtadm {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.target_ip_address = 192.168.122.25 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.target_port = 3260 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.target_protocol = iscsi {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.trace_flags = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.unique_fqdn_network = True {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.use_chap_auth = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.volume_backend_name = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.volume_clear = zero {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.volume_clear_ionice = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.volume_clear_size = 0 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.volume_group = cinder-volumes {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_reports.file_event_handler = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_reports.log_dir = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.backend_availability_zone = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.backend_host = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.chap_password = **** {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.chap_username = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.chiscsi_conf = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.disk_geometry = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.driver_client_cert = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.driver_data_namespace = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.driver_use_ssl = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.extra_capabilities = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.filter_function = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.goodness_function = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.iser_helper = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.iser_ip_address = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.iser_port = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.iser_target_prefix = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.lvm_conf_file = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.lvm_mirrors = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.lvm_share_target = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.lvm_type = auto {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.num_shell_tries = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.nvmet_port_id = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.replication_device = **** {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.report_discard_supported = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.reserved_percentage = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.scst_target_driver = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.storage_protocol = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.target_helper = lioadm {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.target_ip_address = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.target_port = 3260 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.target_protocol = iscsi {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.trace_flags = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.use_chap_auth = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.volume_clear = zero {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.volume_clear_size = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] lvmdriver-1.volumes_dir = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_messaging_rabbit.ssl = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_messaging_notifications.driver = [] {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_messaging_notifications.retry = -1 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] key_manager.fixed_key = **** {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] barbican.barbican_api_version = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] barbican.barbican_endpoint = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] barbican.barbican_endpoint_type = public {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] barbican.barbican_region_name = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] barbican.cafile = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] barbican.certfile = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] barbican.collect_timing = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] barbican.insecure = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] barbican.keyfile = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] barbican.number_of_retries = 60 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] barbican.retry_delay = 1 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] barbican.send_service_user_token = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] barbican.split_loggers = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] barbican.timeout = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] barbican.verify_ssl = True {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] barbican.verify_ssl_path = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] barbican_service_user.auth_section = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] barbican_service_user.auth_type = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] barbican_service_user.cafile = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] barbican_service_user.certfile = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] barbican_service_user.collect_timing = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] barbican_service_user.insecure = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] barbican_service_user.keyfile = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] barbican_service_user.split_loggers = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] barbican_service_user.timeout = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] vault.approle_role_id = **** {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] vault.approle_secret_id = **** {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] vault.kv_mountpoint = secret {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] vault.kv_path = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] vault.kv_version = 2 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] vault.namespace = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] vault.root_token_id = **** {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] vault.ssl_ca_crt_file = None {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] vault.timeout = 60.0 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] vault.use_ssl = False {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:50:47 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] ******************************************************************************** {{(pid=82292) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 24 04:50:48 devstack sudo[82463]: pam_unix(sudo:session): session closed for user root Jun 24 04:50:48 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.668s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:50:48 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:50:48 devstack sudo[82468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 04:50:48 devstack sudo[82468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:50:48 devstack sudo[82468]: pam_unix(sudo:session): session closed for user root Jun 24 04:50:48 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.622s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:50:48 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 04:50:48 devstack cinder-volume[82458]: INFO cinder.brick.local_dev.lvm [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jun 24 04:50:48 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:50:48 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:50:48 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:50:48 devstack sudo[82717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 24 04:50:48 devstack sudo[82717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:50:49 devstack sudo[82717]: pam_unix(sudo:session): session closed for user root Jun 24 04:50:49 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.650s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:50:49 devstack cinder-volume[82458]: DEBUG cinder.brick.local_dev.lvm [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=82458) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jun 24 04:50:49 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:50:49 devstack sudo[82924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 04:50:49 devstack sudo[82924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:50:51 devstack sudo[82924]: pam_unix(sudo:session): session closed for user root Jun 24 04:50:51 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.562s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:50:51 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:50:51 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:50:51 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:50:51 devstack sudo[83213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 04:50:51 devstack sudo[83213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:50:51 devstack sudo[83213]: pam_unix(sudo:session): session closed for user root Jun 24 04:50:51 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.676s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:50:51 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:50:51 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:50:51 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:50:51 devstack sudo[83244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jun 24 04:50:51 devstack sudo[83244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:50:52 devstack sudo[83244]: pam_unix(sudo:session): session closed for user root Jun 24 04:50:52 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.658s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:50:52 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:50:52 devstack sudo[83249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 24 04:50:52 devstack sudo[83249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:50:53 devstack sudo[83249]: pam_unix(sudo:session): session closed for user root Jun 24 04:50:53 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.784s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:50:53 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:50:53 devstack sudo[83258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 24 04:50:53 devstack sudo[83258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:50:54 devstack sudo[83258]: pam_unix(sudo:session): session closed for user root Jun 24 04:50:54 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.816s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:50:54 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:50:54 devstack sudo[83264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 04:50:54 devstack sudo[83264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:50:55 devstack sudo[83264]: pam_unix(sudo:session): session closed for user root Jun 24 04:50:55 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.941s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:50:55 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:50:55 devstack sudo[83271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 04:50:55 devstack sudo[83271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:50:55 devstack sudo[83271]: pam_unix(sudo:session): session closed for user root Jun 24 04:50:55 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.661s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:50:55 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:50:55 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:50:55 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:50:55 devstack sudo[83279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 04:50:55 devstack sudo[83279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:50:56 devstack sudo[83279]: pam_unix(sudo:session): session closed for user root Jun 24 04:50:56 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.657s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:50:56 devstack cinder-volume[82458]: INFO cinder.volume.drivers.lvm [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Enabling LVM thin provisioning by default because a thin pool exists. Jun 24 04:50:56 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:50:56 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:50:56 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:50:56 devstack sudo[83288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 04:50:56 devstack sudo[83288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:50:57 devstack sudo[83288]: pam_unix(sudo:session): session closed for user root Jun 24 04:50:57 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.778s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:50:57 devstack cinder-volume[82458]: DEBUG cinder.volume.drivers.lvm [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Updating volume stats {{(pid=82458) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 24 04:50:57 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:50:57 devstack sudo[83405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 24 04:50:57 devstack sudo[83405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:50:57 devstack cinder-volume[82292]: DEBUG dbcounter [-] [82292] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82292) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 04:50:57 devstack sudo[83405]: pam_unix(sudo:session): session closed for user root Jun 24 04:50:57 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.686s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:50:57 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:50:57 devstack sudo[83409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 04:50:57 devstack sudo[83409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:50:58 devstack sudo[83409]: pam_unix(sudo:session): session closed for user root Jun 24 04:50:58 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.686s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:50:58 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:50:58 devstack sudo[83550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 04:50:58 devstack sudo[83550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:50:59 devstack sudo[83550]: pam_unix(sudo:session): session closed for user root Jun 24 04:50:59 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.623s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:50:59 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:50:59 devstack sudo[83554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 04:50:59 devstack sudo[83554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:50:59 devstack sudo[83554]: pam_unix(sudo:session): session closed for user root Jun 24 04:50:59 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.649s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:50:59 devstack cinder-volume[82458]: INFO cinder.volume.driver [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Driver hasn't implemented _init_vendor_properties() Jun 24 04:50:59 devstack cinder-volume[82458]: DEBUG cinder.volume.driver [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82458) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 24 04:50:59 devstack cinder-volume[82458]: DEBUG oslo_db.sqlalchemy.engines [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82458) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 04:50:59 devstack cinder-volume[82458]: DEBUG dbcounter [-] [82458] Writer thread running {{(pid=82458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 24 04:50:59 devstack cinder-volume[82458]: DEBUG cinder.db.api [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Building query based on filter {{(pid=82458) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 24 04:50:59 devstack cinder-volume[82458]: DEBUG cinder.image.image_utils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82458) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 24 04:50:59 devstack cinder-volume[82458]: INFO cinder.keymgr.migration [None req-7816e0a5-80d6-44fd-b04f-999a31a770c2 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 24 04:50:59 devstack cinder-volume[82458]: DEBUG cinder.volume.drivers.lvm [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Updating volume stats {{(pid=82458) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 24 04:50:59 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:50:59 devstack sudo[83558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 24 04:50:59 devstack sudo[83558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:51:00 devstack sudo[83558]: pam_unix(sudo:session): session closed for user root Jun 24 04:51:00 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:51:00 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:51:00 devstack sudo[83564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 04:51:00 devstack sudo[83564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:51:01 devstack sudo[83564]: pam_unix(sudo:session): session closed for user root Jun 24 04:51:01 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.656s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:51:01 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:51:01 devstack sudo[83568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 04:51:01 devstack sudo[83568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:51:01 devstack sudo[83568]: pam_unix(sudo:session): session closed for user root Jun 24 04:51:01 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.653s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:51:01 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:51:01 devstack sudo[83574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 04:51:01 devstack sudo[83574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:51:02 devstack sudo[83574]: pam_unix(sudo:session): session closed for user root Jun 24 04:51:02 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.672s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:51:02 devstack cinder-volume[82458]: DEBUG cinder.manager [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Notifying Schedulers of capabilities ... {{(pid=82458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 04:51:02 devstack cinder-volume[82458]: INFO cinder.volume.manager [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Driver initialization completed successfully. Jun 24 04:51:02 devstack cinder-volume[82458]: INFO cinder.manager [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Initiating service 2 cleanup Jun 24 04:51:02 devstack cinder-volume[82458]: INFO cinder.manager [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Service 2 cleanup completed. Jun 24 04:51:02 devstack cinder-volume[82458]: DEBUG cinder.service [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Creating RPC server for service cinder-volume {{(pid=82458) start /opt/stack/cinder/cinder/service.py:231}} Jun 24 04:51:02 devstack cinder-volume[82458]: DEBUG cinder.service [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82458) start /opt/stack/cinder/cinder/service.py:237}} Jun 24 04:51:02 devstack cinder-volume[82458]: INFO cinder.volume.manager [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jun 24 04:51:02 devstack cinder-volume[82458]: DEBUG cinder.volume.drivers.lvm [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Updating volume stats {{(pid=82458) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 24 04:51:02 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:51:02 devstack sudo[83581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 24 04:51:02 devstack sudo[83581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:51:03 devstack sudo[83581]: pam_unix(sudo:session): session closed for user root Jun 24 04:51:03 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.702s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:51:03 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:51:03 devstack sudo[83585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 04:51:03 devstack sudo[83585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:51:04 devstack sudo[83585]: pam_unix(sudo:session): session closed for user root Jun 24 04:51:04 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.692s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:51:04 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:51:04 devstack sudo[83591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 04:51:04 devstack sudo[83591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:51:04 devstack sudo[83591]: pam_unix(sudo:session): session closed for user root Jun 24 04:51:04 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.636s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:51:04 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:51:04 devstack sudo[83594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 04:51:04 devstack sudo[83594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:51:05 devstack sudo[83594]: pam_unix(sudo:session): session closed for user root Jun 24 04:51:05 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:51:05 devstack cinder-volume[82458]: INFO cinder.volume.manager [None req-18d8abeb-5d4c-4fd3-a625-50cb8b83686b None None] Driver post RPC initialization completed successfully. Jun 24 04:51:07 devstack cinder-volume[82458]: DEBUG oslo_service.periodic_task [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] Running periodic task VolumeManager._thread_info {{(pid=82458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 04:51:07 devstack cinder-volume[82458]: DEBUG cinder.volume.manager [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] thread count: 6 {{(pid=82458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 04:51:07 devstack cinder-volume[82458]: DEBUG cinder.volume.manager [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] thread info: [<_MainThread(MainThread, started 127574207422592)>, , , , , ] {{(pid=82458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 04:51:12 devstack cinder-volume[82458]: DEBUG dbcounter [-] [82458] Writing DB stats cinder:SELECT=3 {{(pid=82458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 04:51:15 devstack cinder-volume[82458]: DEBUG dbcounter [-] [82458] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=82458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 04:52:07 devstack cinder-volume[82458]: DEBUG oslo_service.periodic_task [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 04:52:07 devstack cinder-volume[82458]: DEBUG cinder.volume.drivers.lvm [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] Updating volume stats {{(pid=82458) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 24 04:52:07 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:52:07 devstack sudo[85380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 24 04:52:07 devstack sudo[85380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:52:08 devstack sudo[85380]: pam_unix(sudo:session): session closed for user root Jun 24 04:52:08 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.652s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:52:08 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:52:08 devstack sudo[85383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 04:52:08 devstack sudo[85383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:52:08 devstack sudo[85383]: pam_unix(sudo:session): session closed for user root Jun 24 04:52:08 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.646s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:52:08 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:52:08 devstack sudo[85404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 04:52:08 devstack sudo[85404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:52:09 devstack sudo[85404]: pam_unix(sudo:session): session closed for user root Jun 24 04:52:09 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.615s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:52:09 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:52:09 devstack sudo[85408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 04:52:09 devstack sudo[85408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:52:10 devstack sudo[85408]: pam_unix(sudo:session): session closed for user root Jun 24 04:52:10 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:52:10 devstack cinder-volume[82458]: DEBUG cinder.manager [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] Notifying Schedulers of capabilities ... {{(pid=82458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 04:52:10 devstack cinder-volume[82458]: DEBUG oslo_service.periodic_task [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] Running periodic task VolumeManager._thread_info {{(pid=82458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 04:52:10 devstack cinder-volume[82458]: DEBUG cinder.volume.manager [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] thread count: 6 {{(pid=82458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 04:52:10 devstack cinder-volume[82458]: DEBUG cinder.volume.manager [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] thread info: [<_MainThread(MainThread, started 127574207422592)>, , , , , ] {{(pid=82458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 04:53:07 devstack cinder-volume[82458]: DEBUG oslo_service.periodic_task [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 04:53:07 devstack cinder-volume[82458]: DEBUG cinder.volume.drivers.lvm [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] Updating volume stats {{(pid=82458) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 24 04:53:07 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:53:07 devstack sudo[88665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 24 04:53:07 devstack sudo[88665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:53:08 devstack sudo[88665]: pam_unix(sudo:session): session closed for user root Jun 24 04:53:08 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.629s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:53:08 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:53:08 devstack sudo[88670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 04:53:08 devstack sudo[88670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:53:08 devstack sudo[88670]: pam_unix(sudo:session): session closed for user root Jun 24 04:53:08 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:53:08 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:53:08 devstack sudo[88675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 04:53:08 devstack sudo[88675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:53:09 devstack sudo[88675]: pam_unix(sudo:session): session closed for user root Jun 24 04:53:09 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.635s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:53:09 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:53:09 devstack sudo[88684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 04:53:09 devstack sudo[88684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:53:10 devstack sudo[88684]: pam_unix(sudo:session): session closed for user root Jun 24 04:53:10 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.645s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:53:10 devstack cinder-volume[82458]: DEBUG cinder.manager [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] Notifying Schedulers of capabilities ... {{(pid=82458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 04:53:10 devstack cinder-volume[82458]: DEBUG oslo_service.periodic_task [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] Running periodic task VolumeManager._thread_info {{(pid=82458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 04:53:10 devstack cinder-volume[82458]: DEBUG cinder.volume.manager [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] thread count: 6 {{(pid=82458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 04:53:10 devstack cinder-volume[82458]: DEBUG cinder.volume.manager [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] thread info: [<_MainThread(MainThread, started 127574207422592)>, , , , , ] {{(pid=82458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 04:53:15 devstack cinder-volume[82458]: DEBUG dbcounter [-] [82458] Writing DB stats cinder:SELECT=1 {{(pid=82458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 04:53:15 devstack cinder-volume[82458]: DEBUG dbcounter [-] [82458] Writing DB stats cinder:UPDATE=1 {{(pid=82458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 04:54:07 devstack cinder-volume[82458]: DEBUG oslo_service.periodic_task [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 04:54:07 devstack cinder-volume[82458]: DEBUG cinder.volume.drivers.lvm [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] Updating volume stats {{(pid=82458) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 24 04:54:07 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:54:07 devstack sudo[90091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 24 04:54:07 devstack sudo[90091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:54:08 devstack sudo[90091]: pam_unix(sudo:session): session closed for user root Jun 24 04:54:08 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.653s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:54:08 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:54:08 devstack sudo[90116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 04:54:08 devstack sudo[90116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:54:08 devstack sudo[90116]: pam_unix(sudo:session): session closed for user root Jun 24 04:54:08 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.662s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:54:08 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:54:08 devstack sudo[90165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 04:54:08 devstack sudo[90165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:54:09 devstack sudo[90165]: pam_unix(sudo:session): session closed for user root Jun 24 04:54:09 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.661s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:54:09 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:54:09 devstack sudo[90205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 04:54:09 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:54:10 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root Jun 24 04:54:10 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.657s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:54:10 devstack cinder-volume[82458]: DEBUG cinder.manager [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] Notifying Schedulers of capabilities ... {{(pid=82458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 04:54:10 devstack cinder-volume[82458]: DEBUG oslo_service.periodic_task [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] Running periodic task VolumeManager._thread_info {{(pid=82458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 04:54:10 devstack cinder-volume[82458]: DEBUG cinder.volume.manager [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] thread count: 6 {{(pid=82458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 04:54:10 devstack cinder-volume[82458]: DEBUG cinder.volume.manager [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] thread info: [<_MainThread(MainThread, started 127574207422592)>, , , , , ] {{(pid=82458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 04:55:07 devstack cinder-volume[82458]: DEBUG oslo_service.periodic_task [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 04:55:07 devstack cinder-volume[82458]: DEBUG cinder.volume.drivers.lvm [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] Updating volume stats {{(pid=82458) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 24 04:55:07 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:55:07 devstack sudo[91823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 24 04:55:07 devstack sudo[91823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:55:08 devstack sudo[91823]: pam_unix(sudo:session): session closed for user root Jun 24 04:55:08 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.654s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:55:08 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:55:08 devstack sudo[91837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 04:55:08 devstack sudo[91837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:55:08 devstack sudo[91837]: pam_unix(sudo:session): session closed for user root Jun 24 04:55:08 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.626s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:55:08 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:55:08 devstack sudo[91841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 04:55:08 devstack sudo[91841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:55:09 devstack sudo[91841]: pam_unix(sudo:session): session closed for user root Jun 24 04:55:09 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.625s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:55:09 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:55:09 devstack sudo[91856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 04:55:09 devstack sudo[91856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:55:10 devstack sudo[91856]: pam_unix(sudo:session): session closed for user root Jun 24 04:55:10 devstack cinder-volume[82458]: DEBUG oslo_concurrency.processutils [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.640s {{(pid=82458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:55:10 devstack cinder-volume[82458]: DEBUG cinder.manager [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] Notifying Schedulers of capabilities ... {{(pid=82458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 04:55:10 devstack cinder-volume[82458]: DEBUG oslo_service.periodic_task [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] Running periodic task VolumeManager._thread_info {{(pid=82458) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 04:55:10 devstack cinder-volume[82458]: DEBUG cinder.volume.manager [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] thread count: 6 {{(pid=82458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 04:55:10 devstack cinder-volume[82458]: DEBUG cinder.volume.manager [None req-3c51074d-fe69-4985-baa6-783ac390f88e None None] thread info: [<_MainThread(MainThread, started 127574207422592)>, , , , , ] {{(pid=82458) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 04:55:15 devstack cinder-volume[82458]: DEBUG dbcounter [-] [82458] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 04:55:53 devstack cinder-volume[82292]: INFO oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] Caught SIGTERM, stopping children Jun 24 04:55:53 devstack cinder-volume[82292]: DEBUG oslo_concurrency.lockutils [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] Acquiring lock "singleton_lock" {{(pid=82292) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 24 04:55:53 devstack cinder-volume[82292]: DEBUG oslo_concurrency.lockutils [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] Acquired lock "singleton_lock" {{(pid=82292) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 24 04:55:53 devstack cinder-volume[82292]: DEBUG oslo_concurrency.lockutils [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] Releasing lock "singleton_lock" {{(pid=82292) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 24 04:55:53 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] Stop services. {{(pid=82292) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 24 04:55:53 devstack cinder-volume[82292]: DEBUG oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] Killing children. {{(pid=82292) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 24 04:55:53 devstack cinder-volume[82292]: INFO oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] Waiting on 1 children to exit Jun 24 04:55:57 devstack cinder-volume[82458]: DEBUG oslo_concurrency.lockutils [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] Acquiring lock "singleton_lock" {{(pid=82458) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 24 04:55:57 devstack cinder-volume[82458]: DEBUG oslo_concurrency.lockutils [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] Acquired lock "singleton_lock" {{(pid=82458) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 24 04:55:57 devstack cinder-volume[82458]: DEBUG oslo_concurrency.lockutils [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] Releasing lock "singleton_lock" {{(pid=82458) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 24 04:55:57 devstack cinder-volume[82458]: WARNING amqp [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 24 04:55:57 devstack cinder-volume[82458]: WARNING amqp [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 24 04:55:57 devstack cinder-volume[82292]: INFO oslo_service.backend._eventlet.service [None req-cddee88a-6a71-43f6-ac89-4d1c9f3a3051 None None] Child 82458 exited with status 0 Jun 24 04:55:58 devstack cinder-volume[92977]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 24 04:55:58 devstack cinder-volume[92977]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 24 04:55:58 devstack cinder-volume[92977]: we strongly recommend against using it for new projects. Jun 24 04:55:58 devstack cinder-volume[92977]: If you are already using Eventlet, we recommend migrating to a different Jun 24 04:55:58 devstack cinder-volume[92977]: framework. For more detail see Jun 24 04:55:58 devstack cinder-volume[92977]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 24 04:55:58 devstack cinder-volume[92977]: import eventlet # noqa Jun 24 04:56:00 devstack cinder-volume[92977]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=92977) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 24 04:56:00 devstack cinder-volume[92977]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=92977) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 24 04:56:00 devstack cinder-volume[92977]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=92977) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 24 04:56:00 devstack cinder-volume[92977]: INFO dbcounter [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] Registered counter for database cinder Jun 24 04:56:00 devstack cinder-volume[92977]: DEBUG oslo_db.sqlalchemy.engines [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92977) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG dbcounter [-] [92977] Writer thread running {{(pid=92977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 24 04:56:01 devstack cinder-volume[92977]: INFO cinder.rpc [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 24 04:56:01 devstack cinder-volume[92977]: INFO cinder.rpc [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_db.sqlalchemy.engines [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92977) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 04:56:01 devstack cinder-volume[92977]: INFO cinder.volume.manager [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] Determined volume DB was empty at startup. Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG cinder.volume.manager [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=92977) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 24 04:56:01 devstack cinder-volume[92977]: INFO cinder.volume.manager [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 24 04:56:01 devstack cinder-volume[92977]: WARNING stevedore.named [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 24 04:56:01 devstack cinder-volume[92977]: WARNING castellan.key_manager [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 24 04:56:01 devstack cinder-volume[92977]: WARNING cinder.keymgr.conf_key_mgr [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 24 04:56:01 devstack cinder-volume[92977]: INFO cinder.volume.manager [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_db.sqlalchemy.engines [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92977) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 04:56:01 devstack cinder-volume[92977]: INFO oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] Starting 1 workers Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] Started child 93192 {{(pid=92977) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] Full set of CONF: {{(pid=92977) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] ******************************************************************************** {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] Configuration options gathered from: {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] ================================================================================ {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] allow_availability_zone_fallback = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] allow_compression_on_image_upload = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] allowed_direct_url_schemes = [] {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] api_rate_limit = True {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] auth_strategy = keystone {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_availability_zone = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_host = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_name = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_stats_polling_interval = 60 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backup_api_class = cinder.backup.api.API {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backup_name_template = backup-%s {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backup_use_same_host = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backup_use_temp_snapshot = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] chap_password = **** {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[93192]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] chap_username = {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cinder_internal_tenant_project_id = d6793bc8cb294ac88b8e1843c05ce080 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cinder_internal_tenant_user_id = 4a7eec64cfa74dc0b05eac602ff5b378 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cluster = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] compression_format = gzip {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] compute_api_class = cinder.compute.nova.API {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] config_dir = [] {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] config_source = [] {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] control_exchange = openstack {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] debug = True {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] default_availability_zone = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] default_group_type = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] default_volume_type = QuobyteHD {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] disk_geometry = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] driver_client_cert = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] driver_client_cert_key = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] driver_data_namespace = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] driver_ssl_cert_path = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] driver_ssl_cert_verify = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] driver_use_ssl = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] enable_new_services = True {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] enable_unsupported_driver = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] enabled_backends = ['QuobyteHD'] {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] enforce_multipath_for_image_xfer = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] filter_function = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] glance_api_insecure = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] glance_api_servers = ['http://192.168.122.25/image'] {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] glance_api_ssl_compression = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] glance_ca_certificates_file = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] glance_catalog_info = image:glance:publicURL {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] glance_certfile = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] glance_keyfile = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] glance_num_retries = 3 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] glance_request_timeout = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] goodness_function = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] graceful_shutdown_timeout = 5 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] group_api_class = cinder.group.api.API {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] host = devstack {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] image_compress_on_upload = True {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] image_conversion_address_space_limit = 1 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] image_conversion_cpu_limit = 60 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] image_conversion_disable = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] image_upload_use_cinder_backend = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] image_upload_use_internal_tenant = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] image_volume_cache_enabled = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] image_volume_cache_max_count = 0 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] image_volume_cache_max_size_gb = 0 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] init_host_max_objects_retrieval = 0 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] instance_format = [instance: %(uuid)s] {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] iscsi_target_flags = {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] iscsi_write_cache = on {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] iser_helper = tgtadm {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] iser_ip_address = 192.168.122.25 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] iser_port = 3260 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] log_color = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] log_config_append = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] log_dir = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] log_file = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] log_options = True {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] log_rotate_interval = 1 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] log_rotate_interval_type = days {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] log_rotation_type = none {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] max_age = 0 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] max_logfile_count = 30 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] max_logfile_size_mb = 200 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] max_over_subscription_ratio = 20.0 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] message_reap_interval = 86400 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] message_ttl = 2592000 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] migration_create_volume_timeout_secs = 300 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] monkey_patch = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] monkey_patch_modules = [] {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] my_ip = 192.168.122.25 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] no_snapshot_gb_quota = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] num_iser_scan_tries = 3 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] num_shell_tries = 3 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] num_volume_device_scan_tries = 3 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] nvmeof_conn_info_version = 1 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] nvmet_ns_id = 10 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] nvmet_port_id = 1 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] osapi_max_limit = 1000 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] osapi_volume_ext_list = [] {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] osapi_volume_listen = 0.0.0.0 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] osapi_volume_listen_port = 8776 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] osapi_volume_use_ssl = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] osapi_volume_workers = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] per_volume_size_limit = -1 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] periodic_fuzzy_delay = 60 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] periodic_interval = 60 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] project_id_regex = [0-9a-f\-]+ {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] public_endpoint = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] publish_errors = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] quota_backup_gigabytes = 1000 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] quota_backups = 10 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] quota_gigabytes = 1000 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] quota_groups = 10 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] quota_snapshots = 10 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] quota_volumes = 10 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] rate_limit_burst = 0 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] rate_limit_except_level = CRITICAL {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] rate_limit_interval = 0 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] reinit_driver_count = 3 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] replication_device = **** {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] report_discard_supported = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] report_interval = 120 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] reservation_clean_interval = 86400 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] reservation_expire = 86400 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] reserved_image_namespaces = [] {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] reserved_percentage = 0 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] rpc_response_timeout = 120 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] run_external_periodic_tasks = True {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] scst_target_driver = iscsi {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] scst_target_iqn_name = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] service_down_time = 720 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] shell_completion = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] snapshot_name_template = snapshot-%s {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] split_loggers = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] state_path = /opt/stack/data/cinder {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] storage_availability_zone = nova {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] storage_protocol = iSCSI {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] syslog_log_facility = LOG_USER {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] target_helper = lioadm {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] target_ip_address = 192.168.122.25 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] target_port = 3260 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] target_protocol = iscsi {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] target_secondary_ip_addresses = [] {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] trace_flags = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] transfer_api_class = cinder.transfer.api.API {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] transport_url = **** {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] until_refresh = 0 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] use_chap_auth = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] use_default_quota_class = True {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] use_journal = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] use_json = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] use_multipath_for_image_xfer = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] use_stderr = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] use_syslog = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] verify_glance_signatures = enabled {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] volume_api_class = cinder.volume.api.API {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] volume_backend_name = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[93192]: INFO cinder.volume.manager [None req-93282686-91a5-4ea7-9a89-baddd9e61f59 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] volume_clear = zero {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[93192]: DEBUG cinder.volume.drivers.remotefs [None req-93282686-91a5-4ea7-9a89-baddd9e61f59 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93192) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] volume_clear_ionice = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] volume_clear_size = 0 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] volume_copy_bps_limit = 0 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] volume_dd_blocksize = 1M {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] volume_name_template = volume-%s {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] volume_service_inithost_offload = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] volume_usage_audit_period = month {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] zoning_mode = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_concurrency.disable_process_locking = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] keystone_authtoken.auth_section = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] keystone_authtoken.auth_type = password {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] keystone_authtoken.auth_version = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] keystone_authtoken.cache = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] keystone_authtoken.certfile = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] keystone_authtoken.include_service_catalog = True {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] keystone_authtoken.insecure = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] keystone_authtoken.interface = public {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] keystone_authtoken.keyfile = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] keystone_authtoken.memcache_password = {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] keystone_authtoken.memcache_username = {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] keystone_authtoken.region_name = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] keystone_authtoken.service_token_roles_required = True {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] keystone_authtoken.service_type = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.25/identity {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cache.backend = dogpile.cache.null {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cache.backend_argument = **** {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cache.backend_expiration_time = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cache.config_prefix = cache.oslo {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cache.debug_cache_backend = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cache.enable_retry_client = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cache.enable_socket_keepalive = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cache.enabled = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cache.expiration_time = 600 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cache.hashclient_retry_attempts = 2 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cache.memcache_dead_retry = 300 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cache.memcache_pool_maxsize = 10 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cache.memcache_sasl_enabled = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cache.password = **** {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cache.proxies = [] {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cache.redis_db = 0 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cache.redis_server = localhost:6379 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cache.retry_attempts = 2 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cache.retry_delay = 0.0 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cache.socket_keepalive_count = 1 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cache.socket_keepalive_idle = 1 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cache.socket_keepalive_interval = 1 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cache.socket_timeout = 1.0 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cache.tls_allowed_ciphers = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cache.tls_cafile = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cache.tls_certfile = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cache.tls_enabled = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cache.tls_keyfile = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cache.username = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] coordination.backend_url = **** {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] database.asyncio_connection = **** {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] database.asyncio_slave_connection = **** {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] database.backend = sqlalchemy {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] database.connection = **** {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] database.connection_debug = 0 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] database.connection_parameters = {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] database.connection_recycle_time = 3600 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] database.connection_trace = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] database.db_inc_retry_interval = True {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] database.db_max_retries = 20 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] database.db_max_retry_interval = 10 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] database.db_retry_interval = 1 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] database.max_overflow = 50 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] database.max_pool_size = 5 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] database.max_retries = 10 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] database.mysql_wsrep_sync_wait = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] database.pool_timeout = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] database.retry_interval = 10 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] database.slave_connection = **** {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] database.sqlite_synchronous = True {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] database.synchronous_reader = True {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] database.use_db_reconnect = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] profiler.connection_string = messaging:// {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] profiler.enabled = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] profiler.es_doc_type = notification {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] profiler.es_scroll_size = 10000 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] profiler.es_scroll_time = 2m {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] profiler.filter_error_trace = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] profiler.hmac_keys = **** {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] profiler.sentinel_service_name = mymaster {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] profiler.socket_timeout = 0.1 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] profiler.trace_requests = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] profiler.trace_sqlalchemy = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] profiler_jaeger.process_tags = {} {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] profiler_jaeger.service_name_prefix = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] profiler_otlp.service_name_prefix = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_policy.enforce_new_defaults = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: WARNING oslo_config.cfg [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_policy.enforce_scope = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_policy.policy_default_rule = default {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_policy.policy_file = policy.yaml {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_policy.remote_timeout = 60.0 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] privsep_osbrick.group = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] privsep_osbrick.helper_command = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] privsep_osbrick.user = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cinder_sys_admin.group = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cinder_sys_admin.helper_command = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] cinder_sys_admin.user = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] service_user.auth_section = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] service_user.auth_type = password {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] service_user.cafile = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] service_user.certfile = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] service_user.collect_timing = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] service_user.insecure = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] service_user.keyfile = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] service_user.send_service_user_token = True {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] service_user.split_loggers = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] service_user.timeout = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] glance.auth_section = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] glance.auth_type = password {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] glance.certfile = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] glance.collect_timing = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] glance.insecure = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] glance.keyfile = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] glance.region_name = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] glance.split_loggers = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] glance.timeout = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.backend_availability_zone = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.chap_password = **** {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.chap_username = {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.disk_geometry = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.driver_client_cert = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.driver_client_cert_key = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.driver_data_namespace = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.driver_use_ssl = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.extra_capabilities = {} {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.filter_function = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.goodness_function = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.iscsi_target_flags = {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.iscsi_write_cache = on {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.iser_helper = tgtadm {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.iser_ip_address = 192.168.122.25 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.iser_port = 3260 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.nas_host = {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.nas_login = admin {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.nas_mount_options = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.nas_password = **** {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.nas_private_key = {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.nas_share_path = {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.nas_ssh_port = 22 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.num_shell_tries = 3 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.quobyte_client_cfg = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[93192]: DEBUG cinder.volume.drivers.quobyte [None req-93282686-91a5-4ea7-9a89-baddd9e61f59 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93192) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 24 04:56:01 devstack cinder-volume[93192]: WARNING cinder.volume.drivers.quobyte [None req-93282686-91a5-4ea7-9a89-baddd9e61f59 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 24 04:56:01 devstack cinder-volume[93192]: WARNING cinder.volume.drivers.quobyte [None req-93282686-91a5-4ea7-9a89-baddd9e61f59 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 24 04:56:01 devstack cinder-volume[93192]: DEBUG oslo_concurrency.processutils [None req-93282686-91a5-4ea7-9a89-baddd9e61f59 None None] Running cmd (subprocess): mount.quobyte {{(pid=93192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.quobyte_volume_url = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.replication_device = **** {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.report_discard_supported = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.reserved_percentage = 0 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.target_helper = tgtadm {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.target_ip_address = 192.168.122.25 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.target_port = 3260 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.target_protocol = iscsi {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.trace_flags = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.unique_fqdn_network = True {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.use_chap_auth = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.volume_backend_name = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.volume_clear = zero {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.volume_clear_ionice = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.volume_clear_size = 0 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_reports.file_event_handler = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_reports.log_dir = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.backend_availability_zone = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.backend_host = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.chap_password = **** {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.chap_username = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.chiscsi_conf = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.disk_geometry = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.driver_client_cert = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.driver_client_cert_key = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.driver_data_namespace = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.driver_use_ssl = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.extra_capabilities = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.filter_function = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.goodness_function = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.iscsi_target_flags = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.iscsi_write_cache = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.iser_helper = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.iser_ip_address = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.iser_port = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.iser_target_prefix = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.nas_host = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.nas_login = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.nas_mount_options = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.nas_password = **** {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.nas_private_key = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.nas_share_path = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.nas_ssh_port = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.num_shell_tries = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.nvmet_ns_id = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.nvmet_port_id = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.replication_device = **** {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.report_discard_supported = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.reserved_percentage = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.scst_target_driver = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.storage_protocol = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.target_helper = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.target_ip_address = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.target_port = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.target_prefix = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.target_protocol = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.trace_flags = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.unique_fqdn_network = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.use_chap_auth = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.volume_clear = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.volume_clear_ionice = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.volume_clear_size = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] QuobyteHD.volumes_dir = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_messaging_rabbit.ssl = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_messaging_rabbit.ssl_version = {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_messaging_notifications.driver = [] {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_messaging_notifications.retry = -1 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] key_manager.fixed_key = **** {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] barbican.barbican_api_version = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] barbican.barbican_endpoint = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] barbican.barbican_endpoint_type = public {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] barbican.barbican_region_name = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] barbican.cafile = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] barbican.certfile = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] barbican.collect_timing = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] barbican.insecure = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] barbican.keyfile = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] barbican.number_of_retries = 60 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] barbican.retry_delay = 1 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] barbican.send_service_user_token = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] barbican.split_loggers = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] barbican.timeout = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] barbican.verify_ssl = True {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] barbican.verify_ssl_path = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] barbican_service_user.auth_section = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] barbican_service_user.auth_type = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] barbican_service_user.cafile = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] barbican_service_user.certfile = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] barbican_service_user.collect_timing = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] barbican_service_user.insecure = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] barbican_service_user.keyfile = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] barbican_service_user.split_loggers = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] barbican_service_user.timeout = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] vault.approle_role_id = **** {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] vault.approle_secret_id = **** {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] vault.kv_mountpoint = secret {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] vault.kv_path = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] vault.kv_version = 2 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] vault.namespace = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] vault.root_token_id = **** {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] vault.ssl_ca_crt_file = None {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] vault.timeout = 60.0 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] vault.use_ssl = False {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:01 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] ******************************************************************************** {{(pid=92977) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 24 04:56:02 devstack quobyte-client[93197]: Reading configuration file: /etc/quobyte/client.cfg Jun 24 04:56:02 devstack quobyte-client[93197]: Invalid parameters found, error: missing mount point. Jun 24 04:56:02 devstack quobyte-client[93197]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 24 04:56:02 devstack quobyte-client[93197]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 24 04:56:02 devstack cinder-volume[93192]: DEBUG oslo_concurrency.processutils [None req-93282686-91a5-4ea7-9a89-baddd9e61f59 None None] CMD "mount.quobyte" returned: 1 in 0.120s {{(pid=93192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:56:02 devstack cinder-volume[93192]: DEBUG oslo_concurrency.lockutils [None req-93282686-91a5-4ea7-9a89-baddd9e61f59 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 04:56:02 devstack cinder-volume[93192]: DEBUG oslo_concurrency.lockutils [None req-93282686-91a5-4ea7-9a89-baddd9e61f59 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 04:56:02 devstack cinder-volume[93192]: DEBUG cinder.volume.drivers.quobyte [None req-93282686-91a5-4ea7-9a89-baddd9e61f59 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 04:56:02 devstack cinder-volume[93192]: INFO cinder.volume.drivers.quobyte [None req-93282686-91a5-4ea7-9a89-baddd9e61f59 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 ... Jun 24 04:56:02 devstack cinder-volume[93192]: DEBUG oslo_concurrency.processutils [None req-93282686-91a5-4ea7-9a89-baddd9e61f59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e -c /etc/quobyte/client-cinder.cfg {{(pid=93192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:56:02 devstack sudo[93198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e -c /etc/quobyte/client-cinder.cfg Jun 24 04:56:02 devstack sudo[93198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:56:02 devstack sudo[93198]: pam_unix(sudo:session): session closed for user root Jun 24 04:56:02 devstack cinder-volume[93192]: DEBUG oslo_concurrency.processutils [None req-93282686-91a5-4ea7-9a89-baddd9e61f59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.757s {{(pid=93192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:56:02 devstack cinder-volume[93192]: INFO cinder.volume.drivers.quobyte [None req-93282686-91a5-4ea7-9a89-baddd9e61f59 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 succeeded Jun 24 04:56:02 devstack cinder-volume[93192]: DEBUG cinder.volume.drivers.quobyte [None req-93282686-91a5-4ea7-9a89-baddd9e61f59 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 04:56:02 devstack cinder-volume[93192]: DEBUG oslo_concurrency.lockutils [None req-93282686-91a5-4ea7-9a89-baddd9e61f59 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.770s {{(pid=93192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 04:56:02 devstack cinder-volume[93192]: DEBUG oslo_concurrency.processutils [None req-93282686-91a5-4ea7-9a89-baddd9e61f59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:56:02 devstack sudo[93273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 04:56:02 devstack sudo[93273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:56:03 devstack sudo[93273]: pam_unix(sudo:session): session closed for user root Jun 24 04:56:03 devstack cinder-volume[93192]: DEBUG oslo_concurrency.processutils [None req-93282686-91a5-4ea7-9a89-baddd9e61f59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.632s {{(pid=93192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:56:03 devstack cinder-volume[93192]: INFO cinder.volume.driver [None req-93282686-91a5-4ea7-9a89-baddd9e61f59 None None] Driver hasn't implemented _init_vendor_properties() Jun 24 04:56:03 devstack cinder-volume[93192]: DEBUG cinder.volume.driver [None req-93282686-91a5-4ea7-9a89-baddd9e61f59 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757827758789, 'free_capacity_gb': 1775.757827758789, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93192) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 24 04:56:03 devstack cinder-volume[93192]: DEBUG oslo_db.sqlalchemy.engines [None req-93282686-91a5-4ea7-9a89-baddd9e61f59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93192) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 04:56:03 devstack cinder-volume[93192]: DEBUG dbcounter [-] [93192] Writer thread running {{(pid=93192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 24 04:56:03 devstack cinder-volume[93192]: DEBUG cinder.db.api [None req-93282686-91a5-4ea7-9a89-baddd9e61f59 None None] Building query based on filter {{(pid=93192) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 24 04:56:03 devstack cinder-volume[93192]: DEBUG cinder.image.image_utils [None req-93282686-91a5-4ea7-9a89-baddd9e61f59 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93192) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 24 04:56:03 devstack cinder-volume[93192]: INFO cinder.keymgr.migration [None req-730e127c-ffff-4f64-a61d-024d7172bd84 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 24 04:56:03 devstack cinder-volume[93192]: DEBUG oslo_concurrency.lockutils [None req-93282686-91a5-4ea7-9a89-baddd9e61f59 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 04:56:03 devstack cinder-volume[93192]: DEBUG oslo_concurrency.lockutils [None req-93282686-91a5-4ea7-9a89-baddd9e61f59 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 04:56:03 devstack cinder-volume[93192]: DEBUG cinder.volume.drivers.quobyte [None req-93282686-91a5-4ea7-9a89-baddd9e61f59 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 04:56:03 devstack cinder-volume[93192]: DEBUG cinder.volume.drivers.quobyte [None req-93282686-91a5-4ea7-9a89-baddd9e61f59 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 04:56:03 devstack cinder-volume[93192]: DEBUG oslo_concurrency.lockutils [None req-93282686-91a5-4ea7-9a89-baddd9e61f59 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 04:56:03 devstack cinder-volume[93192]: DEBUG oslo_concurrency.processutils [None req-93282686-91a5-4ea7-9a89-baddd9e61f59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:56:03 devstack sudo[93276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 04:56:03 devstack sudo[93276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:56:04 devstack sudo[93276]: pam_unix(sudo:session): session closed for user root Jun 24 04:56:04 devstack cinder-volume[93192]: DEBUG oslo_concurrency.processutils [None req-93282686-91a5-4ea7-9a89-baddd9e61f59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.642s {{(pid=93192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:56:04 devstack cinder-volume[93192]: DEBUG cinder.manager [None req-93282686-91a5-4ea7-9a89-baddd9e61f59 None None] Notifying Schedulers of capabilities ... {{(pid=93192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 04:56:04 devstack cinder-volume[93192]: INFO cinder.volume.manager [None req-93282686-91a5-4ea7-9a89-baddd9e61f59 None None] Driver initialization completed successfully. Jun 24 04:56:04 devstack cinder-volume[93192]: INFO cinder.manager [None req-93282686-91a5-4ea7-9a89-baddd9e61f59 None None] Initiating service 3 cleanup Jun 24 04:56:04 devstack cinder-volume[93192]: INFO cinder.manager [None req-93282686-91a5-4ea7-9a89-baddd9e61f59 None None] Service 3 cleanup completed. Jun 24 04:56:04 devstack cinder-volume[93192]: DEBUG cinder.service [None req-93282686-91a5-4ea7-9a89-baddd9e61f59 None None] Creating RPC server for service cinder-volume {{(pid=93192) start /opt/stack/cinder/cinder/service.py:231}} Jun 24 04:56:04 devstack cinder-volume[93192]: DEBUG cinder.service [None req-93282686-91a5-4ea7-9a89-baddd9e61f59 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93192) start /opt/stack/cinder/cinder/service.py:237}} Jun 24 04:56:04 devstack cinder-volume[93192]: INFO cinder.volume.manager [None req-93282686-91a5-4ea7-9a89-baddd9e61f59 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 24 04:56:04 devstack cinder-volume[93192]: DEBUG oslo_concurrency.lockutils [None req-93282686-91a5-4ea7-9a89-baddd9e61f59 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 04:56:04 devstack cinder-volume[93192]: DEBUG oslo_concurrency.lockutils [None req-93282686-91a5-4ea7-9a89-baddd9e61f59 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 04:56:04 devstack cinder-volume[93192]: DEBUG cinder.volume.drivers.quobyte [None req-93282686-91a5-4ea7-9a89-baddd9e61f59 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 04:56:04 devstack cinder-volume[93192]: DEBUG cinder.volume.drivers.quobyte [None req-93282686-91a5-4ea7-9a89-baddd9e61f59 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 04:56:04 devstack cinder-volume[93192]: DEBUG oslo_concurrency.lockutils [None req-93282686-91a5-4ea7-9a89-baddd9e61f59 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 04:56:04 devstack cinder-volume[93192]: DEBUG oslo_concurrency.processutils [None req-93282686-91a5-4ea7-9a89-baddd9e61f59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:56:04 devstack sudo[93283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 04:56:04 devstack sudo[93283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:56:05 devstack sudo[93283]: pam_unix(sudo:session): session closed for user root Jun 24 04:56:05 devstack cinder-volume[93192]: DEBUG oslo_concurrency.processutils [None req-93282686-91a5-4ea7-9a89-baddd9e61f59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.674s {{(pid=93192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:56:05 devstack cinder-volume[93192]: INFO cinder.volume.manager [None req-93282686-91a5-4ea7-9a89-baddd9e61f59 None None] Driver post RPC initialization completed successfully. Jun 24 04:56:09 devstack cinder-volume[93192]: DEBUG oslo_concurrency.lockutils [None req-239f3d6e-58c0-4927-b1f7-78d09ad10ad0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 04:56:09 devstack cinder-volume[93192]: DEBUG oslo_concurrency.lockutils [None req-239f3d6e-58c0-4927-b1f7-78d09ad10ad0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 04:56:09 devstack cinder-volume[93192]: DEBUG cinder.volume.drivers.quobyte [None req-239f3d6e-58c0-4927-b1f7-78d09ad10ad0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 04:56:09 devstack cinder-volume[93192]: DEBUG cinder.volume.drivers.quobyte [None req-239f3d6e-58c0-4927-b1f7-78d09ad10ad0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 04:56:09 devstack cinder-volume[93192]: DEBUG oslo_concurrency.lockutils [None req-239f3d6e-58c0-4927-b1f7-78d09ad10ad0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 04:56:09 devstack cinder-volume[93192]: DEBUG oslo_concurrency.processutils [None req-239f3d6e-58c0-4927-b1f7-78d09ad10ad0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:56:09 devstack sudo[93397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 04:56:09 devstack sudo[93397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:56:09 devstack sudo[93397]: pam_unix(sudo:session): session closed for user root Jun 24 04:56:09 devstack cinder-volume[93192]: DEBUG oslo_concurrency.processutils [None req-239f3d6e-58c0-4927-b1f7-78d09ad10ad0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.619s {{(pid=93192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:56:09 devstack cinder-volume[93192]: DEBUG cinder.manager [None req-239f3d6e-58c0-4927-b1f7-78d09ad10ad0 None None] Notifying Schedulers of capabilities ... {{(pid=93192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 04:56:11 devstack cinder-volume[92977]: DEBUG dbcounter [-] [92977] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=92977) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 04:56:11 devstack cinder-volume[92977]: INFO oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] Caught SIGTERM, stopping children Jun 24 04:56:11 devstack cinder-volume[92977]: DEBUG oslo_concurrency.lockutils [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] Acquiring lock "singleton_lock" {{(pid=92977) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 24 04:56:11 devstack cinder-volume[92977]: DEBUG oslo_concurrency.lockutils [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] Acquired lock "singleton_lock" {{(pid=92977) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 24 04:56:11 devstack cinder-volume[92977]: DEBUG oslo_concurrency.lockutils [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] Releasing lock "singleton_lock" {{(pid=92977) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 24 04:56:11 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] Stop services. {{(pid=92977) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 24 04:56:11 devstack cinder-volume[92977]: DEBUG oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] Killing children. {{(pid=92977) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 24 04:56:11 devstack cinder-volume[92977]: INFO oslo_service.backend._eventlet.service [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] Waiting on 1 children to exit Jun 24 04:56:15 devstack cinder-volume[93192]: DEBUG dbcounter [-] [93192] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=93192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 04:56:15 devstack cinder-volume[93192]: DEBUG dbcounter [-] [93192] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=93192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 04:56:16 devstack cinder-volume[93192]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jun 24 04:56:17 devstack cinder-volume[93488]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 24 04:56:17 devstack cinder-volume[93488]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 24 04:56:17 devstack cinder-volume[93488]: we strongly recommend against using it for new projects. Jun 24 04:56:17 devstack cinder-volume[93488]: If you are already using Eventlet, we recommend migrating to a different Jun 24 04:56:17 devstack cinder-volume[93488]: framework. For more detail see Jun 24 04:56:17 devstack cinder-volume[93488]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 24 04:56:17 devstack cinder-volume[93488]: import eventlet # noqa Jun 24 04:56:17 devstack cinder-volume[93192]: DEBUG oslo_concurrency.lockutils [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] Acquiring lock "singleton_lock" {{(pid=93192) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 24 04:56:17 devstack cinder-volume[93192]: DEBUG oslo_concurrency.lockutils [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] Acquired lock "singleton_lock" {{(pid=93192) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 24 04:56:17 devstack cinder-volume[93192]: DEBUG oslo_concurrency.lockutils [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] Releasing lock "singleton_lock" {{(pid=93192) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 24 04:56:17 devstack cinder-volume[93192]: WARNING amqp [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 24 04:56:17 devstack cinder-volume[93192]: WARNING amqp [None req-2d1ffb1a-c382-42c0-bd76-6dd8822bb8e2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 24 04:56:19 devstack cinder-volume[93488]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93488) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 24 04:56:19 devstack cinder-volume[93488]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93488) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 24 04:56:19 devstack cinder-volume[93488]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93488) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 24 04:56:20 devstack cinder-volume[93488]: INFO dbcounter [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] Registered counter for database cinder Jun 24 04:56:20 devstack cinder-volume[93488]: DEBUG oslo_db.sqlalchemy.engines [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93488) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 04:56:20 devstack cinder-volume[93488]: DEBUG dbcounter [-] [93488] Writer thread running {{(pid=93488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 24 04:56:20 devstack cinder-volume[93488]: INFO cinder.rpc [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 24 04:56:20 devstack cinder-volume[93488]: INFO cinder.rpc [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_db.sqlalchemy.engines [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93488) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 04:56:21 devstack cinder-volume[93488]: INFO cinder.volume.manager [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] Determined volume DB was empty at startup. Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG cinder.volume.manager [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93488) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 24 04:56:21 devstack cinder-volume[93488]: WARNING stevedore.named [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 24 04:56:21 devstack cinder-volume[93488]: WARNING castellan.key_manager [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 24 04:56:21 devstack cinder-volume[93488]: WARNING cinder.keymgr.conf_key_mgr [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 24 04:56:21 devstack cinder-volume[93488]: INFO cinder.volume.manager [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_db.sqlalchemy.engines [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93488) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 04:56:21 devstack cinder-volume[93488]: INFO oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] Starting 1 workers Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] Started child 93830 {{(pid=93488) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] Full set of CONF: {{(pid=93488) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] ******************************************************************************** {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] Configuration options gathered from: {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 24 04:56:21 devstack cinder-volume[93830]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] ================================================================================ {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] allow_availability_zone_fallback = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] allow_compression_on_image_upload = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] allowed_direct_url_schemes = [] {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] api_rate_limit = True {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] auth_strategy = keystone {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_availability_zone = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_host = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_name = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_stats_polling_interval = 60 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backup_api_class = cinder.backup.api.API {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backup_name_template = backup-%s {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backup_use_same_host = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backup_use_temp_snapshot = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] chap_password = **** {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] chap_username = {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cinder_internal_tenant_project_id = d6793bc8cb294ac88b8e1843c05ce080 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cinder_internal_tenant_user_id = 4a7eec64cfa74dc0b05eac602ff5b378 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cluster = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] compression_format = gzip {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] compute_api_class = cinder.compute.nova.API {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] config_dir = [] {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] config_source = [] {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] control_exchange = openstack {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] debug = True {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] default_availability_zone = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] default_group_type = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] default_volume_type = QuobyteHD {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] disk_geometry = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] driver_client_cert = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] driver_client_cert_key = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] driver_data_namespace = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] driver_ssl_cert_path = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] driver_ssl_cert_verify = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] driver_use_ssl = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] enable_new_services = True {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] enable_unsupported_driver = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] enabled_backends = ['QuobyteHD'] {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] enforce_multipath_for_image_xfer = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] filter_function = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] glance_api_insecure = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] glance_api_servers = ['http://192.168.122.25/image'] {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] glance_api_ssl_compression = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] glance_ca_certificates_file = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] glance_catalog_info = image:glance:publicURL {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] glance_certfile = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] glance_keyfile = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] glance_num_retries = 3 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] glance_request_timeout = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] goodness_function = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] graceful_shutdown_timeout = 5 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] group_api_class = cinder.group.api.API {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] host = devstack {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] image_compress_on_upload = True {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] image_conversion_address_space_limit = 1 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] image_conversion_cpu_limit = 60 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] image_conversion_disable = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] image_upload_use_cinder_backend = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] image_upload_use_internal_tenant = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] image_volume_cache_enabled = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] image_volume_cache_max_count = 0 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] image_volume_cache_max_size_gb = 0 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] init_host_max_objects_retrieval = 0 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] instance_format = [instance: %(uuid)s] {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] iscsi_target_flags = {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] iscsi_write_cache = on {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] iser_helper = tgtadm {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] iser_ip_address = 192.168.122.25 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] iser_port = 3260 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] log_color = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] log_config_append = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] log_dir = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] log_file = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] log_options = True {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] log_rotate_interval = 1 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] log_rotate_interval_type = days {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] log_rotation_type = none {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] max_age = 0 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] max_logfile_count = 30 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] max_logfile_size_mb = 200 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] max_over_subscription_ratio = 20.0 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] message_reap_interval = 86400 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] message_ttl = 2592000 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] migration_create_volume_timeout_secs = 300 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] monkey_patch = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] monkey_patch_modules = [] {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] my_ip = 192.168.122.25 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] no_snapshot_gb_quota = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] num_iser_scan_tries = 3 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] num_shell_tries = 3 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-4adc259f-c8c8-4b15-8830-1d2982ad9b86 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] num_volume_device_scan_tries = 3 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] nvmeof_conn_info_version = 1 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] nvmet_ns_id = 10 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] nvmet_port_id = 1 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-4adc259f-c8c8-4b15-8830-1d2982ad9b86 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93830) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] osapi_max_limit = 1000 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] osapi_volume_ext_list = [] {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] osapi_volume_listen = 0.0.0.0 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] osapi_volume_listen_port = 8776 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] osapi_volume_use_ssl = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] osapi_volume_workers = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] per_volume_size_limit = -1 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] periodic_fuzzy_delay = 60 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] periodic_interval = 60 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] project_id_regex = [0-9a-f\-]+ {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] public_endpoint = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] publish_errors = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] quota_backup_gigabytes = 1000 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] quota_backups = 10 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] quota_gigabytes = 1000 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] quota_groups = 10 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] quota_snapshots = 10 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] quota_volumes = 10 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] rate_limit_burst = 0 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] rate_limit_except_level = CRITICAL {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] rate_limit_interval = 0 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] reinit_driver_count = 3 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] replication_device = **** {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] report_discard_supported = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] report_interval = 120 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] reservation_clean_interval = 86400 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] reservation_expire = 86400 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] reserved_image_namespaces = [] {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] reserved_percentage = 0 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] rpc_response_timeout = 120 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] run_external_periodic_tasks = True {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] scst_target_driver = iscsi {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] scst_target_iqn_name = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] service_down_time = 720 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] shell_completion = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] snapshot_name_template = snapshot-%s {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] split_loggers = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] state_path = /opt/stack/data/cinder {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] storage_availability_zone = nova {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] storage_protocol = iSCSI {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] syslog_log_facility = LOG_USER {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] target_helper = lioadm {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] target_ip_address = 192.168.122.25 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] target_port = 3260 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] target_protocol = iscsi {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] target_secondary_ip_addresses = [] {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] trace_flags = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] transfer_api_class = cinder.transfer.api.API {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] transport_url = **** {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] until_refresh = 0 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] use_chap_auth = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] use_default_quota_class = True {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] use_journal = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] use_json = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] use_multipath_for_image_xfer = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] use_stderr = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] use_syslog = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] verify_glance_signatures = enabled {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] volume_api_class = cinder.volume.api.API {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] volume_backend_name = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] volume_clear = zero {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] volume_clear_ionice = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] volume_clear_size = 0 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] volume_copy_bps_limit = 0 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] volume_dd_blocksize = 1M {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] volume_name_template = volume-%s {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] volume_service_inithost_offload = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] volume_usage_audit_period = month {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] zoning_mode = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_concurrency.disable_process_locking = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] keystone_authtoken.auth_section = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] keystone_authtoken.auth_type = password {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] keystone_authtoken.auth_version = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] keystone_authtoken.cache = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] keystone_authtoken.certfile = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] keystone_authtoken.delay_auth_decision = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] keystone_authtoken.http_connect_timeout = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] keystone_authtoken.include_service_catalog = True {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] keystone_authtoken.insecure = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] keystone_authtoken.interface = public {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] keystone_authtoken.keyfile = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] keystone_authtoken.memcache_password = {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] keystone_authtoken.memcache_username = {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] keystone_authtoken.region_name = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] keystone_authtoken.service_token_roles_required = True {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] keystone_authtoken.service_type = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] keystone_authtoken.token_cache_time = 300 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.25/identity {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cache.backend = dogpile.cache.null {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cache.backend_argument = **** {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cache.backend_expiration_time = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cache.config_prefix = cache.oslo {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cache.debug_cache_backend = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cache.enable_retry_client = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cache.enable_socket_keepalive = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cache.enabled = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cache.expiration_time = 600 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cache.hashclient_retry_attempts = 2 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cache.memcache_dead_retry = 300 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-4adc259f-c8c8-4b15-8830-1d2982ad9b86 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93830) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 24 04:56:21 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.quobyte [None req-4adc259f-c8c8-4b15-8830-1d2982ad9b86 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 24 04:56:21 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.quobyte [None req-4adc259f-c8c8-4b15-8830-1d2982ad9b86 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 24 04:56:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4adc259f-c8c8-4b15-8830-1d2982ad9b86 None None] Running cmd (subprocess): mount.quobyte {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cache.memcache_pool_maxsize = 10 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cache.memcache_sasl_enabled = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cache.password = **** {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cache.proxies = [] {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cache.redis_db = 0 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cache.redis_sentinel_service_name = mymaster {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cache.redis_server = localhost:6379 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cache.retry_attempts = 2 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cache.retry_delay = 0.0 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cache.socket_keepalive_count = 1 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cache.socket_keepalive_idle = 1 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cache.socket_keepalive_interval = 1 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cache.socket_timeout = 1.0 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cache.tls_allowed_ciphers = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cache.tls_cafile = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cache.tls_certfile = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cache.tls_enabled = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cache.tls_keyfile = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cache.username = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] coordination.backend_url = **** {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] database.asyncio_connection = **** {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] database.asyncio_slave_connection = **** {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] database.backend = sqlalchemy {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] database.connection = **** {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] database.connection_debug = 0 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] database.connection_parameters = {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] database.connection_recycle_time = 3600 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] database.connection_trace = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] database.db_inc_retry_interval = True {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] database.db_max_retries = 20 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] database.db_max_retry_interval = 10 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] database.db_retry_interval = 1 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] database.max_overflow = 50 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] database.max_pool_size = 5 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] database.max_retries = 10 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] database.mysql_wsrep_sync_wait = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] database.pool_timeout = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] database.retry_interval = 10 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] database.slave_connection = **** {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] database.sqlite_synchronous = True {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] database.synchronous_reader = True {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] database.use_db_reconnect = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] profiler.connection_string = messaging:// {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] profiler.enabled = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] profiler.es_doc_type = notification {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] profiler.es_scroll_size = 10000 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] profiler.es_scroll_time = 2m {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] profiler.filter_error_trace = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] profiler.hmac_keys = **** {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] profiler.sentinel_service_name = mymaster {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] profiler.socket_timeout = 0.1 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] profiler.trace_requests = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] profiler.trace_sqlalchemy = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] profiler_jaeger.process_tags = {} {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] profiler_jaeger.service_name_prefix = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] profiler_otlp.service_name_prefix = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_policy.enforce_new_defaults = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: WARNING oslo_config.cfg [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_policy.enforce_scope = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_policy.policy_default_rule = default {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_policy.policy_file = policy.yaml {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_policy.remote_timeout = 60.0 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] privsep_osbrick.group = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] privsep_osbrick.helper_command = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] privsep_osbrick.user = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cinder_sys_admin.group = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cinder_sys_admin.helper_command = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] cinder_sys_admin.user = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] service_user.auth_section = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] service_user.auth_type = password {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] service_user.cafile = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] service_user.certfile = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] service_user.collect_timing = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] service_user.insecure = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] service_user.keyfile = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] service_user.send_service_user_token = True {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] service_user.split_loggers = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] service_user.timeout = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] glance.auth_section = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] glance.auth_type = password {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] glance.certfile = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] glance.collect_timing = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] glance.insecure = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] glance.keyfile = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] glance.region_name = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] glance.split_loggers = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] glance.timeout = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.backend_availability_zone = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.chap_password = **** {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.chap_username = {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.disk_geometry = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.driver_client_cert = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.driver_client_cert_key = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.driver_data_namespace = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.driver_use_ssl = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.enable_unsupported_driver = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.extra_capabilities = {} {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.filter_function = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.goodness_function = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.iscsi_target_flags = {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.iscsi_write_cache = on {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.iser_helper = tgtadm {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.iser_ip_address = 192.168.122.25 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.iser_port = 3260 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.nas_host = {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.nas_login = admin {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.nas_mount_options = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.nas_password = **** {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.nas_private_key = {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.nas_share_path = {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.nas_ssh_port = 22 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.num_shell_tries = 3 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.nvmet_port_id = 1 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.quobyte_client_cfg = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.quobyte_volume_url = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.replication_device = **** {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.report_discard_supported = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.reserved_percentage = 0 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.scst_target_driver = iscsi {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.scst_target_iqn_name = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.storage_protocol = iSCSI {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.target_helper = tgtadm {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.target_ip_address = 192.168.122.25 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.target_port = 3260 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.target_protocol = iscsi {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.trace_flags = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.unique_fqdn_network = True {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.use_chap_auth = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.volume_backend_name = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.volume_clear = zero {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.volume_clear_ionice = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.volume_clear_size = 0 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_reports.file_event_handler = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_reports.log_dir = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.backend_availability_zone = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.backend_host = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.chap_password = **** {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.chap_username = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.chiscsi_conf = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.disk_geometry = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.driver_client_cert = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.driver_client_cert_key = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.driver_data_namespace = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.driver_use_ssl = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.enable_unsupported_driver = True {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.extra_capabilities = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.filter_function = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.goodness_function = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.iscsi_target_flags = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.iscsi_write_cache = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.iser_helper = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.iser_ip_address = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.iser_port = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.iser_target_prefix = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.nas_host = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.nas_login = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.nas_mount_options = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.nas_password = **** {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.nas_private_key = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.nas_share_path = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.nas_ssh_port = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.num_shell_tries = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.nvmet_ns_id = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.nvmet_port_id = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.replication_device = **** {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.report_discard_supported = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.reserved_percentage = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.scst_target_driver = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.storage_protocol = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.target_helper = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.target_ip_address = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.target_port = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.target_prefix = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.target_protocol = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.trace_flags = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.unique_fqdn_network = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.use_chap_auth = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.volume_clear = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.volume_clear_ionice = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.volume_clear_size = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] QuobyteHD.volumes_dir = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4adc259f-c8c8-4b15-8830-1d2982ad9b86 None None] CMD "mount.quobyte" returned: 1 in 0.125s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4adc259f-c8c8-4b15-8830-1d2982ad9b86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4adc259f-c8c8-4b15-8830-1d2982ad9b86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-4adc259f-c8c8-4b15-8830-1d2982ad9b86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_messaging_rabbit.ssl = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_messaging_rabbit.ssl_version = {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_messaging_notifications.driver = [] {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_messaging_notifications.retry = -1 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] oslo_messaging_notifications.transport_url = **** {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] key_manager.fixed_key = **** {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] barbican.barbican_api_version = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] barbican.barbican_endpoint = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] barbican.barbican_endpoint_type = public {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] barbican.barbican_region_name = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] barbican.cafile = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] barbican.certfile = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] barbican.collect_timing = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] barbican.insecure = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] barbican.keyfile = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] barbican.number_of_retries = 60 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] barbican.retry_delay = 1 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-4adc259f-c8c8-4b15-8830-1d2982ad9b86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] barbican.send_service_user_token = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4adc259f-c8c8-4b15-8830-1d2982ad9b86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] barbican.split_loggers = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] barbican.timeout = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4adc259f-c8c8-4b15-8830-1d2982ad9b86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] barbican.verify_ssl = True {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] barbican.verify_ssl_path = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] barbican_service_user.auth_section = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] barbican_service_user.auth_type = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] barbican_service_user.cafile = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] barbican_service_user.certfile = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] barbican_service_user.collect_timing = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] barbican_service_user.insecure = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] barbican_service_user.keyfile = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] barbican_service_user.split_loggers = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] barbican_service_user.timeout = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] vault.approle_role_id = **** {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] vault.approle_secret_id = **** {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] vault.kv_mountpoint = secret {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] vault.kv_path = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] vault.kv_version = 2 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] vault.namespace = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] vault.root_token_id = **** {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] vault.ssl_ca_crt_file = None {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] vault.timeout = 60.0 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] vault.use_ssl = False {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 04:56:21 devstack cinder-volume[93488]: DEBUG oslo_service.backend._eventlet.service [None req-80b4639c-6f86-4d17-b72c-05bb5ce1fcfa None None] ******************************************************************************** {{(pid=93488) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 24 04:56:21 devstack sudo[93840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 04:56:21 devstack sudo[93840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:56:22 devstack sudo[93840]: pam_unix(sudo:session): session closed for user root Jun 24 04:56:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4adc259f-c8c8-4b15-8830-1d2982ad9b86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.644s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:56:22 devstack cinder-volume[93830]: INFO cinder.volume.driver [None req-4adc259f-c8c8-4b15-8830-1d2982ad9b86 None None] Driver hasn't implemented _init_vendor_properties() Jun 24 04:56:22 devstack cinder-volume[93830]: DEBUG cinder.volume.driver [None req-4adc259f-c8c8-4b15-8830-1d2982ad9b86 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757827758789, 'free_capacity_gb': 1775.757827758789, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93830) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 24 04:56:22 devstack cinder-volume[93830]: DEBUG oslo_db.sqlalchemy.engines [None req-4adc259f-c8c8-4b15-8830-1d2982ad9b86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93830) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 04:56:22 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writer thread running {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 24 04:56:22 devstack cinder-volume[93830]: DEBUG cinder.db.api [None req-4adc259f-c8c8-4b15-8830-1d2982ad9b86 None None] Building query based on filter {{(pid=93830) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 24 04:56:22 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-4adc259f-c8c8-4b15-8830-1d2982ad9b86 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93830) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 24 04:56:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4adc259f-c8c8-4b15-8830-1d2982ad9b86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 04:56:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4adc259f-c8c8-4b15-8830-1d2982ad9b86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 04:56:22 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-4adc259f-c8c8-4b15-8830-1d2982ad9b86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 04:56:22 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-4adc259f-c8c8-4b15-8830-1d2982ad9b86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 04:56:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4adc259f-c8c8-4b15-8830-1d2982ad9b86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 04:56:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4adc259f-c8c8-4b15-8830-1d2982ad9b86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:56:22 devstack cinder-volume[93830]: INFO cinder.keymgr.migration [None req-8b5568c7-bf78-48d6-bddc-356e977990c7 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 24 04:56:22 devstack sudo[93859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 04:56:22 devstack sudo[93859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:56:22 devstack sudo[93859]: pam_unix(sudo:session): session closed for user root Jun 24 04:56:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4adc259f-c8c8-4b15-8830-1d2982ad9b86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.646s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:56:22 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-4adc259f-c8c8-4b15-8830-1d2982ad9b86 None None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 04:56:22 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-4adc259f-c8c8-4b15-8830-1d2982ad9b86 None None] Driver initialization completed successfully. Jun 24 04:56:22 devstack cinder-volume[93830]: INFO cinder.manager [None req-4adc259f-c8c8-4b15-8830-1d2982ad9b86 None None] Initiating service 3 cleanup Jun 24 04:56:22 devstack cinder-volume[93830]: INFO cinder.manager [None req-4adc259f-c8c8-4b15-8830-1d2982ad9b86 None None] Service 3 cleanup completed. Jun 24 04:56:22 devstack cinder-volume[93830]: DEBUG cinder.service [None req-4adc259f-c8c8-4b15-8830-1d2982ad9b86 None None] Creating RPC server for service cinder-volume {{(pid=93830) start /opt/stack/cinder/cinder/service.py:231}} Jun 24 04:56:22 devstack cinder-volume[93830]: DEBUG cinder.service [None req-4adc259f-c8c8-4b15-8830-1d2982ad9b86 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93830) start /opt/stack/cinder/cinder/service.py:237}} Jun 24 04:56:23 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-4adc259f-c8c8-4b15-8830-1d2982ad9b86 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 24 04:56:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4adc259f-c8c8-4b15-8830-1d2982ad9b86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 04:56:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4adc259f-c8c8-4b15-8830-1d2982ad9b86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 04:56:23 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-4adc259f-c8c8-4b15-8830-1d2982ad9b86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 04:56:23 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-4adc259f-c8c8-4b15-8830-1d2982ad9b86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 04:56:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4adc259f-c8c8-4b15-8830-1d2982ad9b86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 04:56:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4adc259f-c8c8-4b15-8830-1d2982ad9b86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:56:23 devstack sudo[93909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 04:56:23 devstack sudo[93909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:56:23 devstack sudo[93909]: pam_unix(sudo:session): session closed for user root Jun 24 04:56:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4adc259f-c8c8-4b15-8830-1d2982ad9b86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.637s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:56:23 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-4adc259f-c8c8-4b15-8830-1d2982ad9b86 None None] Driver post RPC initialization completed successfully. Jun 24 04:56:31 devstack cinder-volume[93488]: DEBUG dbcounter [-] [93488] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=93488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 04:56:32 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:SELECT=3 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 04:56:33 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 04:57:09 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager._thread_info {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 04:57:09 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread count: 6 {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 04:57:09 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread info: [<_MainThread(MainThread, started 130211312517248)>, , , , , ] {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 04:58:01 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-3696b85b-c424-45a5-9b14-b613269990dc tempest-VolumesAdminNegativeTest-926510409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 04:58:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3696b85b-c424-45a5-9b14-b613269990dc tempest-VolumesAdminNegativeTest-926510409 None] Flow 'volume_create_manager' (9870b625-87f7-4b70-9963-fc712b6b1e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 04:58:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3696b85b-c424-45a5-9b14-b613269990dc tempest-VolumesAdminNegativeTest-926510409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4ebbd12-ebdf-42ba-b1a4-f434689eb18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:58:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3696b85b-c424-45a5-9b14-b613269990dc tempest-VolumesAdminNegativeTest-926510409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4ebbd12-ebdf-42ba-b1a4-f434689eb18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T02:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-491058250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8c6af45-8507-4be4-a90b-be3f1e8d71ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='580bb0c9683d4059b66981d20438a143',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:58:01Z,use_quota=True,user_id='2aceae676a62497aa2674c4b41844b3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 04:58:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3696b85b-c424-45a5-9b14-b613269990dc tempest-VolumesAdminNegativeTest-926510409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2a932d9-106c-426f-a41e-2288f7c2c444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:58:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3696b85b-c424-45a5-9b14-b613269990dc tempest-VolumesAdminNegativeTest-926510409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2a932d9-106c-426f-a41e-2288f7c2c444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 04:58:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3696b85b-c424-45a5-9b14-b613269990dc tempest-VolumesAdminNegativeTest-926510409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (225965f8-fe01-4166-b9ec-54973e979d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:58:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3696b85b-c424-45a5-9b14-b613269990dc tempest-VolumesAdminNegativeTest-926510409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (225965f8-fe01-4166-b9ec-54973e979d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8c6af45-8507-4be4-a90b-be3f1e8d71ad', 'volume_name': 'volume-d8c6af45-8507-4be4-a90b-be3f1e8d71ad', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 04:58:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3696b85b-c424-45a5-9b14-b613269990dc tempest-VolumesAdminNegativeTest-926510409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b796b916-14f6-4bd8-9ab9-ff26e8557196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:58:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3696b85b-c424-45a5-9b14-b613269990dc tempest-VolumesAdminNegativeTest-926510409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b796b916-14f6-4bd8-9ab9-ff26e8557196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 04:58:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3696b85b-c424-45a5-9b14-b613269990dc tempest-VolumesAdminNegativeTest-926510409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca739300-4c96-4438-8a63-ec00fbb095a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:58:01 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-3696b85b-c424-45a5-9b14-b613269990dc tempest-VolumesAdminNegativeTest-926510409 None] Volume d8c6af45-8507-4be4-a90b-be3f1e8d71ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8c6af45-8507-4be4-a90b-be3f1e8d71ad', 'volume_size': 1} Jun 24 04:58:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3696b85b-c424-45a5-9b14-b613269990dc tempest-VolumesAdminNegativeTest-926510409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 04:58:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3696b85b-c424-45a5-9b14-b613269990dc tempest-VolumesAdminNegativeTest-926510409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 04:58:01 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-3696b85b-c424-45a5-9b14-b613269990dc tempest-VolumesAdminNegativeTest-926510409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T02:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-491058250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8c6af45-8507-4be4-a90b-be3f1e8d71ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='580bb0c9683d4059b66981d20438a143',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:58:01Z,use_quota=True,user_id='2aceae676a62497aa2674c4b41844b3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 04:58:01 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-3696b85b-c424-45a5-9b14-b613269990dc tempest-VolumesAdminNegativeTest-926510409 None] Creating volume d8c6af45-8507-4be4-a90b-be3f1e8d71ad {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 04:58:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3696b85b-c424-45a5-9b14-b613269990dc tempest-VolumesAdminNegativeTest-926510409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 04:58:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3696b85b-c424-45a5-9b14-b613269990dc tempest-VolumesAdminNegativeTest-926510409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 04:58:01 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-3696b85b-c424-45a5-9b14-b613269990dc tempest-VolumesAdminNegativeTest-926510409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 04:58:01 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-3696b85b-c424-45a5-9b14-b613269990dc tempest-VolumesAdminNegativeTest-926510409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 04:58:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3696b85b-c424-45a5-9b14-b613269990dc tempest-VolumesAdminNegativeTest-926510409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 04:58:01 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-3696b85b-c424-45a5-9b14-b613269990dc tempest-VolumesAdminNegativeTest-926510409 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 04:58:01 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-3696b85b-c424-45a5-9b14-b613269990dc tempest-VolumesAdminNegativeTest-926510409 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 04:58:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3696b85b-c424-45a5-9b14-b613269990dc tempest-VolumesAdminNegativeTest-926510409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d8c6af45-8507-4be4-a90b-be3f1e8d71ad 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:58:01 devstack sudo[94894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d8c6af45-8507-4be4-a90b-be3f1e8d71ad 1073741824 Jun 24 04:58:01 devstack sudo[94894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:58:04 devstack sudo[94894]: pam_unix(sudo:session): session closed for user root Jun 24 04:58:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3696b85b-c424-45a5-9b14-b613269990dc tempest-VolumesAdminNegativeTest-926510409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d8c6af45-8507-4be4-a90b-be3f1e8d71ad 1073741824" returned: 0 in 2.496s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:58:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3696b85b-c424-45a5-9b14-b613269990dc tempest-VolumesAdminNegativeTest-926510409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d8c6af45-8507-4be4-a90b-be3f1e8d71ad {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:58:04 devstack sudo[95274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d8c6af45-8507-4be4-a90b-be3f1e8d71ad Jun 24 04:58:04 devstack sudo[95274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:58:05 devstack sudo[95274]: pam_unix(sudo:session): session closed for user root Jun 24 04:58:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3696b85b-c424-45a5-9b14-b613269990dc tempest-VolumesAdminNegativeTest-926510409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d8c6af45-8507-4be4-a90b-be3f1e8d71ad" returned: 0 in 1.458s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:58:05 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-3696b85b-c424-45a5-9b14-b613269990dc tempest-VolumesAdminNegativeTest-926510409 None] <== create_volume: return (4121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 04:58:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3696b85b-c424-45a5-9b14-b613269990dc tempest-VolumesAdminNegativeTest-926510409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.131s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 04:58:05 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3696b85b-c424-45a5-9b14-b613269990dc tempest-VolumesAdminNegativeTest-926510409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca739300-4c96-4438-8a63-ec00fbb095a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8c6af45-8507-4be4-a90b-be3f1e8d71ad', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 04:58:05 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3696b85b-c424-45a5-9b14-b613269990dc tempest-VolumesAdminNegativeTest-926510409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd6a0d0a-9873-449c-ae35-b1e6ea725a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:58:05 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-3696b85b-c424-45a5-9b14-b613269990dc tempest-VolumesAdminNegativeTest-926510409 None] Volume volume-d8c6af45-8507-4be4-a90b-be3f1e8d71ad (d8c6af45-8507-4be4-a90b-be3f1e8d71ad): created successfully Jun 24 04:58:05 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3696b85b-c424-45a5-9b14-b613269990dc tempest-VolumesAdminNegativeTest-926510409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd6a0d0a-9873-449c-ae35-b1e6ea725a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 04:58:05 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3696b85b-c424-45a5-9b14-b613269990dc tempest-VolumesAdminNegativeTest-926510409 None] Flow 'volume_create_manager' (9870b625-87f7-4b70-9963-fc712b6b1e82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 04:58:05 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-3696b85b-c424-45a5-9b14-b613269990dc tempest-VolumesAdminNegativeTest-926510409 None] Created volume successfully. Jun 24 04:58:08 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3607faca-d773-495a-8b92-7920cb379e32 tempest-VolumesAdminNegativeTest-926510409 None] Acquiring lock "cinder-d8c6af45-8507-4be4-a90b-be3f1e8d71ad-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 04:58:08 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3607faca-d773-495a-8b92-7920cb379e32 tempest-VolumesAdminNegativeTest-926510409 None] Lock "cinder-d8c6af45-8507-4be4-a90b-be3f1e8d71ad-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 04:58:08 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3607faca-d773-495a-8b92-7920cb379e32 tempest-VolumesAdminNegativeTest-926510409 None] Acquiring lock "cinder-quobyte-d8c6af45-8507-4be4-a90b-be3f1e8d71ad" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 04:58:08 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3607faca-d773-495a-8b92-7920cb379e32 tempest-VolumesAdminNegativeTest-926510409 None] Lock "cinder-quobyte-d8c6af45-8507-4be4-a90b-be3f1e8d71ad" acquired by "delete_volume" :: waited 0.070s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 04:58:08 devstack cinder-volume[93830]: INFO oslo.privsep.daemon [None req-3607faca-d773-495a-8b92-7920cb379e32 tempest-VolumesAdminNegativeTest-926510409 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpxgvx2iya/privsep.sock'] Jun 24 04:58:08 devstack sudo[95322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpxgvx2iya/privsep.sock Jun 24 04:58:08 devstack sudo[95322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:58:09 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 04:58:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 04:58:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 04:58:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 04:58:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 04:58:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 04:58:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:58:09 devstack sudo[95343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 04:58:09 devstack sudo[95343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:58:09 devstack cinder-volume[93830]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jun 24 04:58:09 devstack cinder-volume[93830]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 24 04:58:09 devstack cinder-volume[93830]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 24 04:58:09 devstack cinder-volume[93830]: WARNING oslo.privsep.daemon [-] privsep log: Jun 24 04:58:09 devstack cinder-volume[93830]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 24 04:58:09 devstack cinder-volume[93830]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 24 04:58:09 devstack cinder-volume[93830]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 24 04:58:09 devstack cinder-volume[93830]: WARNING oslo.privsep.daemon [-] privsep log: Jun 24 04:58:09 devstack cinder-volume[93830]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jun 24 04:58:12 devstack sudo[95343]: pam_unix(sudo:session): session closed for user root Jun 24 04:58:12 devstack cinder-volume[93830]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jun 24 04:58:12 devstack cinder-volume[93830]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 24 04:58:12 devstack cinder-volume[93830]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 24 04:58:12 devstack cinder-volume[93830]: WARNING oslo.privsep.daemon [-] privsep log: Jun 24 04:58:12 devstack cinder-volume[93830]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 24 04:58:12 devstack cinder-volume[93830]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 24 04:58:12 devstack cinder-volume[93830]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 24 04:58:12 devstack cinder-volume[93830]: WARNING oslo.privsep.daemon [-] privsep log: Jun 24 04:58:12 devstack cinder-volume[93830]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jun 24 04:58:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 2.946s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:58:12 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 04:58:12 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager._thread_info {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 04:58:12 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread count: 7 {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 04:58:12 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread info: [<_MainThread(MainThread, started 130211312517248)>, , , , , , ] {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 04:58:13 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b4522af-70cb-4aed-8c09-50bdd6fa2e1d tempest-ServerRescueNegativeTestJSON-666320637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 04:58:13 devstack sudo[95322]: pam_unix(sudo:session): session closed for user root Jun 24 04:58:13 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4b4522af-70cb-4aed-8c09-50bdd6fa2e1d tempest-ServerRescueNegativeTestJSON-666320637 None] Flow 'volume_create_manager' (bf36e008-81b5-4df1-b602-d21e5f0b147f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 04:58:13 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4b4522af-70cb-4aed-8c09-50bdd6fa2e1d tempest-ServerRescueNegativeTestJSON-666320637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f36bcf0a-0ca5-4f1a-9ea6-e9cb7cea77a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:58:13 devstack cinder-volume[93830]: INFO oslo.privsep.daemon [None req-3607faca-d773-495a-8b92-7920cb379e32 tempest-VolumesAdminNegativeTest-926510409 None] Spawned new privsep daemon via rootwrap Jun 24 04:58:13 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [None req-3607faca-d773-495a-8b92-7920cb379e32 tempest-VolumesAdminNegativeTest-926510409 None] Accepted privsep connection to /tmp/tmpxgvx2iya/privsep.sock {{(pid=93830) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jun 24 04:58:13 devstack cinder-volume[93830]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 24 04:58:13 devstack cinder-volume[93830]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 24 04:58:13 devstack cinder-volume[93830]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 24 04:58:13 devstack cinder-volume[93830]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 95352 Jun 24 04:58:13 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d47e08-eda1-4b3d-9779-6fb841639bfb]: (2,) {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 04:58:13 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4b4522af-70cb-4aed-8c09-50bdd6fa2e1d tempest-ServerRescueNegativeTestJSON-666320637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f36bcf0a-0ca5-4f1a-9ea6-e9cb7cea77a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T02:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1934862744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e48eb9ad-2c16-49f9-acc4-c552387cc1de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b4ce5ee749149239b29a01bf5a672f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:58:13Z,use_quota=True,user_id='f7f3b327d49241aa97e95c98f9dc24f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 04:58:13 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4b4522af-70cb-4aed-8c09-50bdd6fa2e1d tempest-ServerRescueNegativeTestJSON-666320637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d77f7dc-a1bc-4365-bcb7-4d2a198f3742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:58:13 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4b4522af-70cb-4aed-8c09-50bdd6fa2e1d tempest-ServerRescueNegativeTestJSON-666320637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d77f7dc-a1bc-4365-bcb7-4d2a198f3742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 04:58:13 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4b4522af-70cb-4aed-8c09-50bdd6fa2e1d tempest-ServerRescueNegativeTestJSON-666320637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e24ea6ff-3eaa-4318-9ed1-0ccde65d61f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:58:13 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4b4522af-70cb-4aed-8c09-50bdd6fa2e1d tempest-ServerRescueNegativeTestJSON-666320637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e24ea6ff-3eaa-4318-9ed1-0ccde65d61f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e48eb9ad-2c16-49f9-acc4-c552387cc1de', 'volume_name': 'volume-e48eb9ad-2c16-49f9-acc4-c552387cc1de', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 04:58:13 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4b4522af-70cb-4aed-8c09-50bdd6fa2e1d tempest-ServerRescueNegativeTestJSON-666320637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b046863-ce2c-4d78-99b5-9810eef9ebde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:58:13 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4b4522af-70cb-4aed-8c09-50bdd6fa2e1d tempest-ServerRescueNegativeTestJSON-666320637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b046863-ce2c-4d78-99b5-9810eef9ebde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 04:58:13 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4b4522af-70cb-4aed-8c09-50bdd6fa2e1d tempest-ServerRescueNegativeTestJSON-666320637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d5bbad5-4681-4489-8941-2832a1341757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:58:13 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-4b4522af-70cb-4aed-8c09-50bdd6fa2e1d tempest-ServerRescueNegativeTestJSON-666320637 None] Volume e48eb9ad-2c16-49f9-acc4-c552387cc1de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e48eb9ad-2c16-49f9-acc4-c552387cc1de', 'volume_size': 1} Jun 24 04:58:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4b4522af-70cb-4aed-8c09-50bdd6fa2e1d tempest-ServerRescueNegativeTestJSON-666320637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 04:58:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4b4522af-70cb-4aed-8c09-50bdd6fa2e1d tempest-ServerRescueNegativeTestJSON-666320637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 04:58:13 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-4b4522af-70cb-4aed-8c09-50bdd6fa2e1d tempest-ServerRescueNegativeTestJSON-666320637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T02:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1934862744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e48eb9ad-2c16-49f9-acc4-c552387cc1de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b4ce5ee749149239b29a01bf5a672f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:58:13Z,use_quota=True,user_id='f7f3b327d49241aa97e95c98f9dc24f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 04:58:13 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-4b4522af-70cb-4aed-8c09-50bdd6fa2e1d tempest-ServerRescueNegativeTestJSON-666320637 None] Creating volume e48eb9ad-2c16-49f9-acc4-c552387cc1de {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 04:58:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4b4522af-70cb-4aed-8c09-50bdd6fa2e1d tempest-ServerRescueNegativeTestJSON-666320637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 04:58:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4b4522af-70cb-4aed-8c09-50bdd6fa2e1d tempest-ServerRescueNegativeTestJSON-666320637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 04:58:13 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-4b4522af-70cb-4aed-8c09-50bdd6fa2e1d tempest-ServerRescueNegativeTestJSON-666320637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 04:58:13 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-4b4522af-70cb-4aed-8c09-50bdd6fa2e1d tempest-ServerRescueNegativeTestJSON-666320637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 04:58:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4b4522af-70cb-4aed-8c09-50bdd6fa2e1d tempest-ServerRescueNegativeTestJSON-666320637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 04:58:13 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-4b4522af-70cb-4aed-8c09-50bdd6fa2e1d tempest-ServerRescueNegativeTestJSON-666320637 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 04:58:13 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-4b4522af-70cb-4aed-8c09-50bdd6fa2e1d tempest-ServerRescueNegativeTestJSON-666320637 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 04:58:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4b4522af-70cb-4aed-8c09-50bdd6fa2e1d tempest-ServerRescueNegativeTestJSON-666320637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e48eb9ad-2c16-49f9-acc4-c552387cc1de 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:58:13 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a392e57-d54f-44a1-b7d7-62de50c51c68]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 04:58:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3607faca-d773-495a-8b92-7920cb379e32 tempest-VolumesAdminNegativeTest-926510409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d8c6af45-8507-4be4-a90b-be3f1e8d71ad {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:58:13 devstack sudo[95356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e48eb9ad-2c16-49f9-acc4-c552387cc1de 1073741824 Jun 24 04:58:13 devstack sudo[95356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:58:14 devstack sudo[95357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d8c6af45-8507-4be4-a90b-be3f1e8d71ad Jun 24 04:58:14 devstack sudo[95357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:58:15 devstack sudo[95356]: pam_unix(sudo:session): session closed for user root Jun 24 04:58:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4b4522af-70cb-4aed-8c09-50bdd6fa2e1d tempest-ServerRescueNegativeTestJSON-666320637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e48eb9ad-2c16-49f9-acc4-c552387cc1de 1073741824" returned: 0 in 2.056s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:58:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4b4522af-70cb-4aed-8c09-50bdd6fa2e1d tempest-ServerRescueNegativeTestJSON-666320637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e48eb9ad-2c16-49f9-acc4-c552387cc1de {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:58:16 devstack sudo[95378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e48eb9ad-2c16-49f9-acc4-c552387cc1de Jun 24 04:58:16 devstack sudo[95378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:58:16 devstack sudo[95357]: pam_unix(sudo:session): session closed for user root Jun 24 04:58:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3607faca-d773-495a-8b92-7920cb379e32 tempest-VolumesAdminNegativeTest-926510409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d8c6af45-8507-4be4-a90b-be3f1e8d71ad" returned: 0 in 2.992s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:58:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3607faca-d773-495a-8b92-7920cb379e32 tempest-VolumesAdminNegativeTest-926510409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d8c6af45-8507-4be4-a90b-be3f1e8d71ad {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:58:16 devstack sudo[95437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d8c6af45-8507-4be4-a90b-be3f1e8d71ad Jun 24 04:58:16 devstack sudo[95437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:58:18 devstack sudo[95378]: pam_unix(sudo:session): session closed for user root Jun 24 04:58:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4b4522af-70cb-4aed-8c09-50bdd6fa2e1d tempest-ServerRescueNegativeTestJSON-666320637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e48eb9ad-2c16-49f9-acc4-c552387cc1de" returned: 0 in 2.157s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:58:18 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-4b4522af-70cb-4aed-8c09-50bdd6fa2e1d tempest-ServerRescueNegativeTestJSON-666320637 None] <== create_volume: return (4309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 04:58:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4b4522af-70cb-4aed-8c09-50bdd6fa2e1d tempest-ServerRescueNegativeTestJSON-666320637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.312s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 04:58:18 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4b4522af-70cb-4aed-8c09-50bdd6fa2e1d tempest-ServerRescueNegativeTestJSON-666320637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d5bbad5-4681-4489-8941-2832a1341757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e48eb9ad-2c16-49f9-acc4-c552387cc1de', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 04:58:18 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4b4522af-70cb-4aed-8c09-50bdd6fa2e1d tempest-ServerRescueNegativeTestJSON-666320637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cffb4313-bb68-49bf-8fd4-400c4f131495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:58:18 devstack sudo[95437]: pam_unix(sudo:session): session closed for user root Jun 24 04:58:18 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-4b4522af-70cb-4aed-8c09-50bdd6fa2e1d tempest-ServerRescueNegativeTestJSON-666320637 None] Volume volume-e48eb9ad-2c16-49f9-acc4-c552387cc1de (e48eb9ad-2c16-49f9-acc4-c552387cc1de): created successfully Jun 24 04:58:18 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4b4522af-70cb-4aed-8c09-50bdd6fa2e1d tempest-ServerRescueNegativeTestJSON-666320637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cffb4313-bb68-49bf-8fd4-400c4f131495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 04:58:18 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4b4522af-70cb-4aed-8c09-50bdd6fa2e1d tempest-ServerRescueNegativeTestJSON-666320637 None] Flow 'volume_create_manager' (bf36e008-81b5-4df1-b602-d21e5f0b147f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 04:58:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3607faca-d773-495a-8b92-7920cb379e32 tempest-VolumesAdminNegativeTest-926510409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d8c6af45-8507-4be4-a90b-be3f1e8d71ad" returned: 0 in 1.373s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:58:18 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3607faca-d773-495a-8b92-7920cb379e32 tempest-VolumesAdminNegativeTest-926510409 None] Lock "cinder-quobyte-d8c6af45-8507-4be4-a90b-be3f1e8d71ad" released by "delete_volume" :: held 9.628s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 04:58:18 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-4b4522af-70cb-4aed-8c09-50bdd6fa2e1d tempest-ServerRescueNegativeTestJSON-666320637 None] Created volume successfully. Jun 24 04:58:18 devstack cinder-volume[93830]: WARNING cinder.quota [None req-3607faca-d773-495a-8b92-7920cb379e32 tempest-VolumesAdminNegativeTest-926510409 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 24 04:58:18 devstack cinder-volume[93830]: WARNING cinder.quota [None req-3607faca-d773-495a-8b92-7920cb379e32 tempest-VolumesAdminNegativeTest-926510409 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 24 04:58:18 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-3607faca-d773-495a-8b92-7920cb379e32 tempest-VolumesAdminNegativeTest-926510409 None] Created reservations ['e4e72bda-548b-4139-a770-639f308bee47', 'fb92f461-6c84-4f4d-bef5-05539b2092b6', 'f4ef372d-6168-40fe-8e48-c28391c27a32', 'd567655d-9f4b-4fc8-a592-07d10d219b62'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 04:58:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3607faca-d773-495a-8b92-7920cb379e32 tempest-VolumesAdminNegativeTest-926510409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 04:58:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3607faca-d773-495a-8b92-7920cb379e32 tempest-VolumesAdminNegativeTest-926510409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 04:58:19 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-3607faca-d773-495a-8b92-7920cb379e32 tempest-VolumesAdminNegativeTest-926510409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 04:58:19 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-3607faca-d773-495a-8b92-7920cb379e32 tempest-VolumesAdminNegativeTest-926510409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 04:58:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3607faca-d773-495a-8b92-7920cb379e32 tempest-VolumesAdminNegativeTest-926510409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 04:58:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3607faca-d773-495a-8b92-7920cb379e32 tempest-VolumesAdminNegativeTest-926510409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:58:19 devstack sudo[95445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 04:58:19 devstack sudo[95445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:58:20 devstack sudo[95445]: pam_unix(sudo:session): session closed for user root Jun 24 04:58:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3607faca-d773-495a-8b92-7920cb379e32 tempest-VolumesAdminNegativeTest-926510409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 1.744s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:58:20 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-3607faca-d773-495a-8b92-7920cb379e32 tempest-VolumesAdminNegativeTest-926510409 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 04:58:20 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-3607faca-d773-495a-8b92-7920cb379e32 tempest-VolumesAdminNegativeTest-926510409 None] Deleted volume successfully. Jun 24 04:58:20 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3607faca-d773-495a-8b92-7920cb379e32 tempest-VolumesAdminNegativeTest-926510409 None] Lock "cinder-d8c6af45-8507-4be4-a90b-be3f1e8d71ad-delete_volume" released by "delete_volume" :: held 12.446s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 04:58:26 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1b786b0-cc61-4a3c-a24d-5cbb7f194c69 tempest-ServersNegativeTestJSON-503259173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 04:58:26 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d1b786b0-cc61-4a3c-a24d-5cbb7f194c69 tempest-ServersNegativeTestJSON-503259173 None] Flow 'volume_create_manager' (d980acfe-5791-44e5-b508-7b1bb3cafe6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 04:58:26 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d1b786b0-cc61-4a3c-a24d-5cbb7f194c69 tempest-ServersNegativeTestJSON-503259173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (243c68ac-397f-4d53-b8ea-1b2b63f93212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:58:26 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d1b786b0-cc61-4a3c-a24d-5cbb7f194c69 tempest-ServersNegativeTestJSON-503259173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (243c68ac-397f-4d53-b8ea-1b2b63f93212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T02:58:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2138233946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41964ecd-fb08-4742-a122-891e4b1fae95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='831e92af30b545b09d7e2d5f9aeddc6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:58:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:58:26Z,use_quota=True,user_id='98c3e06b17004bd49faef6f2a9bc6ff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 04:58:26 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d1b786b0-cc61-4a3c-a24d-5cbb7f194c69 tempest-ServersNegativeTestJSON-503259173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (576363c0-f14b-4e93-92ae-c6ee190c4a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:58:26 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d1b786b0-cc61-4a3c-a24d-5cbb7f194c69 tempest-ServersNegativeTestJSON-503259173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (576363c0-f14b-4e93-92ae-c6ee190c4a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 04:58:26 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d1b786b0-cc61-4a3c-a24d-5cbb7f194c69 tempest-ServersNegativeTestJSON-503259173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4461eada-292b-4f8e-903f-254645769d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:58:26 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d1b786b0-cc61-4a3c-a24d-5cbb7f194c69 tempest-ServersNegativeTestJSON-503259173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4461eada-292b-4f8e-903f-254645769d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41964ecd-fb08-4742-a122-891e4b1fae95', 'volume_name': 'volume-41964ecd-fb08-4742-a122-891e4b1fae95', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 04:58:26 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d1b786b0-cc61-4a3c-a24d-5cbb7f194c69 tempest-ServersNegativeTestJSON-503259173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1ef2f1a-ca23-4660-aac0-a4dc74c082ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:58:26 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d1b786b0-cc61-4a3c-a24d-5cbb7f194c69 tempest-ServersNegativeTestJSON-503259173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1ef2f1a-ca23-4660-aac0-a4dc74c082ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 04:58:26 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d1b786b0-cc61-4a3c-a24d-5cbb7f194c69 tempest-ServersNegativeTestJSON-503259173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1ad92fd-8328-4425-b989-8b2ba647cfa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:58:26 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-d1b786b0-cc61-4a3c-a24d-5cbb7f194c69 tempest-ServersNegativeTestJSON-503259173 None] Volume 41964ecd-fb08-4742-a122-891e4b1fae95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41964ecd-fb08-4742-a122-891e4b1fae95', 'volume_size': 1} Jun 24 04:58:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-d1b786b0-cc61-4a3c-a24d-5cbb7f194c69 tempest-ServersNegativeTestJSON-503259173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 04:58:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-d1b786b0-cc61-4a3c-a24d-5cbb7f194c69 tempest-ServersNegativeTestJSON-503259173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 04:58:26 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-d1b786b0-cc61-4a3c-a24d-5cbb7f194c69 tempest-ServersNegativeTestJSON-503259173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T02:58:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2138233946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41964ecd-fb08-4742-a122-891e4b1fae95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='831e92af30b545b09d7e2d5f9aeddc6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:58:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:58:26Z,use_quota=True,user_id='98c3e06b17004bd49faef6f2a9bc6ff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 04:58:26 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-d1b786b0-cc61-4a3c-a24d-5cbb7f194c69 tempest-ServersNegativeTestJSON-503259173 None] Creating volume 41964ecd-fb08-4742-a122-891e4b1fae95 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 04:58:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-d1b786b0-cc61-4a3c-a24d-5cbb7f194c69 tempest-ServersNegativeTestJSON-503259173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 04:58:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-d1b786b0-cc61-4a3c-a24d-5cbb7f194c69 tempest-ServersNegativeTestJSON-503259173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 04:58:26 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-d1b786b0-cc61-4a3c-a24d-5cbb7f194c69 tempest-ServersNegativeTestJSON-503259173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 04:58:26 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-d1b786b0-cc61-4a3c-a24d-5cbb7f194c69 tempest-ServersNegativeTestJSON-503259173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 04:58:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-d1b786b0-cc61-4a3c-a24d-5cbb7f194c69 tempest-ServersNegativeTestJSON-503259173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 04:58:26 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-d1b786b0-cc61-4a3c-a24d-5cbb7f194c69 tempest-ServersNegativeTestJSON-503259173 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 04:58:26 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-d1b786b0-cc61-4a3c-a24d-5cbb7f194c69 tempest-ServersNegativeTestJSON-503259173 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 04:58:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d1b786b0-cc61-4a3c-a24d-5cbb7f194c69 tempest-ServersNegativeTestJSON-503259173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-41964ecd-fb08-4742-a122-891e4b1fae95 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:58:26 devstack sudo[95622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-41964ecd-fb08-4742-a122-891e4b1fae95 1073741824 Jun 24 04:58:26 devstack sudo[95622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:58:27 devstack sudo[95622]: pam_unix(sudo:session): session closed for user root Jun 24 04:58:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d1b786b0-cc61-4a3c-a24d-5cbb7f194c69 tempest-ServersNegativeTestJSON-503259173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-41964ecd-fb08-4742-a122-891e4b1fae95 1073741824" returned: 0 in 1.021s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:58:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d1b786b0-cc61-4a3c-a24d-5cbb7f194c69 tempest-ServersNegativeTestJSON-503259173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-41964ecd-fb08-4742-a122-891e4b1fae95 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:58:27 devstack sudo[95630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-41964ecd-fb08-4742-a122-891e4b1fae95 Jun 24 04:58:27 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:58:28 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root Jun 24 04:58:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d1b786b0-cc61-4a3c-a24d-5cbb7f194c69 tempest-ServersNegativeTestJSON-503259173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-41964ecd-fb08-4742-a122-891e4b1fae95" returned: 0 in 1.029s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:58:28 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-d1b786b0-cc61-4a3c-a24d-5cbb7f194c69 tempest-ServersNegativeTestJSON-503259173 None] <== create_volume: return (2121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 04:58:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-d1b786b0-cc61-4a3c-a24d-5cbb7f194c69 tempest-ServersNegativeTestJSON-503259173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.126s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 04:58:28 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d1b786b0-cc61-4a3c-a24d-5cbb7f194c69 tempest-ServersNegativeTestJSON-503259173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1ad92fd-8328-4425-b989-8b2ba647cfa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41964ecd-fb08-4742-a122-891e4b1fae95', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 04:58:28 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d1b786b0-cc61-4a3c-a24d-5cbb7f194c69 tempest-ServersNegativeTestJSON-503259173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (058bf32c-0a86-4739-9337-eabdde9978ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:58:28 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-d1b786b0-cc61-4a3c-a24d-5cbb7f194c69 tempest-ServersNegativeTestJSON-503259173 None] Volume volume-41964ecd-fb08-4742-a122-891e4b1fae95 (41964ecd-fb08-4742-a122-891e4b1fae95): created successfully Jun 24 04:58:28 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d1b786b0-cc61-4a3c-a24d-5cbb7f194c69 tempest-ServersNegativeTestJSON-503259173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (058bf32c-0a86-4739-9337-eabdde9978ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 04:58:28 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d1b786b0-cc61-4a3c-a24d-5cbb7f194c69 tempest-ServersNegativeTestJSON-503259173 None] Flow 'volume_create_manager' (d980acfe-5791-44e5-b508-7b1bb3cafe6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 04:58:28 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-d1b786b0-cc61-4a3c-a24d-5cbb7f194c69 tempest-ServersNegativeTestJSON-503259173 None] Created volume successfully. Jun 24 04:58:32 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-105612db-2cb4-41ca-8e79-3a4134fe9747 tempest-ServersNegativeTestJSON-503259173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 04:58:32 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-105612db-2cb4-41ca-8e79-3a4134fe9747 tempest-ServersNegativeTestJSON-503259173 None] Flow 'volume_create_manager' (20a1c607-104c-45cf-828c-f0553c244ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 04:58:32 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-105612db-2cb4-41ca-8e79-3a4134fe9747 tempest-ServersNegativeTestJSON-503259173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ad1fbc2-eea8-4c0d-b5a1-4a4912c021a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:58:32 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-105612db-2cb4-41ca-8e79-3a4134fe9747 tempest-ServersNegativeTestJSON-503259173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ad1fbc2-eea8-4c0d-b5a1-4a4912c021a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T02:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1359253980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c2b74e6-8280-4c8a-85cb-6c89662ac247,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='831e92af30b545b09d7e2d5f9aeddc6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:58:32Z,use_quota=True,user_id='98c3e06b17004bd49faef6f2a9bc6ff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 04:58:32 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-105612db-2cb4-41ca-8e79-3a4134fe9747 tempest-ServersNegativeTestJSON-503259173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbf6a6ba-dee6-4dbe-806f-bc98dd9f0375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:58:32 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-105612db-2cb4-41ca-8e79-3a4134fe9747 tempest-ServersNegativeTestJSON-503259173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbf6a6ba-dee6-4dbe-806f-bc98dd9f0375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 04:58:32 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-105612db-2cb4-41ca-8e79-3a4134fe9747 tempest-ServersNegativeTestJSON-503259173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f24cba-b74f-418f-97f1-6e40b94e6491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:58:32 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-105612db-2cb4-41ca-8e79-3a4134fe9747 tempest-ServersNegativeTestJSON-503259173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f24cba-b74f-418f-97f1-6e40b94e6491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c2b74e6-8280-4c8a-85cb-6c89662ac247', 'volume_name': 'volume-6c2b74e6-8280-4c8a-85cb-6c89662ac247', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 04:58:32 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-105612db-2cb4-41ca-8e79-3a4134fe9747 tempest-ServersNegativeTestJSON-503259173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ead54646-eee2-4810-825c-39fab75dd395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:58:32 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-105612db-2cb4-41ca-8e79-3a4134fe9747 tempest-ServersNegativeTestJSON-503259173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ead54646-eee2-4810-825c-39fab75dd395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 04:58:32 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-105612db-2cb4-41ca-8e79-3a4134fe9747 tempest-ServersNegativeTestJSON-503259173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78fe3f81-8604-46a3-acc1-b6a53db774d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:58:32 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-105612db-2cb4-41ca-8e79-3a4134fe9747 tempest-ServersNegativeTestJSON-503259173 None] Volume 6c2b74e6-8280-4c8a-85cb-6c89662ac247: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c2b74e6-8280-4c8a-85cb-6c89662ac247', 'volume_size': 1} Jun 24 04:58:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-105612db-2cb4-41ca-8e79-3a4134fe9747 tempest-ServersNegativeTestJSON-503259173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 04:58:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-105612db-2cb4-41ca-8e79-3a4134fe9747 tempest-ServersNegativeTestJSON-503259173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 04:58:32 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-105612db-2cb4-41ca-8e79-3a4134fe9747 tempest-ServersNegativeTestJSON-503259173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T02:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1359253980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c2b74e6-8280-4c8a-85cb-6c89662ac247,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='831e92af30b545b09d7e2d5f9aeddc6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:58:32Z,use_quota=True,user_id='98c3e06b17004bd49faef6f2a9bc6ff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 04:58:32 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-105612db-2cb4-41ca-8e79-3a4134fe9747 tempest-ServersNegativeTestJSON-503259173 None] Creating volume 6c2b74e6-8280-4c8a-85cb-6c89662ac247 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 04:58:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-105612db-2cb4-41ca-8e79-3a4134fe9747 tempest-ServersNegativeTestJSON-503259173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 04:58:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-105612db-2cb4-41ca-8e79-3a4134fe9747 tempest-ServersNegativeTestJSON-503259173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 04:58:32 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-105612db-2cb4-41ca-8e79-3a4134fe9747 tempest-ServersNegativeTestJSON-503259173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 04:58:32 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-105612db-2cb4-41ca-8e79-3a4134fe9747 tempest-ServersNegativeTestJSON-503259173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 04:58:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-105612db-2cb4-41ca-8e79-3a4134fe9747 tempest-ServersNegativeTestJSON-503259173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 04:58:32 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-105612db-2cb4-41ca-8e79-3a4134fe9747 tempest-ServersNegativeTestJSON-503259173 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 04:58:32 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-105612db-2cb4-41ca-8e79-3a4134fe9747 tempest-ServersNegativeTestJSON-503259173 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 04:58:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-105612db-2cb4-41ca-8e79-3a4134fe9747 tempest-ServersNegativeTestJSON-503259173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6c2b74e6-8280-4c8a-85cb-6c89662ac247 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:58:32 devstack sudo[95703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6c2b74e6-8280-4c8a-85cb-6c89662ac247 1073741824 Jun 24 04:58:32 devstack sudo[95703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:58:34 devstack sudo[95703]: pam_unix(sudo:session): session closed for user root Jun 24 04:58:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-105612db-2cb4-41ca-8e79-3a4134fe9747 tempest-ServersNegativeTestJSON-503259173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6c2b74e6-8280-4c8a-85cb-6c89662ac247 1073741824" returned: 0 in 1.648s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:58:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-105612db-2cb4-41ca-8e79-3a4134fe9747 tempest-ServersNegativeTestJSON-503259173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6c2b74e6-8280-4c8a-85cb-6c89662ac247 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:58:34 devstack sudo[95711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6c2b74e6-8280-4c8a-85cb-6c89662ac247 Jun 24 04:58:34 devstack sudo[95711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:58:35 devstack sudo[95711]: pam_unix(sudo:session): session closed for user root Jun 24 04:58:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-105612db-2cb4-41ca-8e79-3a4134fe9747 tempest-ServersNegativeTestJSON-503259173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6c2b74e6-8280-4c8a-85cb-6c89662ac247" returned: 0 in 1.353s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:58:35 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-105612db-2cb4-41ca-8e79-3a4134fe9747 tempest-ServersNegativeTestJSON-503259173 None] <== create_volume: return (3058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 04:58:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-105612db-2cb4-41ca-8e79-3a4134fe9747 tempest-ServersNegativeTestJSON-503259173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.062s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 04:58:35 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-105612db-2cb4-41ca-8e79-3a4134fe9747 tempest-ServersNegativeTestJSON-503259173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78fe3f81-8604-46a3-acc1-b6a53db774d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c2b74e6-8280-4c8a-85cb-6c89662ac247', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 04:58:35 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-105612db-2cb4-41ca-8e79-3a4134fe9747 tempest-ServersNegativeTestJSON-503259173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cf9cb64-1093-436c-9ede-9cc85ddd0b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:58:35 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-105612db-2cb4-41ca-8e79-3a4134fe9747 tempest-ServersNegativeTestJSON-503259173 None] Volume volume-6c2b74e6-8280-4c8a-85cb-6c89662ac247 (6c2b74e6-8280-4c8a-85cb-6c89662ac247): created successfully Jun 24 04:58:35 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-105612db-2cb4-41ca-8e79-3a4134fe9747 tempest-ServersNegativeTestJSON-503259173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cf9cb64-1093-436c-9ede-9cc85ddd0b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 04:58:35 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-105612db-2cb4-41ca-8e79-3a4134fe9747 tempest-ServersNegativeTestJSON-503259173 None] Flow 'volume_create_manager' (20a1c607-104c-45cf-828c-f0553c244ec2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 04:58:35 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-105612db-2cb4-41ca-8e79-3a4134fe9747 tempest-ServersNegativeTestJSON-503259173 None] Created volume successfully. Jun 24 04:58:37 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-71a74ff3-606e-4283-a03a-e5792d5b7a6b tempest-ServersNegativeTestJSON-503259173 None] Acquiring lock "cinder-6c2b74e6-8280-4c8a-85cb-6c89662ac247-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 04:58:37 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-71a74ff3-606e-4283-a03a-e5792d5b7a6b tempest-ServersNegativeTestJSON-503259173 None] Lock "cinder-6c2b74e6-8280-4c8a-85cb-6c89662ac247-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 04:58:37 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-71a74ff3-606e-4283-a03a-e5792d5b7a6b tempest-ServersNegativeTestJSON-503259173 None] Acquiring lock "cinder-quobyte-6c2b74e6-8280-4c8a-85cb-6c89662ac247" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 04:58:37 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-71a74ff3-606e-4283-a03a-e5792d5b7a6b tempest-ServersNegativeTestJSON-503259173 None] Lock "cinder-quobyte-6c2b74e6-8280-4c8a-85cb-6c89662ac247" acquired by "delete_volume" :: waited 0.038s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 04:58:37 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab42c69-32d5-4361-a045-f9df280918ee]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 04:58:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-71a74ff3-606e-4283-a03a-e5792d5b7a6b tempest-ServersNegativeTestJSON-503259173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6c2b74e6-8280-4c8a-85cb-6c89662ac247 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:58:38 devstack sudo[95740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6c2b74e6-8280-4c8a-85cb-6c89662ac247 Jun 24 04:58:38 devstack sudo[95740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:58:39 devstack sudo[95740]: pam_unix(sudo:session): session closed for user root Jun 24 04:58:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-71a74ff3-606e-4283-a03a-e5792d5b7a6b tempest-ServersNegativeTestJSON-503259173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6c2b74e6-8280-4c8a-85cb-6c89662ac247" returned: 0 in 1.701s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:58:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-71a74ff3-606e-4283-a03a-e5792d5b7a6b tempest-ServersNegativeTestJSON-503259173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6c2b74e6-8280-4c8a-85cb-6c89662ac247 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:58:39 devstack sudo[95828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6c2b74e6-8280-4c8a-85cb-6c89662ac247 Jun 24 04:58:39 devstack sudo[95828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:58:40 devstack sudo[95828]: pam_unix(sudo:session): session closed for user root Jun 24 04:58:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-71a74ff3-606e-4283-a03a-e5792d5b7a6b tempest-ServersNegativeTestJSON-503259173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6c2b74e6-8280-4c8a-85cb-6c89662ac247" returned: 0 in 1.342s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:58:40 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-71a74ff3-606e-4283-a03a-e5792d5b7a6b tempest-ServersNegativeTestJSON-503259173 None] Lock "cinder-quobyte-6c2b74e6-8280-4c8a-85cb-6c89662ac247" released by "delete_volume" :: held 3.151s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 04:58:40 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-71a74ff3-606e-4283-a03a-e5792d5b7a6b tempest-ServersNegativeTestJSON-503259173 None] Created reservations ['0f0e0760-1078-4850-a0d6-295fe373c0d2', 'd795a0ed-7d09-418a-adaf-977bc27d6af9', 'a3922593-279c-43b1-90cd-de32e434154b', 'a846772a-4a25-46bf-96a1-ee9f06461f69'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 04:58:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-71a74ff3-606e-4283-a03a-e5792d5b7a6b tempest-ServersNegativeTestJSON-503259173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 04:58:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-71a74ff3-606e-4283-a03a-e5792d5b7a6b tempest-ServersNegativeTestJSON-503259173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 04:58:41 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-71a74ff3-606e-4283-a03a-e5792d5b7a6b tempest-ServersNegativeTestJSON-503259173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 04:58:41 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-71a74ff3-606e-4283-a03a-e5792d5b7a6b tempest-ServersNegativeTestJSON-503259173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 04:58:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-71a74ff3-606e-4283-a03a-e5792d5b7a6b tempest-ServersNegativeTestJSON-503259173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 04:58:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-71a74ff3-606e-4283-a03a-e5792d5b7a6b tempest-ServersNegativeTestJSON-503259173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:58:41 devstack sudo[95868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 04:58:41 devstack sudo[95868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:58:42 devstack sudo[95868]: pam_unix(sudo:session): session closed for user root Jun 24 04:58:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-71a74ff3-606e-4283-a03a-e5792d5b7a6b tempest-ServersNegativeTestJSON-503259173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 1.073s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:58:42 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-71a74ff3-606e-4283-a03a-e5792d5b7a6b tempest-ServersNegativeTestJSON-503259173 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 04:58:42 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-71a74ff3-606e-4283-a03a-e5792d5b7a6b tempest-ServersNegativeTestJSON-503259173 None] Deleted volume successfully. Jun 24 04:58:42 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-255b2498-f95a-4411-bc40-8ad01b8fc9bf tempest-ServersNegativeTestJSON-503259173 None] Acquiring lock "cinder-41964ecd-fb08-4742-a122-891e4b1fae95-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 04:58:42 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-71a74ff3-606e-4283-a03a-e5792d5b7a6b tempest-ServersNegativeTestJSON-503259173 None] Lock "cinder-6c2b74e6-8280-4c8a-85cb-6c89662ac247-delete_volume" released by "delete_volume" :: held 4.744s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 04:58:42 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-255b2498-f95a-4411-bc40-8ad01b8fc9bf tempest-ServersNegativeTestJSON-503259173 None] Lock "cinder-41964ecd-fb08-4742-a122-891e4b1fae95-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 04:58:42 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-255b2498-f95a-4411-bc40-8ad01b8fc9bf tempest-ServersNegativeTestJSON-503259173 None] Acquiring lock "cinder-quobyte-41964ecd-fb08-4742-a122-891e4b1fae95" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 04:58:42 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-255b2498-f95a-4411-bc40-8ad01b8fc9bf tempest-ServersNegativeTestJSON-503259173 None] Lock "cinder-quobyte-41964ecd-fb08-4742-a122-891e4b1fae95" acquired by "delete_volume" :: waited 0.023s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 04:58:42 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7e3675-84ae-48a7-8be2-43c9f9d7dd72]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 04:58:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-255b2498-f95a-4411-bc40-8ad01b8fc9bf tempest-ServersNegativeTestJSON-503259173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-41964ecd-fb08-4742-a122-891e4b1fae95 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:58:42 devstack sudo[95875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-41964ecd-fb08-4742-a122-891e4b1fae95 Jun 24 04:58:42 devstack sudo[95875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:58:43 devstack sudo[95875]: pam_unix(sudo:session): session closed for user root Jun 24 04:58:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-255b2498-f95a-4411-bc40-8ad01b8fc9bf tempest-ServersNegativeTestJSON-503259173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-41964ecd-fb08-4742-a122-891e4b1fae95" returned: 0 in 0.985s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:58:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-255b2498-f95a-4411-bc40-8ad01b8fc9bf tempest-ServersNegativeTestJSON-503259173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-41964ecd-fb08-4742-a122-891e4b1fae95 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:58:43 devstack sudo[95882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-41964ecd-fb08-4742-a122-891e4b1fae95 Jun 24 04:58:43 devstack sudo[95882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:58:44 devstack sudo[95882]: pam_unix(sudo:session): session closed for user root Jun 24 04:58:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-255b2498-f95a-4411-bc40-8ad01b8fc9bf tempest-ServersNegativeTestJSON-503259173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-41964ecd-fb08-4742-a122-891e4b1fae95" returned: 0 in 0.825s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:58:44 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-255b2498-f95a-4411-bc40-8ad01b8fc9bf tempest-ServersNegativeTestJSON-503259173 None] Lock "cinder-quobyte-41964ecd-fb08-4742-a122-891e4b1fae95" released by "delete_volume" :: held 1.897s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 04:58:44 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-255b2498-f95a-4411-bc40-8ad01b8fc9bf tempest-ServersNegativeTestJSON-503259173 None] Created reservations ['5a2274a5-186c-49aa-8758-76706e54c5b8', 'e8fed1c9-68dd-4d21-b6cd-9ccb2beb027a', '823a7513-ed77-4981-a9a5-d8179175e9b7', 'f6af2fa8-842c-417c-8188-3664085ae073'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 04:58:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-255b2498-f95a-4411-bc40-8ad01b8fc9bf tempest-ServersNegativeTestJSON-503259173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 04:58:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-255b2498-f95a-4411-bc40-8ad01b8fc9bf tempest-ServersNegativeTestJSON-503259173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 04:58:44 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-255b2498-f95a-4411-bc40-8ad01b8fc9bf tempest-ServersNegativeTestJSON-503259173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 04:58:44 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-255b2498-f95a-4411-bc40-8ad01b8fc9bf tempest-ServersNegativeTestJSON-503259173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 04:58:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-255b2498-f95a-4411-bc40-8ad01b8fc9bf tempest-ServersNegativeTestJSON-503259173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 04:58:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-255b2498-f95a-4411-bc40-8ad01b8fc9bf tempest-ServersNegativeTestJSON-503259173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:58:44 devstack sudo[95889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 04:58:44 devstack sudo[95889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:58:45 devstack sudo[95889]: pam_unix(sudo:session): session closed for user root Jun 24 04:58:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-255b2498-f95a-4411-bc40-8ad01b8fc9bf tempest-ServersNegativeTestJSON-503259173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 1.119s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:58:45 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-255b2498-f95a-4411-bc40-8ad01b8fc9bf tempest-ServersNegativeTestJSON-503259173 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 04:58:45 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-735ed1d2-942f-4781-94df-be556048ad3e tempest-ServerRescueNegativeTestJSON-666320637 None] Acquiring lock "cinder-e48eb9ad-2c16-49f9-acc4-c552387cc1de-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 04:58:45 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-255b2498-f95a-4411-bc40-8ad01b8fc9bf tempest-ServersNegativeTestJSON-503259173 None] Deleted volume successfully. Jun 24 04:58:45 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-735ed1d2-942f-4781-94df-be556048ad3e tempest-ServerRescueNegativeTestJSON-666320637 None] Lock "cinder-e48eb9ad-2c16-49f9-acc4-c552387cc1de-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 04:58:45 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-255b2498-f95a-4411-bc40-8ad01b8fc9bf tempest-ServersNegativeTestJSON-503259173 None] Lock "cinder-41964ecd-fb08-4742-a122-891e4b1fae95-delete_volume" released by "delete_volume" :: held 3.380s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 04:58:45 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-735ed1d2-942f-4781-94df-be556048ad3e tempest-ServerRescueNegativeTestJSON-666320637 None] Acquiring lock "cinder-quobyte-e48eb9ad-2c16-49f9-acc4-c552387cc1de" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 04:58:45 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-735ed1d2-942f-4781-94df-be556048ad3e tempest-ServerRescueNegativeTestJSON-666320637 None] Lock "cinder-quobyte-e48eb9ad-2c16-49f9-acc4-c552387cc1de" acquired by "delete_volume" :: waited 0.023s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 04:58:45 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5d0cd5-cd00-4e2b-87bf-8dc6782946f1]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 04:58:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-735ed1d2-942f-4781-94df-be556048ad3e tempest-ServerRescueNegativeTestJSON-666320637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e48eb9ad-2c16-49f9-acc4-c552387cc1de {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:58:45 devstack sudo[95895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e48eb9ad-2c16-49f9-acc4-c552387cc1de Jun 24 04:58:45 devstack sudo[95895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:58:47 devstack sudo[95895]: pam_unix(sudo:session): session closed for user root Jun 24 04:58:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-735ed1d2-942f-4781-94df-be556048ad3e tempest-ServerRescueNegativeTestJSON-666320637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e48eb9ad-2c16-49f9-acc4-c552387cc1de" returned: 0 in 2.152s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:58:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-735ed1d2-942f-4781-94df-be556048ad3e tempest-ServerRescueNegativeTestJSON-666320637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e48eb9ad-2c16-49f9-acc4-c552387cc1de {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:58:48 devstack sudo[95996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e48eb9ad-2c16-49f9-acc4-c552387cc1de Jun 24 04:58:48 devstack sudo[95996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:58:49 devstack sudo[95996]: pam_unix(sudo:session): session closed for user root Jun 24 04:58:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-735ed1d2-942f-4781-94df-be556048ad3e tempest-ServerRescueNegativeTestJSON-666320637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e48eb9ad-2c16-49f9-acc4-c552387cc1de" returned: 0 in 1.109s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:58:49 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-735ed1d2-942f-4781-94df-be556048ad3e tempest-ServerRescueNegativeTestJSON-666320637 None] Lock "cinder-quobyte-e48eb9ad-2c16-49f9-acc4-c552387cc1de" released by "delete_volume" :: held 3.322s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 04:58:49 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-735ed1d2-942f-4781-94df-be556048ad3e tempest-ServerRescueNegativeTestJSON-666320637 None] Created reservations ['cf65a698-c185-428d-b16c-d1a97ae6b1d9', 'b66883b6-3bfa-46e5-bf4e-2cffb4af002a', 'ca02027a-450d-41a1-ac73-a7240af5d26b', '6c8218e9-24b6-4b87-bc87-08de81984d89'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 04:58:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-735ed1d2-942f-4781-94df-be556048ad3e tempest-ServerRescueNegativeTestJSON-666320637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 04:58:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-735ed1d2-942f-4781-94df-be556048ad3e tempest-ServerRescueNegativeTestJSON-666320637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 04:58:49 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-735ed1d2-942f-4781-94df-be556048ad3e tempest-ServerRescueNegativeTestJSON-666320637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 04:58:49 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-735ed1d2-942f-4781-94df-be556048ad3e tempest-ServerRescueNegativeTestJSON-666320637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 04:58:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-735ed1d2-942f-4781-94df-be556048ad3e tempest-ServerRescueNegativeTestJSON-666320637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 04:58:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-735ed1d2-942f-4781-94df-be556048ad3e tempest-ServerRescueNegativeTestJSON-666320637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:58:49 devstack sudo[96038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 04:58:49 devstack sudo[96038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:58:51 devstack sudo[96038]: pam_unix(sudo:session): session closed for user root Jun 24 04:58:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-735ed1d2-942f-4781-94df-be556048ad3e tempest-ServerRescueNegativeTestJSON-666320637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 1.922s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:58:51 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-735ed1d2-942f-4781-94df-be556048ad3e tempest-ServerRescueNegativeTestJSON-666320637 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 04:58:51 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-735ed1d2-942f-4781-94df-be556048ad3e tempest-ServerRescueNegativeTestJSON-666320637 None] Deleted volume successfully. Jun 24 04:58:51 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-735ed1d2-942f-4781-94df-be556048ad3e tempest-ServerRescueNegativeTestJSON-666320637 None] Lock "cinder-e48eb9ad-2c16-49f9-acc4-c552387cc1de-delete_volume" released by "delete_volume" :: held 5.687s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 04:58:56 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:UPDATE=45,cinder:SELECT=28,cinder:INSERT=12,cinder:DELETE=5 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 04:58:56 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:SELECT=30,cinder:UPDATE=45,cinder:INSERT=8,cinder:DELETE=3 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 04:58:56 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-06efa3be-74b0-41d8-a33d-c36a63ac48db tempest-DeleteServersTestJSON-1344731407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 04:58:56 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-06efa3be-74b0-41d8-a33d-c36a63ac48db tempest-DeleteServersTestJSON-1344731407 None] Flow 'volume_create_manager' (9e4cbf6e-c8e8-4adc-b179-881d7c62cc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 04:58:56 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-06efa3be-74b0-41d8-a33d-c36a63ac48db tempest-DeleteServersTestJSON-1344731407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7ecbe10-e55b-46f5-8c03-1224cd9ad4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:58:56 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-06efa3be-74b0-41d8-a33d-c36a63ac48db tempest-DeleteServersTestJSON-1344731407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7ecbe10-e55b-46f5-8c03-1224cd9ad4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T02:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-187048956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df8ba5fb-17c4-4e3d-b54d-894abd577693,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05a13e42dd7f48f3ad4d42ef2a50d33d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:58:56Z,use_quota=True,user_id='c097743672d247f1998e65eb6e013e20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 04:58:56 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-06efa3be-74b0-41d8-a33d-c36a63ac48db tempest-DeleteServersTestJSON-1344731407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e4628dc-0f5e-4756-8b8d-8967df223a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:58:56 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-06efa3be-74b0-41d8-a33d-c36a63ac48db tempest-DeleteServersTestJSON-1344731407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e4628dc-0f5e-4756-8b8d-8967df223a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 04:58:56 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-06efa3be-74b0-41d8-a33d-c36a63ac48db tempest-DeleteServersTestJSON-1344731407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a102392-6ab1-41e0-a043-d72e928a8967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:58:56 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-06efa3be-74b0-41d8-a33d-c36a63ac48db tempest-DeleteServersTestJSON-1344731407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a102392-6ab1-41e0-a043-d72e928a8967) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df8ba5fb-17c4-4e3d-b54d-894abd577693', 'volume_name': 'volume-df8ba5fb-17c4-4e3d-b54d-894abd577693', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 04:58:56 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-06efa3be-74b0-41d8-a33d-c36a63ac48db tempest-DeleteServersTestJSON-1344731407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad3eb766-14d9-48cc-8d8d-f0e7e063d06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:58:56 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-06efa3be-74b0-41d8-a33d-c36a63ac48db tempest-DeleteServersTestJSON-1344731407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad3eb766-14d9-48cc-8d8d-f0e7e063d06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 04:58:56 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-06efa3be-74b0-41d8-a33d-c36a63ac48db tempest-DeleteServersTestJSON-1344731407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a14f5bec-c7ed-42ec-85ad-1479693e6bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:58:56 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-06efa3be-74b0-41d8-a33d-c36a63ac48db tempest-DeleteServersTestJSON-1344731407 None] Volume df8ba5fb-17c4-4e3d-b54d-894abd577693: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df8ba5fb-17c4-4e3d-b54d-894abd577693', 'volume_size': 1} Jun 24 04:58:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-06efa3be-74b0-41d8-a33d-c36a63ac48db tempest-DeleteServersTestJSON-1344731407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 04:58:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-06efa3be-74b0-41d8-a33d-c36a63ac48db tempest-DeleteServersTestJSON-1344731407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 04:58:56 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-06efa3be-74b0-41d8-a33d-c36a63ac48db tempest-DeleteServersTestJSON-1344731407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T02:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-187048956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df8ba5fb-17c4-4e3d-b54d-894abd577693,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05a13e42dd7f48f3ad4d42ef2a50d33d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:58:56Z,use_quota=True,user_id='c097743672d247f1998e65eb6e013e20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 04:58:56 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-06efa3be-74b0-41d8-a33d-c36a63ac48db tempest-DeleteServersTestJSON-1344731407 None] Creating volume df8ba5fb-17c4-4e3d-b54d-894abd577693 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 04:58:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-06efa3be-74b0-41d8-a33d-c36a63ac48db tempest-DeleteServersTestJSON-1344731407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 04:58:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-06efa3be-74b0-41d8-a33d-c36a63ac48db tempest-DeleteServersTestJSON-1344731407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 04:58:56 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-06efa3be-74b0-41d8-a33d-c36a63ac48db tempest-DeleteServersTestJSON-1344731407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 04:58:56 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-06efa3be-74b0-41d8-a33d-c36a63ac48db tempest-DeleteServersTestJSON-1344731407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 04:58:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-06efa3be-74b0-41d8-a33d-c36a63ac48db tempest-DeleteServersTestJSON-1344731407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 04:58:56 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-06efa3be-74b0-41d8-a33d-c36a63ac48db tempest-DeleteServersTestJSON-1344731407 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 04:58:56 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-06efa3be-74b0-41d8-a33d-c36a63ac48db tempest-DeleteServersTestJSON-1344731407 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 04:58:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-06efa3be-74b0-41d8-a33d-c36a63ac48db tempest-DeleteServersTestJSON-1344731407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df8ba5fb-17c4-4e3d-b54d-894abd577693 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:58:56 devstack sudo[96159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df8ba5fb-17c4-4e3d-b54d-894abd577693 1073741824 Jun 24 04:58:56 devstack sudo[96159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:58:57 devstack sudo[96159]: pam_unix(sudo:session): session closed for user root Jun 24 04:58:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-06efa3be-74b0-41d8-a33d-c36a63ac48db tempest-DeleteServersTestJSON-1344731407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df8ba5fb-17c4-4e3d-b54d-894abd577693 1073741824" returned: 0 in 1.282s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:58:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-06efa3be-74b0-41d8-a33d-c36a63ac48db tempest-DeleteServersTestJSON-1344731407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df8ba5fb-17c4-4e3d-b54d-894abd577693 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:58:57 devstack sudo[96167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df8ba5fb-17c4-4e3d-b54d-894abd577693 Jun 24 04:58:57 devstack sudo[96167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:58:58 devstack sudo[96167]: pam_unix(sudo:session): session closed for user root Jun 24 04:58:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-06efa3be-74b0-41d8-a33d-c36a63ac48db tempest-DeleteServersTestJSON-1344731407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df8ba5fb-17c4-4e3d-b54d-894abd577693" returned: 0 in 0.987s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:58:58 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-06efa3be-74b0-41d8-a33d-c36a63ac48db tempest-DeleteServersTestJSON-1344731407 None] <== create_volume: return (2366ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 04:58:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-06efa3be-74b0-41d8-a33d-c36a63ac48db tempest-DeleteServersTestJSON-1344731407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.369s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 04:58:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-06efa3be-74b0-41d8-a33d-c36a63ac48db tempest-DeleteServersTestJSON-1344731407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a14f5bec-c7ed-42ec-85ad-1479693e6bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df8ba5fb-17c4-4e3d-b54d-894abd577693', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 04:58:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-06efa3be-74b0-41d8-a33d-c36a63ac48db tempest-DeleteServersTestJSON-1344731407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da0b8d93-59a5-4968-a061-b63be132aa5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:58:58 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-06efa3be-74b0-41d8-a33d-c36a63ac48db tempest-DeleteServersTestJSON-1344731407 None] Volume volume-df8ba5fb-17c4-4e3d-b54d-894abd577693 (df8ba5fb-17c4-4e3d-b54d-894abd577693): created successfully Jun 24 04:58:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-06efa3be-74b0-41d8-a33d-c36a63ac48db tempest-DeleteServersTestJSON-1344731407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da0b8d93-59a5-4968-a061-b63be132aa5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 04:58:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-06efa3be-74b0-41d8-a33d-c36a63ac48db tempest-DeleteServersTestJSON-1344731407 None] Flow 'volume_create_manager' (9e4cbf6e-c8e8-4adc-b179-881d7c62cc0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 04:58:58 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-06efa3be-74b0-41d8-a33d-c36a63ac48db tempest-DeleteServersTestJSON-1344731407 None] Created volume successfully. Jun 24 04:59:07 devstack cinder-volume[93830]: WARNING py.warnings [req-3eba083c-cbad-45eb-b4f0-dc8288f485a4 req-69cfcedf-11d8-43a4-8339-8c88e263583e tempest-DeleteServersTestJSON-1344731407 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jun 24 04:59:07 devstack cinder-volume[93830]: .first() Jun 24 04:59:07 devstack cinder-volume[93830]: Jun 24 04:59:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-3eba083c-cbad-45eb-b4f0-dc8288f485a4 req-69cfcedf-11d8-43a4-8339-8c88e263583e tempest-DeleteServersTestJSON-1344731407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 04:59:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-3eba083c-cbad-45eb-b4f0-dc8288f485a4 req-69cfcedf-11d8-43a4-8339-8c88e263583e tempest-DeleteServersTestJSON-1344731407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 04:59:07 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[810cfae8-2b43-47a8-96a4-862a3cc74284]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 04:59:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-3eba083c-cbad-45eb-b4f0-dc8288f485a4 req-69cfcedf-11d8-43a4-8339-8c88e263583e tempest-DeleteServersTestJSON-1344731407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df8ba5fb-17c4-4e3d-b54d-894abd577693 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:59:07 devstack sudo[96262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df8ba5fb-17c4-4e3d-b54d-894abd577693 Jun 24 04:59:07 devstack sudo[96262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:59:08 devstack sudo[96262]: pam_unix(sudo:session): session closed for user root Jun 24 04:59:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-3eba083c-cbad-45eb-b4f0-dc8288f485a4 req-69cfcedf-11d8-43a4-8339-8c88e263583e tempest-DeleteServersTestJSON-1344731407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df8ba5fb-17c4-4e3d-b54d-894abd577693" returned: 0 in 1.066s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:59:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-3eba083c-cbad-45eb-b4f0-dc8288f485a4 req-69cfcedf-11d8-43a4-8339-8c88e263583e tempest-DeleteServersTestJSON-1344731407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.088s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 04:59:08 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-3eba083c-cbad-45eb-b4f0-dc8288f485a4 req-69cfcedf-11d8-43a4-8339-8c88e263583e tempest-DeleteServersTestJSON-1344731407 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05', 'name': 'volume-df8ba5fb-17c4-4e3d-b54d-894abd577693', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9b0ee908-4b27-4f89-aff2-9cd199c0ad71', 'enforce_multipath': True} {{(pid=93830) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 04:59:08 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-3eba083c-cbad-45eb-b4f0-dc8288f485a4 req-69cfcedf-11d8-43a4-8339-8c88e263583e tempest-DeleteServersTestJSON-1344731407 None] attachment_update completed successfully. Jun 24 04:59:09 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 04:59:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 04:59:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 04:59:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 04:59:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 04:59:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 04:59:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:59:09 devstack sudo[96337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 04:59:09 devstack sudo[96337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:59:10 devstack sudo[96337]: pam_unix(sudo:session): session closed for user root Jun 24 04:59:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.833s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:59:10 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 04:59:18 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:SELECT=6,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 04:59:18 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 04:59:20 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-2d70ccc1-cb52-4000-a153-286981e740e5 req-300b814d-b8b9-48aa-8dcf-b0cd731cac46 tempest-DeleteServersTestJSON-1344731407 None] Terminate volume connection completed successfully. Jun 24 04:59:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-2d70ccc1-cb52-4000-a153-286981e740e5 req-300b814d-b8b9-48aa-8dcf-b0cd731cac46 tempest-DeleteServersTestJSON-1344731407 None] Deleting attachment 9b0ee908-4b27-4f89-aff2-9cd199c0ad71. {{(pid=93830) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 04:59:24 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-188fc3a8-0a4f-429f-be30-b17d8cd52f46 tempest-DeleteServersTestJSON-1344731407 None] Acquiring lock "cinder-df8ba5fb-17c4-4e3d-b54d-894abd577693-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 04:59:24 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-188fc3a8-0a4f-429f-be30-b17d8cd52f46 tempest-DeleteServersTestJSON-1344731407 None] Lock "cinder-df8ba5fb-17c4-4e3d-b54d-894abd577693-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 04:59:25 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-188fc3a8-0a4f-429f-be30-b17d8cd52f46 tempest-DeleteServersTestJSON-1344731407 None] Acquiring lock "cinder-quobyte-df8ba5fb-17c4-4e3d-b54d-894abd577693" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 04:59:25 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-188fc3a8-0a4f-429f-be30-b17d8cd52f46 tempest-DeleteServersTestJSON-1344731407 None] Lock "cinder-quobyte-df8ba5fb-17c4-4e3d-b54d-894abd577693" acquired by "delete_volume" :: waited 0.019s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 04:59:25 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[3789d6c1-746e-4a74-871f-9ccb1dcd0d67]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 04:59:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-188fc3a8-0a4f-429f-be30-b17d8cd52f46 tempest-DeleteServersTestJSON-1344731407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df8ba5fb-17c4-4e3d-b54d-894abd577693 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:59:25 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df8ba5fb-17c4-4e3d-b54d-894abd577693 Jun 24 04:59:25 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:59:25 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Jun 24 04:59:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-188fc3a8-0a4f-429f-be30-b17d8cd52f46 tempest-DeleteServersTestJSON-1344731407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df8ba5fb-17c4-4e3d-b54d-894abd577693" returned: 0 in 0.867s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:59:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-188fc3a8-0a4f-429f-be30-b17d8cd52f46 tempest-DeleteServersTestJSON-1344731407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df8ba5fb-17c4-4e3d-b54d-894abd577693 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:59:25 devstack sudo[96780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df8ba5fb-17c4-4e3d-b54d-894abd577693 Jun 24 04:59:25 devstack sudo[96780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:59:26 devstack sudo[96780]: pam_unix(sudo:session): session closed for user root Jun 24 04:59:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-188fc3a8-0a4f-429f-be30-b17d8cd52f46 tempest-DeleteServersTestJSON-1344731407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df8ba5fb-17c4-4e3d-b54d-894abd577693" returned: 0 in 0.763s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:59:26 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-188fc3a8-0a4f-429f-be30-b17d8cd52f46 tempest-DeleteServersTestJSON-1344731407 None] Lock "cinder-quobyte-df8ba5fb-17c4-4e3d-b54d-894abd577693" released by "delete_volume" :: held 1.689s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 04:59:26 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-188fc3a8-0a4f-429f-be30-b17d8cd52f46 tempest-DeleteServersTestJSON-1344731407 None] Created reservations ['453ef373-ae1c-4867-ac39-8735ba017ab6', '94820cfa-64c0-4f72-a497-75078c7384f6', '274f1d94-f710-4476-a0cf-7072a2fd0747', 'f519c182-f35a-41df-b534-87b94cc0978b'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 04:59:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-188fc3a8-0a4f-429f-be30-b17d8cd52f46 tempest-DeleteServersTestJSON-1344731407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 04:59:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-188fc3a8-0a4f-429f-be30-b17d8cd52f46 tempest-DeleteServersTestJSON-1344731407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 04:59:26 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-188fc3a8-0a4f-429f-be30-b17d8cd52f46 tempest-DeleteServersTestJSON-1344731407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 04:59:26 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-188fc3a8-0a4f-429f-be30-b17d8cd52f46 tempest-DeleteServersTestJSON-1344731407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 04:59:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-188fc3a8-0a4f-429f-be30-b17d8cd52f46 tempest-DeleteServersTestJSON-1344731407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 04:59:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-188fc3a8-0a4f-429f-be30-b17d8cd52f46 tempest-DeleteServersTestJSON-1344731407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:59:26 devstack sudo[96783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 04:59:26 devstack sudo[96783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:59:27 devstack sudo[96783]: pam_unix(sudo:session): session closed for user root Jun 24 04:59:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-188fc3a8-0a4f-429f-be30-b17d8cd52f46 tempest-DeleteServersTestJSON-1344731407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.684s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:59:27 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-188fc3a8-0a4f-429f-be30-b17d8cd52f46 tempest-DeleteServersTestJSON-1344731407 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 04:59:27 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-188fc3a8-0a4f-429f-be30-b17d8cd52f46 tempest-DeleteServersTestJSON-1344731407 None] Deleted volume successfully. Jun 24 04:59:27 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-188fc3a8-0a4f-429f-be30-b17d8cd52f46 tempest-DeleteServersTestJSON-1344731407 None] Lock "cinder-df8ba5fb-17c4-4e3d-b54d-894abd577693-delete_volume" released by "delete_volume" :: held 2.620s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 04:59:36 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:SELECT=6,cinder:UPDATE=9,cinder:INSERT=3 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 04:59:37 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 04:59:38 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-766345eb-7bab-4a0b-a94a-cae653b878d7 tempest-TaggedAttachmentsTest-23923640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 04:59:38 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-766345eb-7bab-4a0b-a94a-cae653b878d7 tempest-TaggedAttachmentsTest-23923640 None] Flow 'volume_create_manager' (99e91845-55f5-441a-8139-4c205756c288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 04:59:38 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-766345eb-7bab-4a0b-a94a-cae653b878d7 tempest-TaggedAttachmentsTest-23923640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4c9b126-4192-4994-ae2f-097cffdda5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:59:38 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-766345eb-7bab-4a0b-a94a-cae653b878d7 tempest-TaggedAttachmentsTest-23923640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4c9b126-4192-4994-ae2f-097cffdda5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T02:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-667488836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2bbebdb-c653-487e-8182-e84c72c3fe7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a4cfe3682f24155a51b4b7a160cc1cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:59:39Z,use_quota=True,user_id='a521f2c99cde4f0b9110c6f9cf8d17d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 04:59:38 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-766345eb-7bab-4a0b-a94a-cae653b878d7 tempest-TaggedAttachmentsTest-23923640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d67ee6c6-0252-4b20-b14d-061bca27d747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:59:38 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-766345eb-7bab-4a0b-a94a-cae653b878d7 tempest-TaggedAttachmentsTest-23923640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d67ee6c6-0252-4b20-b14d-061bca27d747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 04:59:38 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-766345eb-7bab-4a0b-a94a-cae653b878d7 tempest-TaggedAttachmentsTest-23923640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ab9d62e-7a50-4b24-992c-43e286e75b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:59:38 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-766345eb-7bab-4a0b-a94a-cae653b878d7 tempest-TaggedAttachmentsTest-23923640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ab9d62e-7a50-4b24-992c-43e286e75b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2bbebdb-c653-487e-8182-e84c72c3fe7b', 'volume_name': 'volume-a2bbebdb-c653-487e-8182-e84c72c3fe7b', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 04:59:38 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-766345eb-7bab-4a0b-a94a-cae653b878d7 tempest-TaggedAttachmentsTest-23923640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c11fad76-43ec-46da-90f7-d295d221c611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:59:38 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-766345eb-7bab-4a0b-a94a-cae653b878d7 tempest-TaggedAttachmentsTest-23923640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c11fad76-43ec-46da-90f7-d295d221c611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 04:59:38 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-766345eb-7bab-4a0b-a94a-cae653b878d7 tempest-TaggedAttachmentsTest-23923640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f46c03ce-48ab-4234-afe8-bb1f47429e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:59:38 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-766345eb-7bab-4a0b-a94a-cae653b878d7 tempest-TaggedAttachmentsTest-23923640 None] Volume a2bbebdb-c653-487e-8182-e84c72c3fe7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2bbebdb-c653-487e-8182-e84c72c3fe7b', 'volume_size': 1} Jun 24 04:59:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-766345eb-7bab-4a0b-a94a-cae653b878d7 tempest-TaggedAttachmentsTest-23923640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 04:59:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-766345eb-7bab-4a0b-a94a-cae653b878d7 tempest-TaggedAttachmentsTest-23923640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 04:59:38 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-766345eb-7bab-4a0b-a94a-cae653b878d7 tempest-TaggedAttachmentsTest-23923640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T02:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-667488836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2bbebdb-c653-487e-8182-e84c72c3fe7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a4cfe3682f24155a51b4b7a160cc1cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:59:39Z,use_quota=True,user_id='a521f2c99cde4f0b9110c6f9cf8d17d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 04:59:38 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-766345eb-7bab-4a0b-a94a-cae653b878d7 tempest-TaggedAttachmentsTest-23923640 None] Creating volume a2bbebdb-c653-487e-8182-e84c72c3fe7b {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 04:59:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-766345eb-7bab-4a0b-a94a-cae653b878d7 tempest-TaggedAttachmentsTest-23923640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 04:59:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-766345eb-7bab-4a0b-a94a-cae653b878d7 tempest-TaggedAttachmentsTest-23923640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 04:59:38 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-766345eb-7bab-4a0b-a94a-cae653b878d7 tempest-TaggedAttachmentsTest-23923640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 04:59:38 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-766345eb-7bab-4a0b-a94a-cae653b878d7 tempest-TaggedAttachmentsTest-23923640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 04:59:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-766345eb-7bab-4a0b-a94a-cae653b878d7 tempest-TaggedAttachmentsTest-23923640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 04:59:38 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-766345eb-7bab-4a0b-a94a-cae653b878d7 tempest-TaggedAttachmentsTest-23923640 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 04:59:38 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-766345eb-7bab-4a0b-a94a-cae653b878d7 tempest-TaggedAttachmentsTest-23923640 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 04:59:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-766345eb-7bab-4a0b-a94a-cae653b878d7 tempest-TaggedAttachmentsTest-23923640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a2bbebdb-c653-487e-8182-e84c72c3fe7b 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:59:38 devstack sudo[96798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a2bbebdb-c653-487e-8182-e84c72c3fe7b 1073741824 Jun 24 04:59:38 devstack sudo[96798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:59:39 devstack sudo[96798]: pam_unix(sudo:session): session closed for user root Jun 24 04:59:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-766345eb-7bab-4a0b-a94a-cae653b878d7 tempest-TaggedAttachmentsTest-23923640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a2bbebdb-c653-487e-8182-e84c72c3fe7b 1073741824" returned: 0 in 1.118s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:59:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-766345eb-7bab-4a0b-a94a-cae653b878d7 tempest-TaggedAttachmentsTest-23923640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a2bbebdb-c653-487e-8182-e84c72c3fe7b {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:59:40 devstack sudo[96806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a2bbebdb-c653-487e-8182-e84c72c3fe7b Jun 24 04:59:40 devstack sudo[96806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:59:40 devstack sudo[96806]: pam_unix(sudo:session): session closed for user root Jun 24 04:59:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-766345eb-7bab-4a0b-a94a-cae653b878d7 tempest-TaggedAttachmentsTest-23923640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a2bbebdb-c653-487e-8182-e84c72c3fe7b" returned: 0 in 0.965s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:59:40 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-766345eb-7bab-4a0b-a94a-cae653b878d7 tempest-TaggedAttachmentsTest-23923640 None] <== create_volume: return (2147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 04:59:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-766345eb-7bab-4a0b-a94a-cae653b878d7 tempest-TaggedAttachmentsTest-23923640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.150s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 04:59:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-766345eb-7bab-4a0b-a94a-cae653b878d7 tempest-TaggedAttachmentsTest-23923640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f46c03ce-48ab-4234-afe8-bb1f47429e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2bbebdb-c653-487e-8182-e84c72c3fe7b', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 04:59:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-766345eb-7bab-4a0b-a94a-cae653b878d7 tempest-TaggedAttachmentsTest-23923640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30932d4d-22e7-49aa-975d-affbb39920d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:59:41 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-766345eb-7bab-4a0b-a94a-cae653b878d7 tempest-TaggedAttachmentsTest-23923640 None] Volume volume-a2bbebdb-c653-487e-8182-e84c72c3fe7b (a2bbebdb-c653-487e-8182-e84c72c3fe7b): created successfully Jun 24 04:59:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-766345eb-7bab-4a0b-a94a-cae653b878d7 tempest-TaggedAttachmentsTest-23923640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30932d4d-22e7-49aa-975d-affbb39920d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 04:59:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-766345eb-7bab-4a0b-a94a-cae653b878d7 tempest-TaggedAttachmentsTest-23923640 None] Flow 'volume_create_manager' (99e91845-55f5-441a-8139-4c205756c288) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 04:59:41 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-766345eb-7bab-4a0b-a94a-cae653b878d7 tempest-TaggedAttachmentsTest-23923640 None] Created volume successfully. Jun 24 04:59:43 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [req-de8feab3-7917-4a4c-87d7-2df6a1dc7608 req-c69aef44-6d3c-438d-af24-1f38623b3c5e tempest-VolumesGetTestJSON-1322252351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 04:59:43 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-de8feab3-7917-4a4c-87d7-2df6a1dc7608 req-c69aef44-6d3c-438d-af24-1f38623b3c5e tempest-VolumesGetTestJSON-1322252351 None] Flow 'volume_create_manager' (521af98c-3b1c-46e2-b07d-7f1d72e31b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 04:59:43 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-de8feab3-7917-4a4c-87d7-2df6a1dc7608 req-c69aef44-6d3c-438d-af24-1f38623b3c5e tempest-VolumesGetTestJSON-1322252351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ee709e0-13f0-4705-a8db-8b49699bb73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:59:43 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-de8feab3-7917-4a4c-87d7-2df6a1dc7608 req-c69aef44-6d3c-438d-af24-1f38623b3c5e tempest-VolumesGetTestJSON-1322252351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ee709e0-13f0-4705-a8db-8b49699bb73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T02:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2034102431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43861bb6-3243-47a4-ab98-88dc02d4bd16,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8335c82f330f463b9c204dc5d5d511a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:59:44Z,use_quota=True,user_id='5c6cfd1a3599463c8f2a7dfb4a908b31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 04:59:43 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-de8feab3-7917-4a4c-87d7-2df6a1dc7608 req-c69aef44-6d3c-438d-af24-1f38623b3c5e tempest-VolumesGetTestJSON-1322252351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399529d4-b5a2-4895-b51d-655634349c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:59:43 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-de8feab3-7917-4a4c-87d7-2df6a1dc7608 req-c69aef44-6d3c-438d-af24-1f38623b3c5e tempest-VolumesGetTestJSON-1322252351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399529d4-b5a2-4895-b51d-655634349c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 04:59:43 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-de8feab3-7917-4a4c-87d7-2df6a1dc7608 req-c69aef44-6d3c-438d-af24-1f38623b3c5e tempest-VolumesGetTestJSON-1322252351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b366b53-3531-44cb-ada2-eea9c4fa9094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:59:43 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-de8feab3-7917-4a4c-87d7-2df6a1dc7608 req-c69aef44-6d3c-438d-af24-1f38623b3c5e tempest-VolumesGetTestJSON-1322252351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b366b53-3531-44cb-ada2-eea9c4fa9094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43861bb6-3243-47a4-ab98-88dc02d4bd16', 'volume_name': 'volume-43861bb6-3243-47a4-ab98-88dc02d4bd16', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 04:59:43 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-de8feab3-7917-4a4c-87d7-2df6a1dc7608 req-c69aef44-6d3c-438d-af24-1f38623b3c5e tempest-VolumesGetTestJSON-1322252351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea2a305-8536-4931-9470-723554eff5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:59:43 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-de8feab3-7917-4a4c-87d7-2df6a1dc7608 req-c69aef44-6d3c-438d-af24-1f38623b3c5e tempest-VolumesGetTestJSON-1322252351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea2a305-8536-4931-9470-723554eff5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 04:59:43 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-de8feab3-7917-4a4c-87d7-2df6a1dc7608 req-c69aef44-6d3c-438d-af24-1f38623b3c5e tempest-VolumesGetTestJSON-1322252351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfa83e18-04ec-410e-bf39-e90ccdb0d5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:59:43 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [req-de8feab3-7917-4a4c-87d7-2df6a1dc7608 req-c69aef44-6d3c-438d-af24-1f38623b3c5e tempest-VolumesGetTestJSON-1322252351 None] Volume 43861bb6-3243-47a4-ab98-88dc02d4bd16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43861bb6-3243-47a4-ab98-88dc02d4bd16', 'volume_size': 1} Jun 24 04:59:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-de8feab3-7917-4a4c-87d7-2df6a1dc7608 req-c69aef44-6d3c-438d-af24-1f38623b3c5e tempest-VolumesGetTestJSON-1322252351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 04:59:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-de8feab3-7917-4a4c-87d7-2df6a1dc7608 req-c69aef44-6d3c-438d-af24-1f38623b3c5e tempest-VolumesGetTestJSON-1322252351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 04:59:43 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [req-de8feab3-7917-4a4c-87d7-2df6a1dc7608 req-c69aef44-6d3c-438d-af24-1f38623b3c5e tempest-VolumesGetTestJSON-1322252351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T02:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2034102431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43861bb6-3243-47a4-ab98-88dc02d4bd16,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8335c82f330f463b9c204dc5d5d511a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:59:44Z,use_quota=True,user_id='5c6cfd1a3599463c8f2a7dfb4a908b31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 04:59:43 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [req-de8feab3-7917-4a4c-87d7-2df6a1dc7608 req-c69aef44-6d3c-438d-af24-1f38623b3c5e tempest-VolumesGetTestJSON-1322252351 None] Creating volume 43861bb6-3243-47a4-ab98-88dc02d4bd16 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 04:59:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-de8feab3-7917-4a4c-87d7-2df6a1dc7608 req-c69aef44-6d3c-438d-af24-1f38623b3c5e tempest-VolumesGetTestJSON-1322252351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 04:59:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-de8feab3-7917-4a4c-87d7-2df6a1dc7608 req-c69aef44-6d3c-438d-af24-1f38623b3c5e tempest-VolumesGetTestJSON-1322252351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 04:59:43 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [req-de8feab3-7917-4a4c-87d7-2df6a1dc7608 req-c69aef44-6d3c-438d-af24-1f38623b3c5e tempest-VolumesGetTestJSON-1322252351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 04:59:43 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [req-de8feab3-7917-4a4c-87d7-2df6a1dc7608 req-c69aef44-6d3c-438d-af24-1f38623b3c5e tempest-VolumesGetTestJSON-1322252351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 04:59:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-de8feab3-7917-4a4c-87d7-2df6a1dc7608 req-c69aef44-6d3c-438d-af24-1f38623b3c5e tempest-VolumesGetTestJSON-1322252351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 04:59:43 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [req-de8feab3-7917-4a4c-87d7-2df6a1dc7608 req-c69aef44-6d3c-438d-af24-1f38623b3c5e tempest-VolumesGetTestJSON-1322252351 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 04:59:43 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [req-de8feab3-7917-4a4c-87d7-2df6a1dc7608 req-c69aef44-6d3c-438d-af24-1f38623b3c5e tempest-VolumesGetTestJSON-1322252351 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 04:59:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-de8feab3-7917-4a4c-87d7-2df6a1dc7608 req-c69aef44-6d3c-438d-af24-1f38623b3c5e tempest-VolumesGetTestJSON-1322252351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-43861bb6-3243-47a4-ab98-88dc02d4bd16 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:59:44 devstack sudo[96838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-43861bb6-3243-47a4-ab98-88dc02d4bd16 1073741824 Jun 24 04:59:44 devstack sudo[96838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:59:45 devstack sudo[96838]: pam_unix(sudo:session): session closed for user root Jun 24 04:59:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-de8feab3-7917-4a4c-87d7-2df6a1dc7608 req-c69aef44-6d3c-438d-af24-1f38623b3c5e tempest-VolumesGetTestJSON-1322252351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-43861bb6-3243-47a4-ab98-88dc02d4bd16 1073741824" returned: 0 in 1.017s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:59:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-de8feab3-7917-4a4c-87d7-2df6a1dc7608 req-c69aef44-6d3c-438d-af24-1f38623b3c5e tempest-VolumesGetTestJSON-1322252351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-43861bb6-3243-47a4-ab98-88dc02d4bd16 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:59:45 devstack sudo[96847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-43861bb6-3243-47a4-ab98-88dc02d4bd16 Jun 24 04:59:45 devstack sudo[96847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:59:45 devstack sudo[96847]: pam_unix(sudo:session): session closed for user root Jun 24 04:59:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-de8feab3-7917-4a4c-87d7-2df6a1dc7608 req-c69aef44-6d3c-438d-af24-1f38623b3c5e tempest-VolumesGetTestJSON-1322252351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-43861bb6-3243-47a4-ab98-88dc02d4bd16" returned: 0 in 0.713s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:59:45 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [req-de8feab3-7917-4a4c-87d7-2df6a1dc7608 req-c69aef44-6d3c-438d-af24-1f38623b3c5e tempest-VolumesGetTestJSON-1322252351 None] <== create_volume: return (1786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 04:59:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-de8feab3-7917-4a4c-87d7-2df6a1dc7608 req-c69aef44-6d3c-438d-af24-1f38623b3c5e tempest-VolumesGetTestJSON-1322252351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.788s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 04:59:45 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-de8feab3-7917-4a4c-87d7-2df6a1dc7608 req-c69aef44-6d3c-438d-af24-1f38623b3c5e tempest-VolumesGetTestJSON-1322252351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfa83e18-04ec-410e-bf39-e90ccdb0d5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43861bb6-3243-47a4-ab98-88dc02d4bd16', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 04:59:45 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-de8feab3-7917-4a4c-87d7-2df6a1dc7608 req-c69aef44-6d3c-438d-af24-1f38623b3c5e tempest-VolumesGetTestJSON-1322252351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d27cfdf-7499-46e2-8c80-e91c0c5c78f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:59:45 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [req-de8feab3-7917-4a4c-87d7-2df6a1dc7608 req-c69aef44-6d3c-438d-af24-1f38623b3c5e tempest-VolumesGetTestJSON-1322252351 None] Volume volume-43861bb6-3243-47a4-ab98-88dc02d4bd16 (43861bb6-3243-47a4-ab98-88dc02d4bd16): created successfully Jun 24 04:59:45 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-de8feab3-7917-4a4c-87d7-2df6a1dc7608 req-c69aef44-6d3c-438d-af24-1f38623b3c5e tempest-VolumesGetTestJSON-1322252351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d27cfdf-7499-46e2-8c80-e91c0c5c78f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 04:59:45 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-de8feab3-7917-4a4c-87d7-2df6a1dc7608 req-c69aef44-6d3c-438d-af24-1f38623b3c5e tempest-VolumesGetTestJSON-1322252351 None] Flow 'volume_create_manager' (521af98c-3b1c-46e2-b07d-7f1d72e31b42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 04:59:45 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-de8feab3-7917-4a4c-87d7-2df6a1dc7608 req-c69aef44-6d3c-438d-af24-1f38623b3c5e tempest-VolumesGetTestJSON-1322252351 None] Created volume successfully. Jun 24 04:59:47 devstack cinder-volume[93830]: DEBUG cinder.coordination [req-ba91e8d6-9e71-4b8b-b703-0a3838aa2e87 req-937ead37-af5a-4281-9791-d0732c4ce08e tempest-VolumesGetTestJSON-1322252351 None] Acquiring lock "cinder-43861bb6-3243-47a4-ab98-88dc02d4bd16-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 04:59:47 devstack cinder-volume[93830]: DEBUG cinder.coordination [req-ba91e8d6-9e71-4b8b-b703-0a3838aa2e87 req-937ead37-af5a-4281-9791-d0732c4ce08e tempest-VolumesGetTestJSON-1322252351 None] Lock "cinder-43861bb6-3243-47a4-ab98-88dc02d4bd16-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 04:59:47 devstack cinder-volume[93830]: DEBUG cinder.coordination [req-ba91e8d6-9e71-4b8b-b703-0a3838aa2e87 req-937ead37-af5a-4281-9791-d0732c4ce08e tempest-VolumesGetTestJSON-1322252351 None] Acquiring lock "cinder-quobyte-43861bb6-3243-47a4-ab98-88dc02d4bd16" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 04:59:47 devstack cinder-volume[93830]: DEBUG cinder.coordination [req-ba91e8d6-9e71-4b8b-b703-0a3838aa2e87 req-937ead37-af5a-4281-9791-d0732c4ce08e tempest-VolumesGetTestJSON-1322252351 None] Lock "cinder-quobyte-43861bb6-3243-47a4-ab98-88dc02d4bd16" acquired by "delete_volume" :: waited 0.025s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 04:59:47 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad58bcde-d87b-4dd8-b259-66838d0b1ad0]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 04:59:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-ba91e8d6-9e71-4b8b-b703-0a3838aa2e87 req-937ead37-af5a-4281-9791-d0732c4ce08e tempest-VolumesGetTestJSON-1322252351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-43861bb6-3243-47a4-ab98-88dc02d4bd16 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:59:47 devstack sudo[96883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-43861bb6-3243-47a4-ab98-88dc02d4bd16 Jun 24 04:59:47 devstack sudo[96883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:59:48 devstack sudo[96883]: pam_unix(sudo:session): session closed for user root Jun 24 04:59:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-ba91e8d6-9e71-4b8b-b703-0a3838aa2e87 req-937ead37-af5a-4281-9791-d0732c4ce08e tempest-VolumesGetTestJSON-1322252351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-43861bb6-3243-47a4-ab98-88dc02d4bd16" returned: 0 in 1.733s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:59:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-ba91e8d6-9e71-4b8b-b703-0a3838aa2e87 req-937ead37-af5a-4281-9791-d0732c4ce08e tempest-VolumesGetTestJSON-1322252351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-43861bb6-3243-47a4-ab98-88dc02d4bd16 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:59:48 devstack sudo[96947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-43861bb6-3243-47a4-ab98-88dc02d4bd16 Jun 24 04:59:48 devstack sudo[96947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:59:50 devstack sudo[96947]: pam_unix(sudo:session): session closed for user root Jun 24 04:59:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-ba91e8d6-9e71-4b8b-b703-0a3838aa2e87 req-937ead37-af5a-4281-9791-d0732c4ce08e tempest-VolumesGetTestJSON-1322252351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-43861bb6-3243-47a4-ab98-88dc02d4bd16" returned: 0 in 1.176s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:59:50 devstack cinder-volume[93830]: DEBUG cinder.coordination [req-ba91e8d6-9e71-4b8b-b703-0a3838aa2e87 req-937ead37-af5a-4281-9791-d0732c4ce08e tempest-VolumesGetTestJSON-1322252351 None] Lock "cinder-quobyte-43861bb6-3243-47a4-ab98-88dc02d4bd16" released by "delete_volume" :: held 3.046s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 04:59:50 devstack cinder-volume[93830]: DEBUG cinder.quota [req-ba91e8d6-9e71-4b8b-b703-0a3838aa2e87 req-937ead37-af5a-4281-9791-d0732c4ce08e tempest-VolumesGetTestJSON-1322252351 None] Created reservations ['4f0ac43c-c941-4f9f-8df9-f353b9e087a6', '9ec48bab-b5cc-488f-9e07-307490bba255', '915dec83-6f64-4c8e-8fd6-beb90dd9d5e2', '645fdb87-d29c-4fc9-942c-31f9922719ed'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 04:59:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-ba91e8d6-9e71-4b8b-b703-0a3838aa2e87 req-937ead37-af5a-4281-9791-d0732c4ce08e tempest-VolumesGetTestJSON-1322252351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 04:59:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-ba91e8d6-9e71-4b8b-b703-0a3838aa2e87 req-937ead37-af5a-4281-9791-d0732c4ce08e tempest-VolumesGetTestJSON-1322252351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 04:59:50 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [req-ba91e8d6-9e71-4b8b-b703-0a3838aa2e87 req-937ead37-af5a-4281-9791-d0732c4ce08e tempest-VolumesGetTestJSON-1322252351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 04:59:50 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [req-ba91e8d6-9e71-4b8b-b703-0a3838aa2e87 req-937ead37-af5a-4281-9791-d0732c4ce08e tempest-VolumesGetTestJSON-1322252351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 04:59:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-ba91e8d6-9e71-4b8b-b703-0a3838aa2e87 req-937ead37-af5a-4281-9791-d0732c4ce08e tempest-VolumesGetTestJSON-1322252351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 04:59:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-ba91e8d6-9e71-4b8b-b703-0a3838aa2e87 req-937ead37-af5a-4281-9791-d0732c4ce08e tempest-VolumesGetTestJSON-1322252351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:59:50 devstack sudo[96965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 04:59:50 devstack sudo[96965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:59:51 devstack sudo[96965]: pam_unix(sudo:session): session closed for user root Jun 24 04:59:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-ba91e8d6-9e71-4b8b-b703-0a3838aa2e87 req-937ead37-af5a-4281-9791-d0732c4ce08e tempest-VolumesGetTestJSON-1322252351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 1.186s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:59:51 devstack cinder-volume[93830]: DEBUG cinder.manager [req-ba91e8d6-9e71-4b8b-b703-0a3838aa2e87 req-937ead37-af5a-4281-9791-d0732c4ce08e tempest-VolumesGetTestJSON-1322252351 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 04:59:51 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-ba91e8d6-9e71-4b8b-b703-0a3838aa2e87 req-937ead37-af5a-4281-9791-d0732c4ce08e tempest-VolumesGetTestJSON-1322252351 None] Deleted volume successfully. Jun 24 04:59:51 devstack cinder-volume[93830]: DEBUG cinder.coordination [req-ba91e8d6-9e71-4b8b-b703-0a3838aa2e87 req-937ead37-af5a-4281-9791-d0732c4ce08e tempest-VolumesGetTestJSON-1322252351 None] Lock "cinder-43861bb6-3243-47a4-ab98-88dc02d4bd16-delete_volume" released by "delete_volume" :: held 4.591s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 04:59:58 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-97317d67-9196-41c0-8b00-f1118fd464ed tempest-VolumesTestJSON-1105090006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 04:59:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-97317d67-9196-41c0-8b00-f1118fd464ed tempest-VolumesTestJSON-1105090006 None] Flow 'volume_create_manager' (0e9792c6-715f-4c3a-bb37-7455d90c73f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 04:59:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-97317d67-9196-41c0-8b00-f1118fd464ed tempest-VolumesTestJSON-1105090006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8b48d91-3f0e-4481-85f3-87921d43f825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:59:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-97317d67-9196-41c0-8b00-f1118fd464ed tempest-VolumesTestJSON-1105090006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8b48d91-3f0e-4481-85f3-87921d43f825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T02:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-739318511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=512ec64f-0c27-441b-972f-adb4dc41c62a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4c0794bbcf8b4538b2b4cc9c92fbacf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:59:58Z,use_quota=True,user_id='d3eccdfeeb8642c2b17756b2934e0aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 04:59:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-97317d67-9196-41c0-8b00-f1118fd464ed tempest-VolumesTestJSON-1105090006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f4f40cf-4749-4338-aa45-a983ee723f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:59:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-97317d67-9196-41c0-8b00-f1118fd464ed tempest-VolumesTestJSON-1105090006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f4f40cf-4749-4338-aa45-a983ee723f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 04:59:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-97317d67-9196-41c0-8b00-f1118fd464ed tempest-VolumesTestJSON-1105090006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd6a4ac9-a08a-4702-ab49-fae621438c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:59:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-97317d67-9196-41c0-8b00-f1118fd464ed tempest-VolumesTestJSON-1105090006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd6a4ac9-a08a-4702-ab49-fae621438c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '512ec64f-0c27-441b-972f-adb4dc41c62a', 'volume_name': 'volume-512ec64f-0c27-441b-972f-adb4dc41c62a', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 04:59:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-97317d67-9196-41c0-8b00-f1118fd464ed tempest-VolumesTestJSON-1105090006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8089b7de-e242-4cf0-b23d-ee86156fdc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:59:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-97317d67-9196-41c0-8b00-f1118fd464ed tempest-VolumesTestJSON-1105090006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8089b7de-e242-4cf0-b23d-ee86156fdc94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 04:59:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-97317d67-9196-41c0-8b00-f1118fd464ed tempest-VolumesTestJSON-1105090006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d10478e8-44a7-4b6d-9341-0a24570f7487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 04:59:58 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-97317d67-9196-41c0-8b00-f1118fd464ed tempest-VolumesTestJSON-1105090006 None] Volume 512ec64f-0c27-441b-972f-adb4dc41c62a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-512ec64f-0c27-441b-972f-adb4dc41c62a', 'volume_size': 1} Jun 24 04:59:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-97317d67-9196-41c0-8b00-f1118fd464ed tempest-VolumesTestJSON-1105090006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 04:59:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-97317d67-9196-41c0-8b00-f1118fd464ed tempest-VolumesTestJSON-1105090006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 04:59:58 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-97317d67-9196-41c0-8b00-f1118fd464ed tempest-VolumesTestJSON-1105090006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T02:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-739318511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=512ec64f-0c27-441b-972f-adb4dc41c62a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4c0794bbcf8b4538b2b4cc9c92fbacf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T02:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T02:59:58Z,use_quota=True,user_id='d3eccdfeeb8642c2b17756b2934e0aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 04:59:58 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-97317d67-9196-41c0-8b00-f1118fd464ed tempest-VolumesTestJSON-1105090006 None] Creating volume 512ec64f-0c27-441b-972f-adb4dc41c62a {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 04:59:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-97317d67-9196-41c0-8b00-f1118fd464ed tempest-VolumesTestJSON-1105090006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 04:59:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-97317d67-9196-41c0-8b00-f1118fd464ed tempest-VolumesTestJSON-1105090006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 04:59:58 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-97317d67-9196-41c0-8b00-f1118fd464ed tempest-VolumesTestJSON-1105090006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 04:59:58 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-97317d67-9196-41c0-8b00-f1118fd464ed tempest-VolumesTestJSON-1105090006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 04:59:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-97317d67-9196-41c0-8b00-f1118fd464ed tempest-VolumesTestJSON-1105090006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 04:59:58 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-97317d67-9196-41c0-8b00-f1118fd464ed tempest-VolumesTestJSON-1105090006 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 04:59:58 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-97317d67-9196-41c0-8b00-f1118fd464ed tempest-VolumesTestJSON-1105090006 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 04:59:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-97317d67-9196-41c0-8b00-f1118fd464ed tempest-VolumesTestJSON-1105090006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-512ec64f-0c27-441b-972f-adb4dc41c62a 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:59:58 devstack sudo[97004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-512ec64f-0c27-441b-972f-adb4dc41c62a 1073741824 Jun 24 04:59:58 devstack sudo[97004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 04:59:59 devstack sudo[97004]: pam_unix(sudo:session): session closed for user root Jun 24 04:59:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-97317d67-9196-41c0-8b00-f1118fd464ed tempest-VolumesTestJSON-1105090006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-512ec64f-0c27-441b-972f-adb4dc41c62a 1073741824" returned: 0 in 1.133s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 04:59:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-97317d67-9196-41c0-8b00-f1118fd464ed tempest-VolumesTestJSON-1105090006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-512ec64f-0c27-441b-972f-adb4dc41c62a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 04:59:59 devstack sudo[97064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-512ec64f-0c27-441b-972f-adb4dc41c62a Jun 24 04:59:59 devstack sudo[97064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:00:00 devstack sudo[97064]: pam_unix(sudo:session): session closed for user root Jun 24 05:00:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-97317d67-9196-41c0-8b00-f1118fd464ed tempest-VolumesTestJSON-1105090006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-512ec64f-0c27-441b-972f-adb4dc41c62a" returned: 0 in 1.429s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:00:00 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-97317d67-9196-41c0-8b00-f1118fd464ed tempest-VolumesTestJSON-1105090006 None] <== create_volume: return (2639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:00:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-97317d67-9196-41c0-8b00-f1118fd464ed tempest-VolumesTestJSON-1105090006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.642s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:00:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-97317d67-9196-41c0-8b00-f1118fd464ed tempest-VolumesTestJSON-1105090006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d10478e8-44a7-4b6d-9341-0a24570f7487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-512ec64f-0c27-441b-972f-adb4dc41c62a', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:00:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-97317d67-9196-41c0-8b00-f1118fd464ed tempest-VolumesTestJSON-1105090006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9459fd8-313a-4f23-a090-d1ec6db8bb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:00:01 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-97317d67-9196-41c0-8b00-f1118fd464ed tempest-VolumesTestJSON-1105090006 None] Volume volume-512ec64f-0c27-441b-972f-adb4dc41c62a (512ec64f-0c27-441b-972f-adb4dc41c62a): created successfully Jun 24 05:00:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-97317d67-9196-41c0-8b00-f1118fd464ed tempest-VolumesTestJSON-1105090006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9459fd8-313a-4f23-a090-d1ec6db8bb9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:00:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-97317d67-9196-41c0-8b00-f1118fd464ed tempest-VolumesTestJSON-1105090006 None] Flow 'volume_create_manager' (0e9792c6-715f-4c3a-bb37-7455d90c73f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:00:01 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-97317d67-9196-41c0-8b00-f1118fd464ed tempest-VolumesTestJSON-1105090006 None] Created volume successfully. Jun 24 05:00:03 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-27043377-7e4d-4a49-8b2d-6bb7e1c55cf4 tempest-VolumesTestJSON-1105090006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:00:03 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-27043377-7e4d-4a49-8b2d-6bb7e1c55cf4 tempest-VolumesTestJSON-1105090006 None] Flow 'volume_create_manager' (8ba6be3c-3cdd-4343-b995-c8495c9e9de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:00:03 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-27043377-7e4d-4a49-8b2d-6bb7e1c55cf4 tempest-VolumesTestJSON-1105090006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (999e03c2-ccf2-4d39-b7fb-ded2993f3b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:00:03 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-27043377-7e4d-4a49-8b2d-6bb7e1c55cf4 tempest-VolumesTestJSON-1105090006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (999e03c2-ccf2-4d39-b7fb-ded2993f3b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-956686516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22402eb7-f3fa-41cb-9b58-96fa9f4aa3f4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4c0794bbcf8b4538b2b4cc9c92fbacf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:00:03Z,use_quota=True,user_id='d3eccdfeeb8642c2b17756b2934e0aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:00:03 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-27043377-7e4d-4a49-8b2d-6bb7e1c55cf4 tempest-VolumesTestJSON-1105090006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b650abdf-87ec-4366-9ff3-44dcbb98faa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:00:03 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-27043377-7e4d-4a49-8b2d-6bb7e1c55cf4 tempest-VolumesTestJSON-1105090006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b650abdf-87ec-4366-9ff3-44dcbb98faa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:00:03 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-27043377-7e4d-4a49-8b2d-6bb7e1c55cf4 tempest-VolumesTestJSON-1105090006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (606042c0-86cf-4c13-bc2a-afe83430a7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:00:03 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-27043377-7e4d-4a49-8b2d-6bb7e1c55cf4 tempest-VolumesTestJSON-1105090006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (606042c0-86cf-4c13-bc2a-afe83430a7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22402eb7-f3fa-41cb-9b58-96fa9f4aa3f4', 'volume_name': 'volume-22402eb7-f3fa-41cb-9b58-96fa9f4aa3f4', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:00:03 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-27043377-7e4d-4a49-8b2d-6bb7e1c55cf4 tempest-VolumesTestJSON-1105090006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7700004a-9c58-415c-8f58-f3b14c0a9924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:00:03 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-27043377-7e4d-4a49-8b2d-6bb7e1c55cf4 tempest-VolumesTestJSON-1105090006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7700004a-9c58-415c-8f58-f3b14c0a9924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:00:03 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-27043377-7e4d-4a49-8b2d-6bb7e1c55cf4 tempest-VolumesTestJSON-1105090006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c119e841-d67b-4e9a-868b-b5c816f6f7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:00:03 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-27043377-7e4d-4a49-8b2d-6bb7e1c55cf4 tempest-VolumesTestJSON-1105090006 None] Volume 22402eb7-f3fa-41cb-9b58-96fa9f4aa3f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22402eb7-f3fa-41cb-9b58-96fa9f4aa3f4', 'volume_size': 1} Jun 24 05:00:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-27043377-7e4d-4a49-8b2d-6bb7e1c55cf4 tempest-VolumesTestJSON-1105090006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:00:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-27043377-7e4d-4a49-8b2d-6bb7e1c55cf4 tempest-VolumesTestJSON-1105090006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:00:03 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-27043377-7e4d-4a49-8b2d-6bb7e1c55cf4 tempest-VolumesTestJSON-1105090006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-956686516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22402eb7-f3fa-41cb-9b58-96fa9f4aa3f4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4c0794bbcf8b4538b2b4cc9c92fbacf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:00:03Z,use_quota=True,user_id='d3eccdfeeb8642c2b17756b2934e0aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:00:03 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-27043377-7e4d-4a49-8b2d-6bb7e1c55cf4 tempest-VolumesTestJSON-1105090006 None] Creating volume 22402eb7-f3fa-41cb-9b58-96fa9f4aa3f4 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:00:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-27043377-7e4d-4a49-8b2d-6bb7e1c55cf4 tempest-VolumesTestJSON-1105090006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:00:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-27043377-7e4d-4a49-8b2d-6bb7e1c55cf4 tempest-VolumesTestJSON-1105090006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:00:03 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-27043377-7e4d-4a49-8b2d-6bb7e1c55cf4 tempest-VolumesTestJSON-1105090006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:00:03 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-27043377-7e4d-4a49-8b2d-6bb7e1c55cf4 tempest-VolumesTestJSON-1105090006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:00:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-27043377-7e4d-4a49-8b2d-6bb7e1c55cf4 tempest-VolumesTestJSON-1105090006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:00:03 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-27043377-7e4d-4a49-8b2d-6bb7e1c55cf4 tempest-VolumesTestJSON-1105090006 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:00:03 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-27043377-7e4d-4a49-8b2d-6bb7e1c55cf4 tempest-VolumesTestJSON-1105090006 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:00:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-27043377-7e4d-4a49-8b2d-6bb7e1c55cf4 tempest-VolumesTestJSON-1105090006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-22402eb7-f3fa-41cb-9b58-96fa9f4aa3f4 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:00:03 devstack sudo[97232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-22402eb7-f3fa-41cb-9b58-96fa9f4aa3f4 1073741824 Jun 24 05:00:03 devstack sudo[97232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:00:04 devstack sudo[97232]: pam_unix(sudo:session): session closed for user root Jun 24 05:00:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-27043377-7e4d-4a49-8b2d-6bb7e1c55cf4 tempest-VolumesTestJSON-1105090006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-22402eb7-f3fa-41cb-9b58-96fa9f4aa3f4 1073741824" returned: 0 in 1.177s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:00:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-27043377-7e4d-4a49-8b2d-6bb7e1c55cf4 tempest-VolumesTestJSON-1105090006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-22402eb7-f3fa-41cb-9b58-96fa9f4aa3f4 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:00:04 devstack sudo[97243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-22402eb7-f3fa-41cb-9b58-96fa9f4aa3f4 Jun 24 05:00:04 devstack sudo[97243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:00:05 devstack sudo[97243]: pam_unix(sudo:session): session closed for user root Jun 24 05:00:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-27043377-7e4d-4a49-8b2d-6bb7e1c55cf4 tempest-VolumesTestJSON-1105090006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-22402eb7-f3fa-41cb-9b58-96fa9f4aa3f4" returned: 0 in 0.912s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:00:05 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-27043377-7e4d-4a49-8b2d-6bb7e1c55cf4 tempest-VolumesTestJSON-1105090006 None] <== create_volume: return (2176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:00:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-27043377-7e4d-4a49-8b2d-6bb7e1c55cf4 tempest-VolumesTestJSON-1105090006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.184s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:00:05 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-27043377-7e4d-4a49-8b2d-6bb7e1c55cf4 tempest-VolumesTestJSON-1105090006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c119e841-d67b-4e9a-868b-b5c816f6f7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22402eb7-f3fa-41cb-9b58-96fa9f4aa3f4', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:00:05 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-27043377-7e4d-4a49-8b2d-6bb7e1c55cf4 tempest-VolumesTestJSON-1105090006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a400b0c4-feea-4a3f-a50b-f088ddeb9a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:00:05 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-27043377-7e4d-4a49-8b2d-6bb7e1c55cf4 tempest-VolumesTestJSON-1105090006 None] Volume volume-22402eb7-f3fa-41cb-9b58-96fa9f4aa3f4 (22402eb7-f3fa-41cb-9b58-96fa9f4aa3f4): created successfully Jun 24 05:00:05 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-27043377-7e4d-4a49-8b2d-6bb7e1c55cf4 tempest-VolumesTestJSON-1105090006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a400b0c4-feea-4a3f-a50b-f088ddeb9a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:00:05 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-27043377-7e4d-4a49-8b2d-6bb7e1c55cf4 tempest-VolumesTestJSON-1105090006 None] Flow 'volume_create_manager' (8ba6be3c-3cdd-4343-b995-c8495c9e9de0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:00:05 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-27043377-7e4d-4a49-8b2d-6bb7e1c55cf4 tempest-VolumesTestJSON-1105090006 None] Created volume successfully. Jun 24 05:00:07 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-918adee6-81db-4c0f-8eb6-6cba54e48700 tempest-VolumesTestJSON-1105090006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:00:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-918adee6-81db-4c0f-8eb6-6cba54e48700 tempest-VolumesTestJSON-1105090006 None] Flow 'volume_create_manager' (cc3e8ef3-211f-498c-bddc-bd370fbdafdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:00:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-918adee6-81db-4c0f-8eb6-6cba54e48700 tempest-VolumesTestJSON-1105090006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4076f3cc-3939-453a-90af-daf58eaa1d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:00:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-918adee6-81db-4c0f-8eb6-6cba54e48700 tempest-VolumesTestJSON-1105090006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4076f3cc-3939-453a-90af-daf58eaa1d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1635782812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea94f034-0f9c-48cd-8c1c-e276f56f4ade,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4c0794bbcf8b4538b2b4cc9c92fbacf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:00:07Z,use_quota=True,user_id='d3eccdfeeb8642c2b17756b2934e0aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:00:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-918adee6-81db-4c0f-8eb6-6cba54e48700 tempest-VolumesTestJSON-1105090006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd55800f-d886-49c7-a79b-01370a524b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:00:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-918adee6-81db-4c0f-8eb6-6cba54e48700 tempest-VolumesTestJSON-1105090006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd55800f-d886-49c7-a79b-01370a524b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:00:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-918adee6-81db-4c0f-8eb6-6cba54e48700 tempest-VolumesTestJSON-1105090006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f19c6217-7852-4b4e-9684-6f8e829bfcaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:00:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-918adee6-81db-4c0f-8eb6-6cba54e48700 tempest-VolumesTestJSON-1105090006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f19c6217-7852-4b4e-9684-6f8e829bfcaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea94f034-0f9c-48cd-8c1c-e276f56f4ade', 'volume_name': 'volume-ea94f034-0f9c-48cd-8c1c-e276f56f4ade', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:00:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-918adee6-81db-4c0f-8eb6-6cba54e48700 tempest-VolumesTestJSON-1105090006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f02511-a7ad-4a60-857c-c0138b20a08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:00:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-918adee6-81db-4c0f-8eb6-6cba54e48700 tempest-VolumesTestJSON-1105090006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f02511-a7ad-4a60-857c-c0138b20a08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:00:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-918adee6-81db-4c0f-8eb6-6cba54e48700 tempest-VolumesTestJSON-1105090006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f57b756c-f1ea-4072-a632-7138c350f6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:00:07 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-918adee6-81db-4c0f-8eb6-6cba54e48700 tempest-VolumesTestJSON-1105090006 None] Volume ea94f034-0f9c-48cd-8c1c-e276f56f4ade: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea94f034-0f9c-48cd-8c1c-e276f56f4ade', 'volume_size': 1} Jun 24 05:00:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-918adee6-81db-4c0f-8eb6-6cba54e48700 tempest-VolumesTestJSON-1105090006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:00:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-918adee6-81db-4c0f-8eb6-6cba54e48700 tempest-VolumesTestJSON-1105090006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:00:07 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-918adee6-81db-4c0f-8eb6-6cba54e48700 tempest-VolumesTestJSON-1105090006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1635782812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea94f034-0f9c-48cd-8c1c-e276f56f4ade,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4c0794bbcf8b4538b2b4cc9c92fbacf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:00:07Z,use_quota=True,user_id='d3eccdfeeb8642c2b17756b2934e0aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:00:07 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-918adee6-81db-4c0f-8eb6-6cba54e48700 tempest-VolumesTestJSON-1105090006 None] Creating volume ea94f034-0f9c-48cd-8c1c-e276f56f4ade {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:00:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-918adee6-81db-4c0f-8eb6-6cba54e48700 tempest-VolumesTestJSON-1105090006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:00:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-918adee6-81db-4c0f-8eb6-6cba54e48700 tempest-VolumesTestJSON-1105090006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:00:07 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-918adee6-81db-4c0f-8eb6-6cba54e48700 tempest-VolumesTestJSON-1105090006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:00:07 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-918adee6-81db-4c0f-8eb6-6cba54e48700 tempest-VolumesTestJSON-1105090006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:00:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-918adee6-81db-4c0f-8eb6-6cba54e48700 tempest-VolumesTestJSON-1105090006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:00:07 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-918adee6-81db-4c0f-8eb6-6cba54e48700 tempest-VolumesTestJSON-1105090006 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:00:07 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-918adee6-81db-4c0f-8eb6-6cba54e48700 tempest-VolumesTestJSON-1105090006 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:00:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-918adee6-81db-4c0f-8eb6-6cba54e48700 tempest-VolumesTestJSON-1105090006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ea94f034-0f9c-48cd-8c1c-e276f56f4ade 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:00:07 devstack sudo[97251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ea94f034-0f9c-48cd-8c1c-e276f56f4ade 1073741824 Jun 24 05:00:07 devstack sudo[97251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:00:08 devstack sudo[97251]: pam_unix(sudo:session): session closed for user root Jun 24 05:00:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-918adee6-81db-4c0f-8eb6-6cba54e48700 tempest-VolumesTestJSON-1105090006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ea94f034-0f9c-48cd-8c1c-e276f56f4ade 1073741824" returned: 0 in 1.234s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:00:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-918adee6-81db-4c0f-8eb6-6cba54e48700 tempest-VolumesTestJSON-1105090006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ea94f034-0f9c-48cd-8c1c-e276f56f4ade {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:00:08 devstack sudo[97259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ea94f034-0f9c-48cd-8c1c-e276f56f4ade Jun 24 05:00:08 devstack sudo[97259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:00:09 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 05:00:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:00:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:00:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:00:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:00:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:00:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:00:09 devstack sudo[97259]: pam_unix(sudo:session): session closed for user root Jun 24 05:00:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-918adee6-81db-4c0f-8eb6-6cba54e48700 tempest-VolumesTestJSON-1105090006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ea94f034-0f9c-48cd-8c1c-e276f56f4ade" returned: 0 in 0.878s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:00:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-918adee6-81db-4c0f-8eb6-6cba54e48700 tempest-VolumesTestJSON-1105090006 None] <== create_volume: return (2155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:00:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-918adee6-81db-4c0f-8eb6-6cba54e48700 tempest-VolumesTestJSON-1105090006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.158s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:00:09 devstack sudo[97263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:00:09 devstack sudo[97263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:00:09 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-918adee6-81db-4c0f-8eb6-6cba54e48700 tempest-VolumesTestJSON-1105090006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f57b756c-f1ea-4072-a632-7138c350f6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea94f034-0f9c-48cd-8c1c-e276f56f4ade', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:00:09 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-918adee6-81db-4c0f-8eb6-6cba54e48700 tempest-VolumesTestJSON-1105090006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88292933-3184-410a-9edd-b93981dae1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:00:09 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-918adee6-81db-4c0f-8eb6-6cba54e48700 tempest-VolumesTestJSON-1105090006 None] Volume volume-ea94f034-0f9c-48cd-8c1c-e276f56f4ade (ea94f034-0f9c-48cd-8c1c-e276f56f4ade): created successfully Jun 24 05:00:09 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-918adee6-81db-4c0f-8eb6-6cba54e48700 tempest-VolumesTestJSON-1105090006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88292933-3184-410a-9edd-b93981dae1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:00:09 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-918adee6-81db-4c0f-8eb6-6cba54e48700 tempest-VolumesTestJSON-1105090006 None] Flow 'volume_create_manager' (cc3e8ef3-211f-498c-bddc-bd370fbdafdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:00:09 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-918adee6-81db-4c0f-8eb6-6cba54e48700 tempest-VolumesTestJSON-1105090006 None] Created volume successfully. Jun 24 05:00:10 devstack sudo[97263]: pam_unix(sudo:session): session closed for user root Jun 24 05:00:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.845s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:00:10 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:00:10 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager._thread_info {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 05:00:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread count: 8 {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 05:00:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread info: [<_MainThread(MainThread, started 130211312517248)>, , , , , , , ] {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 05:00:11 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-bdba4023-443c-48d7-b10c-33b45c460328 tempest-VolumesTestJSON-1105090006 None] Acquiring lock "cinder-ea94f034-0f9c-48cd-8c1c-e276f56f4ade-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:00:11 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-bdba4023-443c-48d7-b10c-33b45c460328 tempest-VolumesTestJSON-1105090006 None] Lock "cinder-ea94f034-0f9c-48cd-8c1c-e276f56f4ade-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:00:11 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-bdba4023-443c-48d7-b10c-33b45c460328 tempest-VolumesTestJSON-1105090006 None] Acquiring lock "cinder-quobyte-ea94f034-0f9c-48cd-8c1c-e276f56f4ade" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:00:12 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-bdba4023-443c-48d7-b10c-33b45c460328 tempest-VolumesTestJSON-1105090006 None] Lock "cinder-quobyte-ea94f034-0f9c-48cd-8c1c-e276f56f4ade" acquired by "delete_volume" :: waited 0.028s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:00:12 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[983c5f4f-05ed-4ebc-8387-ed0c6ff5b5e2]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:00:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-bdba4023-443c-48d7-b10c-33b45c460328 tempest-VolumesTestJSON-1105090006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ea94f034-0f9c-48cd-8c1c-e276f56f4ade {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:00:12 devstack sudo[97266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ea94f034-0f9c-48cd-8c1c-e276f56f4ade Jun 24 05:00:12 devstack sudo[97266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:00:12 devstack sudo[97266]: pam_unix(sudo:session): session closed for user root Jun 24 05:00:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-bdba4023-443c-48d7-b10c-33b45c460328 tempest-VolumesTestJSON-1105090006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ea94f034-0f9c-48cd-8c1c-e276f56f4ade" returned: 0 in 0.792s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:00:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-bdba4023-443c-48d7-b10c-33b45c460328 tempest-VolumesTestJSON-1105090006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ea94f034-0f9c-48cd-8c1c-e276f56f4ade {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:00:12 devstack sudo[97272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ea94f034-0f9c-48cd-8c1c-e276f56f4ade Jun 24 05:00:12 devstack sudo[97272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:00:13 devstack sudo[97272]: pam_unix(sudo:session): session closed for user root Jun 24 05:00:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-bdba4023-443c-48d7-b10c-33b45c460328 tempest-VolumesTestJSON-1105090006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ea94f034-0f9c-48cd-8c1c-e276f56f4ade" returned: 0 in 0.647s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:00:13 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-bdba4023-443c-48d7-b10c-33b45c460328 tempest-VolumesTestJSON-1105090006 None] Lock "cinder-quobyte-ea94f034-0f9c-48cd-8c1c-e276f56f4ade" released by "delete_volume" :: held 1.508s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:00:13 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-bdba4023-443c-48d7-b10c-33b45c460328 tempest-VolumesTestJSON-1105090006 None] Created reservations ['dd0d5cc5-ee93-4f00-834b-470b44ac660e', '2ec61f02-f4f0-46c7-8071-51bc07d8d1a7', '404acf70-a2f8-4548-a18b-182b1fd6ed76', '94894c1b-8a4f-4371-b1e1-1663bc45d901'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:00:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-bdba4023-443c-48d7-b10c-33b45c460328 tempest-VolumesTestJSON-1105090006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:00:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-bdba4023-443c-48d7-b10c-33b45c460328 tempest-VolumesTestJSON-1105090006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:00:13 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-bdba4023-443c-48d7-b10c-33b45c460328 tempest-VolumesTestJSON-1105090006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:00:13 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-bdba4023-443c-48d7-b10c-33b45c460328 tempest-VolumesTestJSON-1105090006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:00:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-bdba4023-443c-48d7-b10c-33b45c460328 tempest-VolumesTestJSON-1105090006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:00:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-bdba4023-443c-48d7-b10c-33b45c460328 tempest-VolumesTestJSON-1105090006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:00:13 devstack sudo[97275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:00:13 devstack sudo[97275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:00:14 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-dbc9a058-045e-4158-8e69-5676535ac114 tempest-VolumesTestJSON-1105090006 None] Acquiring lock "cinder-22402eb7-f3fa-41cb-9b58-96fa9f4aa3f4-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:00:14 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-dbc9a058-045e-4158-8e69-5676535ac114 tempest-VolumesTestJSON-1105090006 None] Lock "cinder-22402eb7-f3fa-41cb-9b58-96fa9f4aa3f4-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:00:14 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-dbc9a058-045e-4158-8e69-5676535ac114 tempest-VolumesTestJSON-1105090006 None] Acquiring lock "cinder-quobyte-22402eb7-f3fa-41cb-9b58-96fa9f4aa3f4" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:00:14 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-dbc9a058-045e-4158-8e69-5676535ac114 tempest-VolumesTestJSON-1105090006 None] Lock "cinder-quobyte-22402eb7-f3fa-41cb-9b58-96fa9f4aa3f4" acquired by "delete_volume" :: waited 0.023s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:00:14 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb35ec73-762d-4a1a-9d2d-ad006259627f]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:00:14 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dbc9a058-045e-4158-8e69-5676535ac114 tempest-VolumesTestJSON-1105090006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-22402eb7-f3fa-41cb-9b58-96fa9f4aa3f4 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:00:14 devstack sudo[97275]: pam_unix(sudo:session): session closed for user root Jun 24 05:00:14 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-bdba4023-443c-48d7-b10c-33b45c460328 tempest-VolumesTestJSON-1105090006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.822s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:00:14 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-bdba4023-443c-48d7-b10c-33b45c460328 tempest-VolumesTestJSON-1105090006 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:00:14 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-bdba4023-443c-48d7-b10c-33b45c460328 tempest-VolumesTestJSON-1105090006 None] Deleted volume successfully. Jun 24 05:00:14 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-bdba4023-443c-48d7-b10c-33b45c460328 tempest-VolumesTestJSON-1105090006 None] Lock "cinder-ea94f034-0f9c-48cd-8c1c-e276f56f4ade-delete_volume" released by "delete_volume" :: held 2.590s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:00:14 devstack sudo[97278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-22402eb7-f3fa-41cb-9b58-96fa9f4aa3f4 Jun 24 05:00:14 devstack sudo[97278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:00:15 devstack sudo[97278]: pam_unix(sudo:session): session closed for user root Jun 24 05:00:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dbc9a058-045e-4158-8e69-5676535ac114 tempest-VolumesTestJSON-1105090006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-22402eb7-f3fa-41cb-9b58-96fa9f4aa3f4" returned: 0 in 0.861s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:00:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dbc9a058-045e-4158-8e69-5676535ac114 tempest-VolumesTestJSON-1105090006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-22402eb7-f3fa-41cb-9b58-96fa9f4aa3f4 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:00:15 devstack sudo[97313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-22402eb7-f3fa-41cb-9b58-96fa9f4aa3f4 Jun 24 05:00:15 devstack sudo[97313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:00:15 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-f85cc7ad-e7c9-44ee-a5b6-1534f6e3ba7a tempest-AttachVolumeShelveTestJSON-1590289362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:00:15 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f85cc7ad-e7c9-44ee-a5b6-1534f6e3ba7a tempest-AttachVolumeShelveTestJSON-1590289362 None] Flow 'volume_create_manager' (82d33481-6efe-401e-afa5-14473715a8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:00:15 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f85cc7ad-e7c9-44ee-a5b6-1534f6e3ba7a tempest-AttachVolumeShelveTestJSON-1590289362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93c12744-100b-4de3-b146-7acc2b28e7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:00:16 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f85cc7ad-e7c9-44ee-a5b6-1534f6e3ba7a tempest-AttachVolumeShelveTestJSON-1590289362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93c12744-100b-4de3-b146-7acc2b28e7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:00:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-771674218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5312a76-36b2-4de5-9efd-0c6e39849629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa134f7e2bfc494087f6afa0282efdea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:00:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:00:16Z,use_quota=True,user_id='1cd4427ec8fe4c32a07f9ecc1b6d5283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:00:16 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f85cc7ad-e7c9-44ee-a5b6-1534f6e3ba7a tempest-AttachVolumeShelveTestJSON-1590289362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46a32cab-7405-41b2-ba48-05c212d1c168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:00:16 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f85cc7ad-e7c9-44ee-a5b6-1534f6e3ba7a tempest-AttachVolumeShelveTestJSON-1590289362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46a32cab-7405-41b2-ba48-05c212d1c168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:00:16 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f85cc7ad-e7c9-44ee-a5b6-1534f6e3ba7a tempest-AttachVolumeShelveTestJSON-1590289362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f19f73d9-e783-4e5a-97af-a56cc5601128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:00:16 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f85cc7ad-e7c9-44ee-a5b6-1534f6e3ba7a tempest-AttachVolumeShelveTestJSON-1590289362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f19f73d9-e783-4e5a-97af-a56cc5601128) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5312a76-36b2-4de5-9efd-0c6e39849629', 'volume_name': 'volume-f5312a76-36b2-4de5-9efd-0c6e39849629', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:00:16 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f85cc7ad-e7c9-44ee-a5b6-1534f6e3ba7a tempest-AttachVolumeShelveTestJSON-1590289362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b61d362-2edc-415d-97ac-2a3f9c10775b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:00:16 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f85cc7ad-e7c9-44ee-a5b6-1534f6e3ba7a tempest-AttachVolumeShelveTestJSON-1590289362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b61d362-2edc-415d-97ac-2a3f9c10775b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:00:16 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f85cc7ad-e7c9-44ee-a5b6-1534f6e3ba7a tempest-AttachVolumeShelveTestJSON-1590289362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e106a07-ab51-41fe-a8b5-3952987f9d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:00:16 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-f85cc7ad-e7c9-44ee-a5b6-1534f6e3ba7a tempest-AttachVolumeShelveTestJSON-1590289362 None] Volume f5312a76-36b2-4de5-9efd-0c6e39849629: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5312a76-36b2-4de5-9efd-0c6e39849629', 'volume_size': 1} Jun 24 05:00:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f85cc7ad-e7c9-44ee-a5b6-1534f6e3ba7a tempest-AttachVolumeShelveTestJSON-1590289362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:00:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f85cc7ad-e7c9-44ee-a5b6-1534f6e3ba7a tempest-AttachVolumeShelveTestJSON-1590289362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:00:16 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f85cc7ad-e7c9-44ee-a5b6-1534f6e3ba7a tempest-AttachVolumeShelveTestJSON-1590289362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:00:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-771674218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5312a76-36b2-4de5-9efd-0c6e39849629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa134f7e2bfc494087f6afa0282efdea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:00:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:00:16Z,use_quota=True,user_id='1cd4427ec8fe4c32a07f9ecc1b6d5283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:00:16 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-f85cc7ad-e7c9-44ee-a5b6-1534f6e3ba7a tempest-AttachVolumeShelveTestJSON-1590289362 None] Creating volume f5312a76-36b2-4de5-9efd-0c6e39849629 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:00:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f85cc7ad-e7c9-44ee-a5b6-1534f6e3ba7a tempest-AttachVolumeShelveTestJSON-1590289362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:00:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f85cc7ad-e7c9-44ee-a5b6-1534f6e3ba7a tempest-AttachVolumeShelveTestJSON-1590289362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:00:16 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f85cc7ad-e7c9-44ee-a5b6-1534f6e3ba7a tempest-AttachVolumeShelveTestJSON-1590289362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:00:16 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f85cc7ad-e7c9-44ee-a5b6-1534f6e3ba7a tempest-AttachVolumeShelveTestJSON-1590289362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:00:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f85cc7ad-e7c9-44ee-a5b6-1534f6e3ba7a tempest-AttachVolumeShelveTestJSON-1590289362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:00:16 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f85cc7ad-e7c9-44ee-a5b6-1534f6e3ba7a tempest-AttachVolumeShelveTestJSON-1590289362 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:00:16 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-f85cc7ad-e7c9-44ee-a5b6-1534f6e3ba7a tempest-AttachVolumeShelveTestJSON-1590289362 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:00:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f85cc7ad-e7c9-44ee-a5b6-1534f6e3ba7a tempest-AttachVolumeShelveTestJSON-1590289362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f5312a76-36b2-4de5-9efd-0c6e39849629 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:00:16 devstack sudo[97313]: pam_unix(sudo:session): session closed for user root Jun 24 05:00:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dbc9a058-045e-4158-8e69-5676535ac114 tempest-VolumesTestJSON-1105090006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-22402eb7-f3fa-41cb-9b58-96fa9f4aa3f4" returned: 0 in 0.766s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:00:16 devstack sudo[97318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f5312a76-36b2-4de5-9efd-0c6e39849629 1073741824 Jun 24 05:00:16 devstack sudo[97318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:00:16 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-dbc9a058-045e-4158-8e69-5676535ac114 tempest-VolumesTestJSON-1105090006 None] Lock "cinder-quobyte-22402eb7-f3fa-41cb-9b58-96fa9f4aa3f4" released by "delete_volume" :: held 1.692s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:00:16 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-dbc9a058-045e-4158-8e69-5676535ac114 tempest-VolumesTestJSON-1105090006 None] Created reservations ['216bf533-0b47-4293-9da3-e71643939891', '05f825c0-a9b1-42c6-8612-2ca7697e585b', 'f29604f9-cf02-402c-8da2-9976bbfeba02', 'cad4333c-1409-432d-ac57-83a8889116b5'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:00:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-dbc9a058-045e-4158-8e69-5676535ac114 tempest-VolumesTestJSON-1105090006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:00:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-dbc9a058-045e-4158-8e69-5676535ac114 tempest-VolumesTestJSON-1105090006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:00:16 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-dbc9a058-045e-4158-8e69-5676535ac114 tempest-VolumesTestJSON-1105090006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:00:16 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-dbc9a058-045e-4158-8e69-5676535ac114 tempest-VolumesTestJSON-1105090006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:00:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-dbc9a058-045e-4158-8e69-5676535ac114 tempest-VolumesTestJSON-1105090006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:00:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dbc9a058-045e-4158-8e69-5676535ac114 tempest-VolumesTestJSON-1105090006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:00:16 devstack sudo[97320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:00:16 devstack sudo[97320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:00:16 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-68a3755d-8ba0-4100-a47f-2a23d08bb0c5 tempest-VolumesTestJSON-1105090006 None] Acquiring lock "cinder-512ec64f-0c27-441b-972f-adb4dc41c62a-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:00:16 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-68a3755d-8ba0-4100-a47f-2a23d08bb0c5 tempest-VolumesTestJSON-1105090006 None] Lock "cinder-512ec64f-0c27-441b-972f-adb4dc41c62a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:00:16 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-68a3755d-8ba0-4100-a47f-2a23d08bb0c5 tempest-VolumesTestJSON-1105090006 None] Acquiring lock "cinder-quobyte-512ec64f-0c27-441b-972f-adb4dc41c62a" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:00:16 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-68a3755d-8ba0-4100-a47f-2a23d08bb0c5 tempest-VolumesTestJSON-1105090006 None] Lock "cinder-quobyte-512ec64f-0c27-441b-972f-adb4dc41c62a" acquired by "delete_volume" :: waited 0.035s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:00:16 devstack sudo[97320]: pam_unix(sudo:session): session closed for user root Jun 24 05:00:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dbc9a058-045e-4158-8e69-5676535ac114 tempest-VolumesTestJSON-1105090006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.699s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:00:16 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-dbc9a058-045e-4158-8e69-5676535ac114 tempest-VolumesTestJSON-1105090006 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:00:16 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-dbc9a058-045e-4158-8e69-5676535ac114 tempest-VolumesTestJSON-1105090006 None] Deleted volume successfully. Jun 24 05:00:16 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76c6b4e-4356-413f-8b4e-4fd1329ce352]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:00:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-68a3755d-8ba0-4100-a47f-2a23d08bb0c5 tempest-VolumesTestJSON-1105090006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-512ec64f-0c27-441b-972f-adb4dc41c62a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:00:16 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-dbc9a058-045e-4158-8e69-5676535ac114 tempest-VolumesTestJSON-1105090006 None] Lock "cinder-22402eb7-f3fa-41cb-9b58-96fa9f4aa3f4-delete_volume" released by "delete_volume" :: held 2.635s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:00:17 devstack sudo[97318]: pam_unix(sudo:session): session closed for user root Jun 24 05:00:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f85cc7ad-e7c9-44ee-a5b6-1534f6e3ba7a tempest-AttachVolumeShelveTestJSON-1590289362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f5312a76-36b2-4de5-9efd-0c6e39849629 1073741824" returned: 0 in 0.985s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:00:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f85cc7ad-e7c9-44ee-a5b6-1534f6e3ba7a tempest-AttachVolumeShelveTestJSON-1590289362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f5312a76-36b2-4de5-9efd-0c6e39849629 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:00:17 devstack sudo[97326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-512ec64f-0c27-441b-972f-adb4dc41c62a Jun 24 05:00:17 devstack sudo[97326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:00:17 devstack sudo[97327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f5312a76-36b2-4de5-9efd-0c6e39849629 Jun 24 05:00:17 devstack sudo[97327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:00:17 devstack sudo[97327]: pam_unix(sudo:session): session closed for user root Jun 24 05:00:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f85cc7ad-e7c9-44ee-a5b6-1534f6e3ba7a tempest-AttachVolumeShelveTestJSON-1590289362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f5312a76-36b2-4de5-9efd-0c6e39849629" returned: 0 in 0.640s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:00:17 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f85cc7ad-e7c9-44ee-a5b6-1534f6e3ba7a tempest-AttachVolumeShelveTestJSON-1590289362 None] <== create_volume: return (1681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:00:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f85cc7ad-e7c9-44ee-a5b6-1534f6e3ba7a tempest-AttachVolumeShelveTestJSON-1590289362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:00:17 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f85cc7ad-e7c9-44ee-a5b6-1534f6e3ba7a tempest-AttachVolumeShelveTestJSON-1590289362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e106a07-ab51-41fe-a8b5-3952987f9d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5312a76-36b2-4de5-9efd-0c6e39849629', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:00:17 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f85cc7ad-e7c9-44ee-a5b6-1534f6e3ba7a tempest-AttachVolumeShelveTestJSON-1590289362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (076a977f-f5ea-4395-a002-4c4a889a0d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:00:17 devstack sudo[97326]: pam_unix(sudo:session): session closed for user root Jun 24 05:00:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-68a3755d-8ba0-4100-a47f-2a23d08bb0c5 tempest-VolumesTestJSON-1105090006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-512ec64f-0c27-441b-972f-adb4dc41c62a" returned: 0 in 0.832s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:00:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-68a3755d-8ba0-4100-a47f-2a23d08bb0c5 tempest-VolumesTestJSON-1105090006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-512ec64f-0c27-441b-972f-adb4dc41c62a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:00:17 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-f85cc7ad-e7c9-44ee-a5b6-1534f6e3ba7a tempest-AttachVolumeShelveTestJSON-1590289362 None] Volume volume-f5312a76-36b2-4de5-9efd-0c6e39849629 (f5312a76-36b2-4de5-9efd-0c6e39849629): created successfully Jun 24 05:00:17 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f85cc7ad-e7c9-44ee-a5b6-1534f6e3ba7a tempest-AttachVolumeShelveTestJSON-1590289362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (076a977f-f5ea-4395-a002-4c4a889a0d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:00:17 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f85cc7ad-e7c9-44ee-a5b6-1534f6e3ba7a tempest-AttachVolumeShelveTestJSON-1590289362 None] Flow 'volume_create_manager' (82d33481-6efe-401e-afa5-14473715a8f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:00:17 devstack sudo[97334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-512ec64f-0c27-441b-972f-adb4dc41c62a Jun 24 05:00:17 devstack sudo[97334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:00:17 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-f85cc7ad-e7c9-44ee-a5b6-1534f6e3ba7a tempest-AttachVolumeShelveTestJSON-1590289362 None] Created volume successfully. Jun 24 05:00:18 devstack sudo[97334]: pam_unix(sudo:session): session closed for user root Jun 24 05:00:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-68a3755d-8ba0-4100-a47f-2a23d08bb0c5 tempest-VolumesTestJSON-1105090006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-512ec64f-0c27-441b-972f-adb4dc41c62a" returned: 0 in 0.710s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:00:18 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-68a3755d-8ba0-4100-a47f-2a23d08bb0c5 tempest-VolumesTestJSON-1105090006 None] Lock "cinder-quobyte-512ec64f-0c27-441b-972f-adb4dc41c62a" released by "delete_volume" :: held 1.608s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:00:18 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-68a3755d-8ba0-4100-a47f-2a23d08bb0c5 tempest-VolumesTestJSON-1105090006 None] Created reservations ['7625e90f-d870-4ec3-b429-444f78fb79f2', 'c345aa9d-3bae-478d-9278-d4e8f37802d2', '01e529ad-0186-44e9-911a-c9889fc20062', 'd13c444f-f42b-4f03-b0e9-144d3951075d'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:00:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-68a3755d-8ba0-4100-a47f-2a23d08bb0c5 tempest-VolumesTestJSON-1105090006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:00:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-68a3755d-8ba0-4100-a47f-2a23d08bb0c5 tempest-VolumesTestJSON-1105090006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:00:18 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-68a3755d-8ba0-4100-a47f-2a23d08bb0c5 tempest-VolumesTestJSON-1105090006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:00:18 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-68a3755d-8ba0-4100-a47f-2a23d08bb0c5 tempest-VolumesTestJSON-1105090006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:00:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-68a3755d-8ba0-4100-a47f-2a23d08bb0c5 tempest-VolumesTestJSON-1105090006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:00:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-68a3755d-8ba0-4100-a47f-2a23d08bb0c5 tempest-VolumesTestJSON-1105090006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:00:18 devstack sudo[97365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:00:18 devstack sudo[97365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:00:19 devstack sudo[97365]: pam_unix(sudo:session): session closed for user root Jun 24 05:00:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-68a3755d-8ba0-4100-a47f-2a23d08bb0c5 tempest-VolumesTestJSON-1105090006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.784s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:00:19 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-68a3755d-8ba0-4100-a47f-2a23d08bb0c5 tempest-VolumesTestJSON-1105090006 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:00:19 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-68a3755d-8ba0-4100-a47f-2a23d08bb0c5 tempest-VolumesTestJSON-1105090006 None] Deleted volume successfully. Jun 24 05:00:19 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-68a3755d-8ba0-4100-a47f-2a23d08bb0c5 tempest-VolumesTestJSON-1105090006 None] Lock "cinder-512ec64f-0c27-441b-972f-adb4dc41c62a-delete_volume" released by "delete_volume" :: held 2.689s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:00:27 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b60e324-65b5-415f-8af0-a865cb695781 tempest-AttachVolumeTestJSON-729142982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:00:27 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-6b60e324-65b5-415f-8af0-a865cb695781 tempest-AttachVolumeTestJSON-729142982 None] Flow 'volume_create_manager' (2fc92500-393c-4826-9857-2f50efd33df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:00:27 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-6b60e324-65b5-415f-8af0-a865cb695781 tempest-AttachVolumeTestJSON-729142982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bab88cc-1deb-4f23-8247-05da20d0eb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:00:27 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-6b60e324-65b5-415f-8af0-a865cb695781 tempest-AttachVolumeTestJSON-729142982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bab88cc-1deb-4f23-8247-05da20d0eb18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:00:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1123030872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a553c74-0fb4-4746-a67a-e6f3315ecd14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86bb7834debb40eca1cb8980d588eee3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:00:27Z,use_quota=True,user_id='42525aab0b21446b8739e354bf85f2be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:00:27 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-6b60e324-65b5-415f-8af0-a865cb695781 tempest-AttachVolumeTestJSON-729142982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfcaea4e-edfa-4e26-a567-efacdc00fd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:00:27 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-6b60e324-65b5-415f-8af0-a865cb695781 tempest-AttachVolumeTestJSON-729142982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfcaea4e-edfa-4e26-a567-efacdc00fd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:00:27 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-6b60e324-65b5-415f-8af0-a865cb695781 tempest-AttachVolumeTestJSON-729142982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eef3e1d2-6aa9-4dc2-a968-f3eec7940c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:00:27 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-6b60e324-65b5-415f-8af0-a865cb695781 tempest-AttachVolumeTestJSON-729142982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eef3e1d2-6aa9-4dc2-a968-f3eec7940c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a553c74-0fb4-4746-a67a-e6f3315ecd14', 'volume_name': 'volume-7a553c74-0fb4-4746-a67a-e6f3315ecd14', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:00:27 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-6b60e324-65b5-415f-8af0-a865cb695781 tempest-AttachVolumeTestJSON-729142982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3671413-6d45-4b33-bd09-960cfdc24c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:00:27 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-6b60e324-65b5-415f-8af0-a865cb695781 tempest-AttachVolumeTestJSON-729142982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3671413-6d45-4b33-bd09-960cfdc24c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:00:27 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-6b60e324-65b5-415f-8af0-a865cb695781 tempest-AttachVolumeTestJSON-729142982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a20a453f-6935-427c-9aea-0c5be966d915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:00:27 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-6b60e324-65b5-415f-8af0-a865cb695781 tempest-AttachVolumeTestJSON-729142982 None] Volume 7a553c74-0fb4-4746-a67a-e6f3315ecd14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a553c74-0fb4-4746-a67a-e6f3315ecd14', 'volume_size': 1} Jun 24 05:00:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-6b60e324-65b5-415f-8af0-a865cb695781 tempest-AttachVolumeTestJSON-729142982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:00:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-6b60e324-65b5-415f-8af0-a865cb695781 tempest-AttachVolumeTestJSON-729142982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:00:27 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-6b60e324-65b5-415f-8af0-a865cb695781 tempest-AttachVolumeTestJSON-729142982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:00:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1123030872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a553c74-0fb4-4746-a67a-e6f3315ecd14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86bb7834debb40eca1cb8980d588eee3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:00:27Z,use_quota=True,user_id='42525aab0b21446b8739e354bf85f2be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:00:27 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-6b60e324-65b5-415f-8af0-a865cb695781 tempest-AttachVolumeTestJSON-729142982 None] Creating volume 7a553c74-0fb4-4746-a67a-e6f3315ecd14 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:00:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-6b60e324-65b5-415f-8af0-a865cb695781 tempest-AttachVolumeTestJSON-729142982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:00:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-6b60e324-65b5-415f-8af0-a865cb695781 tempest-AttachVolumeTestJSON-729142982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:00:27 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-6b60e324-65b5-415f-8af0-a865cb695781 tempest-AttachVolumeTestJSON-729142982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:00:27 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-6b60e324-65b5-415f-8af0-a865cb695781 tempest-AttachVolumeTestJSON-729142982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:00:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-6b60e324-65b5-415f-8af0-a865cb695781 tempest-AttachVolumeTestJSON-729142982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:00:27 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-6b60e324-65b5-415f-8af0-a865cb695781 tempest-AttachVolumeTestJSON-729142982 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:00:27 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-6b60e324-65b5-415f-8af0-a865cb695781 tempest-AttachVolumeTestJSON-729142982 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:00:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6b60e324-65b5-415f-8af0-a865cb695781 tempest-AttachVolumeTestJSON-729142982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7a553c74-0fb4-4746-a67a-e6f3315ecd14 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:00:27 devstack sudo[97484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7a553c74-0fb4-4746-a67a-e6f3315ecd14 1073741824 Jun 24 05:00:27 devstack sudo[97484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:00:28 devstack sudo[97484]: pam_unix(sudo:session): session closed for user root Jun 24 05:00:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6b60e324-65b5-415f-8af0-a865cb695781 tempest-AttachVolumeTestJSON-729142982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7a553c74-0fb4-4746-a67a-e6f3315ecd14 1073741824" returned: 0 in 0.961s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:00:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6b60e324-65b5-415f-8af0-a865cb695781 tempest-AttachVolumeTestJSON-729142982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7a553c74-0fb4-4746-a67a-e6f3315ecd14 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:00:28 devstack sudo[97494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7a553c74-0fb4-4746-a67a-e6f3315ecd14 Jun 24 05:00:28 devstack sudo[97494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:00:29 devstack sudo[97494]: pam_unix(sudo:session): session closed for user root Jun 24 05:00:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6b60e324-65b5-415f-8af0-a865cb695781 tempest-AttachVolumeTestJSON-729142982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7a553c74-0fb4-4746-a67a-e6f3315ecd14" returned: 0 in 0.759s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:00:29 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-6b60e324-65b5-415f-8af0-a865cb695781 tempest-AttachVolumeTestJSON-729142982 None] <== create_volume: return (1767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:00:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-6b60e324-65b5-415f-8af0-a865cb695781 tempest-AttachVolumeTestJSON-729142982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.770s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:00:29 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-6b60e324-65b5-415f-8af0-a865cb695781 tempest-AttachVolumeTestJSON-729142982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a20a453f-6935-427c-9aea-0c5be966d915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a553c74-0fb4-4746-a67a-e6f3315ecd14', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:00:29 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-6b60e324-65b5-415f-8af0-a865cb695781 tempest-AttachVolumeTestJSON-729142982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e451d075-86cf-4eae-a750-1a2a610bd444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:00:29 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-6b60e324-65b5-415f-8af0-a865cb695781 tempest-AttachVolumeTestJSON-729142982 None] Volume volume-7a553c74-0fb4-4746-a67a-e6f3315ecd14 (7a553c74-0fb4-4746-a67a-e6f3315ecd14): created successfully Jun 24 05:00:29 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-6b60e324-65b5-415f-8af0-a865cb695781 tempest-AttachVolumeTestJSON-729142982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e451d075-86cf-4eae-a750-1a2a610bd444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:00:29 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-6b60e324-65b5-415f-8af0-a865cb695781 tempest-AttachVolumeTestJSON-729142982 None] Flow 'volume_create_manager' (2fc92500-393c-4826-9857-2f50efd33df7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:00:29 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-6b60e324-65b5-415f-8af0-a865cb695781 tempest-AttachVolumeTestJSON-729142982 None] Created volume successfully. Jun 24 05:00:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-3b4057c0-5477-49a7-86ac-715c012388e8 req-c9e6a32c-7395-4a74-a0e3-78c4e6fc83bb tempest-AttachVolumeTestJSON-729142982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:00:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-3b4057c0-5477-49a7-86ac-715c012388e8 req-c9e6a32c-7395-4a74-a0e3-78c4e6fc83bb tempest-AttachVolumeTestJSON-729142982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:00:32 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[96873823-737f-4ed5-b5ab-0eaa33d7802a]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:00:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-3b4057c0-5477-49a7-86ac-715c012388e8 req-c9e6a32c-7395-4a74-a0e3-78c4e6fc83bb tempest-AttachVolumeTestJSON-729142982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7a553c74-0fb4-4746-a67a-e6f3315ecd14 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:00:32 devstack sudo[97518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7a553c74-0fb4-4746-a67a-e6f3315ecd14 Jun 24 05:00:32 devstack sudo[97518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:00:32 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-e83ceef3-49ab-4b7b-b2bc-3ceba082a02e tempest-GroupsV314Test-1044020990 None] Group tempest-GroupsV314Test-Group-700214880: creating Jun 24 05:00:33 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-e83ceef3-49ab-4b7b-b2bc-3ceba082a02e tempest-GroupsV314Test-1044020990 None] Group tempest-GroupsV314Test-Group-700214880: created successfully Jun 24 05:00:33 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-e83ceef3-49ab-4b7b-b2bc-3ceba082a02e tempest-GroupsV314Test-1044020990 None] Create group completed successfully. Jun 24 05:00:33 devstack sudo[97518]: pam_unix(sudo:session): session closed for user root Jun 24 05:00:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-3b4057c0-5477-49a7-86ac-715c012388e8 req-c9e6a32c-7395-4a74-a0e3-78c4e6fc83bb tempest-AttachVolumeTestJSON-729142982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7a553c74-0fb4-4746-a67a-e6f3315ecd14" returned: 0 in 0.866s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:00:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-3b4057c0-5477-49a7-86ac-715c012388e8 req-c9e6a32c-7395-4a74-a0e3-78c4e6fc83bb tempest-AttachVolumeTestJSON-729142982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.883s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:00:33 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-3b4057c0-5477-49a7-86ac-715c012388e8 req-c9e6a32c-7395-4a74-a0e3-78c4e6fc83bb tempest-AttachVolumeTestJSON-729142982 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05', 'name': 'volume-7a553c74-0fb4-4746-a67a-e6f3315ecd14', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a73f3370-99cb-484b-bc53-453b55bfcff6', 'enforce_multipath': True} {{(pid=93830) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 05:00:33 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-3b4057c0-5477-49a7-86ac-715c012388e8 req-c9e6a32c-7395-4a74-a0e3-78c4e6fc83bb tempest-AttachVolumeTestJSON-729142982 None] attachment_update completed successfully. Jun 24 05:00:34 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-6bd51184-216c-4889-9e0a-5e4d5b71f005 req-c84fe712-2d8f-4b95-a733-355402519d4c tempest-AttachVolumeShelveTestJSON-1590289362 None] No connector for attachment e0ad10d9-a642-4b02-93cb-ca0c7ff3987f; skipping storage backend terminate_connection call. {{(pid=93830) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jun 24 05:00:34 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-6bd51184-216c-4889-9e0a-5e4d5b71f005 req-c84fe712-2d8f-4b95-a733-355402519d4c tempest-AttachVolumeShelveTestJSON-1590289362 None] Deleting attachment e0ad10d9-a642-4b02-93cb-ca0c7ff3987f. {{(pid=93830) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 05:00:34 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-1eb7da28-d70b-4fcb-8848-708fffe4d87c tempest-GroupsV314Test-1044020990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:00:34 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1eb7da28-d70b-4fcb-8848-708fffe4d87c tempest-GroupsV314Test-1044020990 None] Flow 'volume_create_manager' (6bc28605-f8bb-4b8b-ae57-07395dd21a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:00:34 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1eb7da28-d70b-4fcb-8848-708fffe4d87c tempest-GroupsV314Test-1044020990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (725cc445-970c-4431-906e-c2142c16e38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:00:34 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1eb7da28-d70b-4fcb-8848-708fffe4d87c tempest-GroupsV314Test-1044020990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (725cc445-970c-4431-906e-c2142c16e38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1656807094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=35984406-29c8-40f9-ac13-deef41382fd7,host='devstack@QuobyteHD#QuobyteHD',id=575ff5dc-fc89-4633-a9d6-54675b269a4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1dc5b66f8554bf6ae2bd70ef4f4edcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:00:35Z,use_quota=True,user_id='1417056822f84937890814db514d9ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a69e2a08-6096-4590-9c37-46980e7e4f64),volume_type_id=a69e2a08-6096-4590-9c37-46980e7e4f64)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:00:34 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1eb7da28-d70b-4fcb-8848-708fffe4d87c tempest-GroupsV314Test-1044020990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f333966-d9b9-4be2-b913-cdfe10bb0dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:00:34 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1eb7da28-d70b-4fcb-8848-708fffe4d87c tempest-GroupsV314Test-1044020990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f333966-d9b9-4be2-b913-cdfe10bb0dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:00:34 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1eb7da28-d70b-4fcb-8848-708fffe4d87c tempest-GroupsV314Test-1044020990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57711d06-e501-4dae-990b-4bdb5e848ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:00:34 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1eb7da28-d70b-4fcb-8848-708fffe4d87c tempest-GroupsV314Test-1044020990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57711d06-e501-4dae-990b-4bdb5e848ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '575ff5dc-fc89-4633-a9d6-54675b269a4a', 'volume_name': 'volume-575ff5dc-fc89-4633-a9d6-54675b269a4a', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:00:34 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1eb7da28-d70b-4fcb-8848-708fffe4d87c tempest-GroupsV314Test-1044020990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f4de1e0-092b-4ad7-8ba6-43218ba8e23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:00:34 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1eb7da28-d70b-4fcb-8848-708fffe4d87c tempest-GroupsV314Test-1044020990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f4de1e0-092b-4ad7-8ba6-43218ba8e23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:00:34 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1eb7da28-d70b-4fcb-8848-708fffe4d87c tempest-GroupsV314Test-1044020990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b748cea-9981-4199-8a53-53837b5fa5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:00:34 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-1eb7da28-d70b-4fcb-8848-708fffe4d87c tempest-GroupsV314Test-1044020990 None] Volume 575ff5dc-fc89-4633-a9d6-54675b269a4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-575ff5dc-fc89-4633-a9d6-54675b269a4a', 'volume_size': 1} Jun 24 05:00:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1eb7da28-d70b-4fcb-8848-708fffe4d87c tempest-GroupsV314Test-1044020990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:00:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1eb7da28-d70b-4fcb-8848-708fffe4d87c tempest-GroupsV314Test-1044020990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:00:34 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-1eb7da28-d70b-4fcb-8848-708fffe4d87c tempest-GroupsV314Test-1044020990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=35984406-29c8-40f9-ac13-deef41382fd7,created_at=2026-06-24T03:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1656807094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=35984406-29c8-40f9-ac13-deef41382fd7,host='devstack@QuobyteHD#QuobyteHD',id=575ff5dc-fc89-4633-a9d6-54675b269a4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1dc5b66f8554bf6ae2bd70ef4f4edcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:00:35Z,use_quota=True,user_id='1417056822f84937890814db514d9ff5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a69e2a08-6096-4590-9c37-46980e7e4f64),volume_type_id=a69e2a08-6096-4590-9c37-46980e7e4f64)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:00:34 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-1eb7da28-d70b-4fcb-8848-708fffe4d87c tempest-GroupsV314Test-1044020990 None] Creating volume 575ff5dc-fc89-4633-a9d6-54675b269a4a {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:00:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1eb7da28-d70b-4fcb-8848-708fffe4d87c tempest-GroupsV314Test-1044020990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:00:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1eb7da28-d70b-4fcb-8848-708fffe4d87c tempest-GroupsV314Test-1044020990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:00:34 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-1eb7da28-d70b-4fcb-8848-708fffe4d87c tempest-GroupsV314Test-1044020990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:00:34 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-1eb7da28-d70b-4fcb-8848-708fffe4d87c tempest-GroupsV314Test-1044020990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:00:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1eb7da28-d70b-4fcb-8848-708fffe4d87c tempest-GroupsV314Test-1044020990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:00:34 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-1eb7da28-d70b-4fcb-8848-708fffe4d87c tempest-GroupsV314Test-1044020990 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:00:34 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-1eb7da28-d70b-4fcb-8848-708fffe4d87c tempest-GroupsV314Test-1044020990 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:00:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1eb7da28-d70b-4fcb-8848-708fffe4d87c tempest-GroupsV314Test-1044020990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:00:34 devstack sudo[97590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a 1073741824 Jun 24 05:00:34 devstack sudo[97590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:00:35 devstack sudo[97590]: pam_unix(sudo:session): session closed for user root Jun 24 05:00:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1eb7da28-d70b-4fcb-8848-708fffe4d87c tempest-GroupsV314Test-1044020990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a 1073741824" returned: 0 in 0.939s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:00:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1eb7da28-d70b-4fcb-8848-708fffe4d87c tempest-GroupsV314Test-1044020990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:00:35 devstack sudo[97914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a Jun 24 05:00:35 devstack sudo[97914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:00:37 devstack sudo[97914]: pam_unix(sudo:session): session closed for user root Jun 24 05:00:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1eb7da28-d70b-4fcb-8848-708fffe4d87c tempest-GroupsV314Test-1044020990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a" returned: 0 in 1.212s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:00:37 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-1eb7da28-d70b-4fcb-8848-708fffe4d87c tempest-GroupsV314Test-1044020990 None] <== create_volume: return (2206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:00:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1eb7da28-d70b-4fcb-8848-708fffe4d87c tempest-GroupsV314Test-1044020990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.211s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:00:37 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1eb7da28-d70b-4fcb-8848-708fffe4d87c tempest-GroupsV314Test-1044020990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b748cea-9981-4199-8a53-53837b5fa5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-575ff5dc-fc89-4633-a9d6-54675b269a4a', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:00:37 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1eb7da28-d70b-4fcb-8848-708fffe4d87c tempest-GroupsV314Test-1044020990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e521398f-171a-44f5-8ac1-794d2470fbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:00:37 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:SELECT=38,cinder:UPDATE=60,cinder:INSERT=12,cinder:DELETE=6 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:00:37 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-1eb7da28-d70b-4fcb-8848-708fffe4d87c tempest-GroupsV314Test-1044020990 None] Volume volume-575ff5dc-fc89-4633-a9d6-54675b269a4a (575ff5dc-fc89-4633-a9d6-54675b269a4a): created successfully Jun 24 05:00:37 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1eb7da28-d70b-4fcb-8848-708fffe4d87c tempest-GroupsV314Test-1044020990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e521398f-171a-44f5-8ac1-794d2470fbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:00:37 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1eb7da28-d70b-4fcb-8848-708fffe4d87c tempest-GroupsV314Test-1044020990 None] Flow 'volume_create_manager' (6bc28605-f8bb-4b8b-ae57-07395dd21a3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:00:37 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-1eb7da28-d70b-4fcb-8848-708fffe4d87c tempest-GroupsV314Test-1044020990 None] Created volume successfully. Jun 24 05:00:38 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:SELECT=52,cinder:UPDATE=58,cinder:INSERT=12,cinder:DELETE=6 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:00:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:00:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:00:38 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] Cloning volume 575ff5dc-fc89-4633-a9d6-54675b269a4a to volume eacfea27-694c-4330-82b8-c68eb9099f39 Jun 24 05:00:38 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] Creating offline snapshot 70af2007-44c5-4e0f-989a-6d721f808a00 of volume 575ff5dc-fc89-4633-a9d6-54675b269a4a {{(pid=93830) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 05:00:38 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ed53f1-05c5-4ad1-a876-4f5a19fc22bb]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:00:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:00:38 devstack sudo[97974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a Jun 24 05:00:38 devstack sudo[97974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:00:39 devstack sudo[97974]: pam_unix(sudo:session): session closed for user root Jun 24 05:00:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a" returned: 0 in 0.793s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:00:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a.70af2007-44c5-4e0f-989a-6d721f808a00 1G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:00:39 devstack sudo[97982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a.70af2007-44c5-4e0f-989a-6d721f808a00 1G Jun 24 05:00:39 devstack sudo[97982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:00:40 devstack sudo[97982]: pam_unix(sudo:session): session closed for user root Jun 24 05:00:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a.70af2007-44c5-4e0f-989a-6d721f808a00 1G" returned: 0 in 0.941s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:00:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-575ff5dc-fc89-4633-a9d6-54675b269a4a -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a.70af2007-44c5-4e0f-989a-6d721f808a00 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:00:40 devstack sudo[97993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-575ff5dc-fc89-4633-a9d6-54675b269a4a -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a.70af2007-44c5-4e0f-989a-6d721f808a00 Jun 24 05:00:40 devstack sudo[97993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:00:41 devstack sudo[97993]: pam_unix(sudo:session): session closed for user root Jun 24 05:00:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-575ff5dc-fc89-4633-a9d6-54675b269a4a -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a.70af2007-44c5-4e0f-989a-6d721f808a00" returned: 0 in 0.855s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:00:41 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a.70af2007-44c5-4e0f-989a-6d721f808a00 is being set with open permissions: ugo+rw: NotImplementedError Jun 24 05:00:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a.70af2007-44c5-4e0f-989a-6d721f808a00 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:00:41 devstack sudo[98043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a.70af2007-44c5-4e0f-989a-6d721f808a00 Jun 24 05:00:41 devstack sudo[98043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:00:41 devstack sudo[98043]: pam_unix(sudo:session): session closed for user root Jun 24 05:00:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a.70af2007-44c5-4e0f-989a-6d721f808a00" returned: 0 in 0.676s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:00:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:00:42 devstack sudo[98047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a.info Jun 24 05:00:42 devstack sudo[98047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:00:42 devstack sudo[98047]: pam_unix(sudo:session): session closed for user root Jun 24 05:00:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a.info" returned: 0 in 0.718s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:00:42 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a.info is being set with open permissions: ugo+rw: NotImplementedError Jun 24 05:00:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:00:42 devstack sudo[98052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a.info Jun 24 05:00:42 devstack sudo[98052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:00:43 devstack sudo[98052]: pam_unix(sudo:session): session closed for user root Jun 24 05:00:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a.info" returned: 0 in 0.655s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:00:43 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] Acquiring lock "cinder-quobyte-eacfea27-694c-4330-82b8-c68eb9099f39" by "_copy_volume_from_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:00:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-a914c514-fb69-4303-beed-9086ca6daf81 req-f481cdac-1e8c-44d2-b492-3848632a963f tempest-TaggedAttachmentsTest-23923640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:00:43 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] Lock "cinder-quobyte-eacfea27-694c-4330-82b8-c68eb9099f39" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:00:43 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] snapshot: 70af2007-44c5-4e0f-989a-6d721f808a00, volume: eacfea27-694c-4330-82b8-c68eb9099f39, {{(pid=93830) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 05:00:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:00:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:00:43 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:00:43 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:00:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:00:43 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[541346ab-9bd4-4892-897f-619366dff66a]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:00:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a.70af2007-44c5-4e0f-989a-6d721f808a00 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:00:43 devstack sudo[98065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a.70af2007-44c5-4e0f-989a-6d721f808a00 Jun 24 05:00:43 devstack sudo[98065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:00:44 devstack sudo[98065]: pam_unix(sudo:session): session closed for user root Jun 24 05:00:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a.70af2007-44c5-4e0f-989a-6d721f808a00" returned: 0 in 0.823s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:00:44 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-575ff5dc-fc89-4633-a9d6-54675b269a4a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:00:44 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a {{(pid=93830) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 05:00:44 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] Creating direct copy from snapshot {{(pid=93830) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 05:00:44 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[41640889-c908-40ae-9779-07c7db11efdb]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:00:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:00:44 devstack sudo[98070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a Jun 24 05:00:44 devstack sudo[98070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:00:45 devstack sudo[98070]: pam_unix(sudo:session): session closed for user root Jun 24 05:00:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a" returned: 0 in 0.789s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:00:45 devstack cinder-volume[93830]: DEBUG cinder.utils [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] Path /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eacfea27-694c-4330-82b8-c68eb9099f39 not found in is_blk_device check {{(pid=93830) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 05:00:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eacfea27-694c-4330-82b8-c68eb9099f39 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:00:45 devstack sudo[98077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eacfea27-694c-4330-82b8-c68eb9099f39 Jun 24 05:00:45 devstack sudo[98077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:00:51 devstack sudo[98077]: pam_unix(sudo:session): session closed for user root Jun 24 05:00:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eacfea27-694c-4330-82b8-c68eb9099f39" returned: 0 in 6.294s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:00:51 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aff6092-3011-4871-af3b-3529acec4c31]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:00:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:00:51 devstack sudo[98207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a Jun 24 05:00:51 devstack sudo[98207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:00:52 devstack sudo[98207]: pam_unix(sudo:session): session closed for user root Jun 24 05:00:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a" returned: 0 in 1.023s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:00:52 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] Image conversion details: src /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a, size 1024.00 MB, duration 6.30 sec, destination /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eacfea27-694c-4330-82b8-c68eb9099f39 {{(pid=93830) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 05:00:52 devstack cinder-volume[93830]: INFO cinder.image.image_utils [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] Converted 1024.00 MB image at 162.66 MB/s Jun 24 05:00:52 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eacfea27-694c-4330-82b8-c68eb9099f39 is being set with open permissions: ugo+rw: NotImplementedError Jun 24 05:00:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eacfea27-694c-4330-82b8-c68eb9099f39 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:00:52 devstack sudo[98563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eacfea27-694c-4330-82b8-c68eb9099f39 Jun 24 05:00:52 devstack sudo[98563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:00:53 devstack sudo[98563]: pam_unix(sudo:session): session closed for user root Jun 24 05:00:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eacfea27-694c-4330-82b8-c68eb9099f39" returned: 0 in 0.738s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:00:53 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] Lock "cinder-quobyte-eacfea27-694c-4330-82b8-c68eb9099f39" released by "_copy_volume_from_snapshot" :: held 9.759s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:00:53 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] Acquiring lock "cinder-quobyte-70af2007-44c5-4e0f-989a-6d721f808a00" by "_delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:00:53 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] Lock "cinder-quobyte-70af2007-44c5-4e0f-989a-6d721f808a00" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:00:53 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] Deleting offline snapshot 70af2007-44c5-4e0f-989a-6d721f808a00 of volume 575ff5dc-fc89-4633-a9d6-54675b269a4a {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 05:00:53 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] snapshot_file for this snap is: volume-575ff5dc-fc89-4633-a9d6-54675b269a4a.70af2007-44c5-4e0f-989a-6d721f808a00 {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 05:00:53 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a34a813-fb00-456b-ae75-4fd1956b3045]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:00:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a.70af2007-44c5-4e0f-989a-6d721f808a00 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:00:53 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=1 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:00:53 devstack sudo[98611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a.70af2007-44c5-4e0f-989a-6d721f808a00 Jun 24 05:00:53 devstack sudo[98611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:00:54 devstack sudo[98611]: pam_unix(sudo:session): session closed for user root Jun 24 05:00:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a.70af2007-44c5-4e0f-989a-6d721f808a00" returned: 0 in 1.350s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:00:54 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-575ff5dc-fc89-4633-a9d6-54675b269a4a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:00:54 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[782edf99-54c7-4eb4-809c-639eeb0b1e2d]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:00:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:00:54 devstack sudo[98660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a Jun 24 05:00:54 devstack sudo[98660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:00:55 devstack sudo[98660]: pam_unix(sudo:session): session closed for user root Jun 24 05:00:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a" returned: 0 in 1.022s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:00:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a.70af2007-44c5-4e0f-989a-6d721f808a00 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:00:55 devstack sudo[98667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a.70af2007-44c5-4e0f-989a-6d721f808a00 Jun 24 05:00:55 devstack sudo[98667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:00:56 devstack sudo[98667]: pam_unix(sudo:session): session closed for user root Jun 24 05:00:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a.70af2007-44c5-4e0f-989a-6d721f808a00" returned: 0 in 0.780s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:00:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a.70af2007-44c5-4e0f-989a-6d721f808a00 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:00:56 devstack sudo[98672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a.70af2007-44c5-4e0f-989a-6d721f808a00 Jun 24 05:00:56 devstack sudo[98672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:00:57 devstack sudo[98672]: pam_unix(sudo:session): session closed for user root Jun 24 05:00:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a.70af2007-44c5-4e0f-989a-6d721f808a00" returned: 0 in 0.816s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:00:57 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] Lock "cinder-quobyte-70af2007-44c5-4e0f-989a-6d721f808a00" released by "_delete_snapshot" :: held 4.128s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:00:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.769s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:00:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-a914c514-fb69-4303-beed-9086ca6daf81 req-f481cdac-1e8c-44d2-b492-3848632a963f tempest-TaggedAttachmentsTest-23923640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 13.972s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:00:57 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[d488561b-12ca-4114-adc4-3f7c30ee5854]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:00:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-a914c514-fb69-4303-beed-9086ca6daf81 req-f481cdac-1e8c-44d2-b492-3848632a963f tempest-TaggedAttachmentsTest-23923640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a2bbebdb-c653-487e-8182-e84c72c3fe7b {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:00:57 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-55d7ffff-2a62-4a93-80cd-232aa26646de tempest-GroupsV314Test-1044020990 None] Create group from source-group-35984406-29c8-40f9-ac13-deef41382fd7 completed successfully. Jun 24 05:00:57 devstack sudo[98680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a2bbebdb-c653-487e-8182-e84c72c3fe7b Jun 24 05:00:57 devstack sudo[98680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:00:58 devstack sudo[98680]: pam_unix(sudo:session): session closed for user root Jun 24 05:00:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-a914c514-fb69-4303-beed-9086ca6daf81 req-f481cdac-1e8c-44d2-b492-3848632a963f tempest-TaggedAttachmentsTest-23923640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a2bbebdb-c653-487e-8182-e84c72c3fe7b" returned: 0 in 0.811s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:00:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-a914c514-fb69-4303-beed-9086ca6daf81 req-f481cdac-1e8c-44d2-b492-3848632a963f tempest-TaggedAttachmentsTest-23923640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.832s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:00:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-a914c514-fb69-4303-beed-9086ca6daf81 req-f481cdac-1e8c-44d2-b492-3848632a963f tempest-TaggedAttachmentsTest-23923640 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05', 'name': 'volume-a2bbebdb-c653-487e-8182-e84c72c3fe7b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '54b1dbf2-4eb3-4d96-8c03-ad7368108b86', 'enforce_multipath': True} {{(pid=93830) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 05:00:58 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-a914c514-fb69-4303-beed-9086ca6daf81 req-f481cdac-1e8c-44d2-b492-3848632a963f tempest-TaggedAttachmentsTest-23923640 None] attachment_update completed successfully. Jun 24 05:00:58 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9df22124-91e1-4577-ae86-25dddb3150f4 tempest-GroupsV314Test-1044020990 None] Acquiring lock "cinder-quobyte-eacfea27-694c-4330-82b8-c68eb9099f39" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:00:58 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9df22124-91e1-4577-ae86-25dddb3150f4 tempest-GroupsV314Test-1044020990 None] Lock "cinder-quobyte-eacfea27-694c-4330-82b8-c68eb9099f39" acquired by "delete_volume" :: waited 0.026s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:00:58 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0505925-ea7e-47d1-b5f9-02fa45bf1d4b]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:00:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9df22124-91e1-4577-ae86-25dddb3150f4 tempest-GroupsV314Test-1044020990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eacfea27-694c-4330-82b8-c68eb9099f39 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:00:59 devstack sudo[98697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eacfea27-694c-4330-82b8-c68eb9099f39 Jun 24 05:00:59 devstack sudo[98697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:00 devstack sudo[98697]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9df22124-91e1-4577-ae86-25dddb3150f4 tempest-GroupsV314Test-1044020990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eacfea27-694c-4330-82b8-c68eb9099f39" returned: 0 in 1.567s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9df22124-91e1-4577-ae86-25dddb3150f4 tempest-GroupsV314Test-1044020990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eacfea27-694c-4330-82b8-c68eb9099f39 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:00 devstack sudo[98766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eacfea27-694c-4330-82b8-c68eb9099f39 Jun 24 05:01:00 devstack sudo[98766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:01 devstack sudo[98766]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9df22124-91e1-4577-ae86-25dddb3150f4 tempest-GroupsV314Test-1044020990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eacfea27-694c-4330-82b8-c68eb9099f39" returned: 0 in 1.128s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:01 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9df22124-91e1-4577-ae86-25dddb3150f4 tempest-GroupsV314Test-1044020990 None] Lock "cinder-quobyte-eacfea27-694c-4330-82b8-c68eb9099f39" released by "delete_volume" :: held 2.747s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:01:01 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-9df22124-91e1-4577-ae86-25dddb3150f4 tempest-GroupsV314Test-1044020990 None] Created reservations ['a8ee6303-11b5-4ac7-a5f1-16ca01051e2e'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:01:01 devstack cinder-volume[93830]: WARNING cinder.quota [None req-9df22124-91e1-4577-ae86-25dddb3150f4 tempest-GroupsV314Test-1044020990 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-436773704 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-436773704, it is now deprecated. Please use the default quota class for default quota. Jun 24 05:01:01 devstack cinder-volume[93830]: WARNING cinder.quota [None req-9df22124-91e1-4577-ae86-25dddb3150f4 tempest-GroupsV314Test-1044020990 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-436773704 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-436773704, it is now deprecated. Please use the default quota class for default quota. Jun 24 05:01:01 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-9df22124-91e1-4577-ae86-25dddb3150f4 tempest-GroupsV314Test-1044020990 None] Created reservations ['082c7abc-3d58-454e-aa22-700d894ffa2a', 'd12da6a3-f276-4f83-b689-e1e471044402', '62e012da-32f3-48d8-b41a-279ab3b5f53c', '9aac5533-92a8-4db5-ba67-dc8a921b9567'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:01:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9df22124-91e1-4577-ae86-25dddb3150f4 tempest-GroupsV314Test-1044020990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:01:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9df22124-91e1-4577-ae86-25dddb3150f4 tempest-GroupsV314Test-1044020990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:01:01 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-9df22124-91e1-4577-ae86-25dddb3150f4 tempest-GroupsV314Test-1044020990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:01:01 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-9df22124-91e1-4577-ae86-25dddb3150f4 tempest-GroupsV314Test-1044020990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:01:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9df22124-91e1-4577-ae86-25dddb3150f4 tempest-GroupsV314Test-1044020990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:01:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9df22124-91e1-4577-ae86-25dddb3150f4 tempest-GroupsV314Test-1044020990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:02 devstack sudo[98781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:01:02 devstack sudo[98781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:02 devstack sudo[98781]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9df22124-91e1-4577-ae86-25dddb3150f4 tempest-GroupsV314Test-1044020990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.718s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:02 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-9df22124-91e1-4577-ae86-25dddb3150f4 tempest-GroupsV314Test-1044020990 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:01:02 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-9df22124-91e1-4577-ae86-25dddb3150f4 tempest-GroupsV314Test-1044020990 None] Delete group completed successfully. Jun 24 05:01:03 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-ca43cfef-cf40-46e2-b019-c63f3a2c7edc tempest-GroupsV314Test-1044020990 None] Acquiring lock "cinder-quobyte-575ff5dc-fc89-4633-a9d6-54675b269a4a" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:01:03 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-ca43cfef-cf40-46e2-b019-c63f3a2c7edc tempest-GroupsV314Test-1044020990 None] Lock "cinder-quobyte-575ff5dc-fc89-4633-a9d6-54675b269a4a" acquired by "delete_volume" :: waited 0.049s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:01:03 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef756bf4-056d-4e94-96a2-33e99fb6e704]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:01:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ca43cfef-cf40-46e2-b019-c63f3a2c7edc tempest-GroupsV314Test-1044020990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:03 devstack sudo[98795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a Jun 24 05:01:03 devstack sudo[98795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:04 devstack sudo[98795]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ca43cfef-cf40-46e2-b019-c63f3a2c7edc tempest-GroupsV314Test-1044020990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a" returned: 0 in 0.960s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ca43cfef-cf40-46e2-b019-c63f3a2c7edc tempest-GroupsV314Test-1044020990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:04 devstack sudo[98801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a Jun 24 05:01:04 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:05 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ca43cfef-cf40-46e2-b019-c63f3a2c7edc tempest-GroupsV314Test-1044020990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-575ff5dc-fc89-4633-a9d6-54675b269a4a" returned: 0 in 0.690s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:05 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-ca43cfef-cf40-46e2-b019-c63f3a2c7edc tempest-GroupsV314Test-1044020990 None] Lock "cinder-quobyte-575ff5dc-fc89-4633-a9d6-54675b269a4a" released by "delete_volume" :: held 1.760s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:01:05 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-ca43cfef-cf40-46e2-b019-c63f3a2c7edc tempest-GroupsV314Test-1044020990 None] Created reservations ['ce84f6ad-334e-4248-8291-bee042c8eab6'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:01:05 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-ca43cfef-cf40-46e2-b019-c63f3a2c7edc tempest-GroupsV314Test-1044020990 None] Created reservations ['1848d428-a470-47e2-89ae-3f2176ba1ab8', '9ccbcc47-76c1-4982-b521-2e21fdbb4b65', '526c0876-c2be-4b2b-975c-e3fbb983212c', '2942e4cc-1c98-4d59-908f-cbf7f3cea2d3'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:01:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-ca43cfef-cf40-46e2-b019-c63f3a2c7edc tempest-GroupsV314Test-1044020990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:01:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-ca43cfef-cf40-46e2-b019-c63f3a2c7edc tempest-GroupsV314Test-1044020990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:01:05 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-ca43cfef-cf40-46e2-b019-c63f3a2c7edc tempest-GroupsV314Test-1044020990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:01:05 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-ca43cfef-cf40-46e2-b019-c63f3a2c7edc tempest-GroupsV314Test-1044020990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:01:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-ca43cfef-cf40-46e2-b019-c63f3a2c7edc tempest-GroupsV314Test-1044020990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:01:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ca43cfef-cf40-46e2-b019-c63f3a2c7edc tempest-GroupsV314Test-1044020990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:05 devstack sudo[98806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:01:05 devstack sudo[98806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:05 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-212189a4-5d09-4967-8c8a-a1bc1da8b4f7 req-675d2acd-fb11-4abc-bfc7-0e3013f81581 tempest-TaggedAttachmentsTest-23923640 None] Terminate volume connection completed successfully. Jun 24 05:01:05 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-212189a4-5d09-4967-8c8a-a1bc1da8b4f7 req-675d2acd-fb11-4abc-bfc7-0e3013f81581 tempest-TaggedAttachmentsTest-23923640 None] Deleting attachment 54b1dbf2-4eb3-4d96-8c03-ad7368108b86. {{(pid=93830) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 05:01:06 devstack sudo[98806]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ca43cfef-cf40-46e2-b019-c63f3a2c7edc tempest-GroupsV314Test-1044020990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.764s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:06 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-ca43cfef-cf40-46e2-b019-c63f3a2c7edc tempest-GroupsV314Test-1044020990 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:01:06 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-ca43cfef-cf40-46e2-b019-c63f3a2c7edc tempest-GroupsV314Test-1044020990 None] Delete group completed successfully. Jun 24 05:01:09 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 05:01:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:01:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:01:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:01:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:01:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:01:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:09 devstack sudo[98867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:01:09 devstack sudo[98867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:10 devstack sudo[98867]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.944s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:10 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:01:10 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager._thread_info {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 05:01:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread count: 8 {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 05:01:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread info: [<_MainThread(MainThread, started 130211312517248)>, , , , , , , ] {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 05:01:12 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-9035d2eb-c49f-4edc-85c7-f1abbbac4467 tempest-SnapshotsActionsTest-636083438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:01:12 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9035d2eb-c49f-4edc-85c7-f1abbbac4467 tempest-SnapshotsActionsTest-636083438 None] Flow 'volume_create_manager' (2d385ff0-7976-42ff-bc5f-6878b5e1fd10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:01:12 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9035d2eb-c49f-4edc-85c7-f1abbbac4467 tempest-SnapshotsActionsTest-636083438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e05bd884-4c49-4175-b20f-f98205fedd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:01:12 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9035d2eb-c49f-4edc-85c7-f1abbbac4467 tempest-SnapshotsActionsTest-636083438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e05bd884-4c49-4175-b20f-f98205fedd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1753355675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=843afbc6-3433-46e0-9c9e-d9d9c43fa8d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ee0be9066eb4a46bd72e126e0b2d220',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:01:13Z,use_quota=True,user_id='9a35077d659247ac896a077cb33f265c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:01:12 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9035d2eb-c49f-4edc-85c7-f1abbbac4467 tempest-SnapshotsActionsTest-636083438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25780d3c-91f7-4577-999f-c892ef7babc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:01:12 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9035d2eb-c49f-4edc-85c7-f1abbbac4467 tempest-SnapshotsActionsTest-636083438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25780d3c-91f7-4577-999f-c892ef7babc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:01:12 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9035d2eb-c49f-4edc-85c7-f1abbbac4467 tempest-SnapshotsActionsTest-636083438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bca41a36-1333-49df-a963-fb0355613f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:01:12 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9035d2eb-c49f-4edc-85c7-f1abbbac4467 tempest-SnapshotsActionsTest-636083438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bca41a36-1333-49df-a963-fb0355613f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '843afbc6-3433-46e0-9c9e-d9d9c43fa8d3', 'volume_name': 'volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:01:12 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9035d2eb-c49f-4edc-85c7-f1abbbac4467 tempest-SnapshotsActionsTest-636083438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d55b60db-a84a-47e2-9ba2-8ca0e3a714e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:01:12 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9035d2eb-c49f-4edc-85c7-f1abbbac4467 tempest-SnapshotsActionsTest-636083438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d55b60db-a84a-47e2-9ba2-8ca0e3a714e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:01:12 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9035d2eb-c49f-4edc-85c7-f1abbbac4467 tempest-SnapshotsActionsTest-636083438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6de651b-c2b4-45c8-b38a-bbd74885f294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:01:12 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-9035d2eb-c49f-4edc-85c7-f1abbbac4467 tempest-SnapshotsActionsTest-636083438 None] Volume 843afbc6-3433-46e0-9c9e-d9d9c43fa8d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3', 'volume_size': 1} Jun 24 05:01:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9035d2eb-c49f-4edc-85c7-f1abbbac4467 tempest-SnapshotsActionsTest-636083438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:01:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9035d2eb-c49f-4edc-85c7-f1abbbac4467 tempest-SnapshotsActionsTest-636083438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:01:12 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-9035d2eb-c49f-4edc-85c7-f1abbbac4467 tempest-SnapshotsActionsTest-636083438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1753355675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=843afbc6-3433-46e0-9c9e-d9d9c43fa8d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ee0be9066eb4a46bd72e126e0b2d220',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:01:13Z,use_quota=True,user_id='9a35077d659247ac896a077cb33f265c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:01:12 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-9035d2eb-c49f-4edc-85c7-f1abbbac4467 tempest-SnapshotsActionsTest-636083438 None] Creating volume 843afbc6-3433-46e0-9c9e-d9d9c43fa8d3 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:01:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9035d2eb-c49f-4edc-85c7-f1abbbac4467 tempest-SnapshotsActionsTest-636083438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:01:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9035d2eb-c49f-4edc-85c7-f1abbbac4467 tempest-SnapshotsActionsTest-636083438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:01:12 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-9035d2eb-c49f-4edc-85c7-f1abbbac4467 tempest-SnapshotsActionsTest-636083438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:01:12 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-9035d2eb-c49f-4edc-85c7-f1abbbac4467 tempest-SnapshotsActionsTest-636083438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:01:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9035d2eb-c49f-4edc-85c7-f1abbbac4467 tempest-SnapshotsActionsTest-636083438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:01:12 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-9035d2eb-c49f-4edc-85c7-f1abbbac4467 tempest-SnapshotsActionsTest-636083438 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:01:12 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-9035d2eb-c49f-4edc-85c7-f1abbbac4467 tempest-SnapshotsActionsTest-636083438 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:01:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9035d2eb-c49f-4edc-85c7-f1abbbac4467 tempest-SnapshotsActionsTest-636083438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:12 devstack sudo[98872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3 1073741824 Jun 24 05:01:12 devstack sudo[98872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:13 devstack sudo[98872]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9035d2eb-c49f-4edc-85c7-f1abbbac4467 tempest-SnapshotsActionsTest-636083438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3 1073741824" returned: 0 in 0.870s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9035d2eb-c49f-4edc-85c7-f1abbbac4467 tempest-SnapshotsActionsTest-636083438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:13 devstack sudo[98877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3 Jun 24 05:01:13 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:14 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:14 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9035d2eb-c49f-4edc-85c7-f1abbbac4467 tempest-SnapshotsActionsTest-636083438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3" returned: 0 in 0.651s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:14 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-9035d2eb-c49f-4edc-85c7-f1abbbac4467 tempest-SnapshotsActionsTest-636083438 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:01:14 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9035d2eb-c49f-4edc-85c7-f1abbbac4467 tempest-SnapshotsActionsTest-636083438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:01:14 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9035d2eb-c49f-4edc-85c7-f1abbbac4467 tempest-SnapshotsActionsTest-636083438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6de651b-c2b4-45c8-b38a-bbd74885f294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:01:14 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9035d2eb-c49f-4edc-85c7-f1abbbac4467 tempest-SnapshotsActionsTest-636083438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c518b1e8-f9e3-4bf7-9117-13a18a625aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:01:14 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-9035d2eb-c49f-4edc-85c7-f1abbbac4467 tempest-SnapshotsActionsTest-636083438 None] Volume volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3 (843afbc6-3433-46e0-9c9e-d9d9c43fa8d3): created successfully Jun 24 05:01:14 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9035d2eb-c49f-4edc-85c7-f1abbbac4467 tempest-SnapshotsActionsTest-636083438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c518b1e8-f9e3-4bf7-9117-13a18a625aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:01:14 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9035d2eb-c49f-4edc-85c7-f1abbbac4467 tempest-SnapshotsActionsTest-636083438 None] Flow 'volume_create_manager' (2d385ff0-7976-42ff-bc5f-6878b5e1fd10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:01:14 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-9035d2eb-c49f-4edc-85c7-f1abbbac4467 tempest-SnapshotsActionsTest-636083438 None] Created volume successfully. Jun 24 05:01:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-d6b15c14-ad2b-4b7b-98c9-ae4432513c75 tempest-SnapshotsActionsTest-636083438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:01:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-d6b15c14-ad2b-4b7b-98c9-ae4432513c75 tempest-SnapshotsActionsTest-636083438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:01:15 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-d6b15c14-ad2b-4b7b-98c9-ae4432513c75 tempest-SnapshotsActionsTest-636083438 None] Creating offline snapshot 23109391-1063-4402-abbc-8a084bc76da0 of volume 843afbc6-3433-46e0-9c9e-d9d9c43fa8d3 {{(pid=93830) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 05:01:15 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2074ec1-460c-4513-b16e-8aea93883992]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:01:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d6b15c14-ad2b-4b7b-98c9-ae4432513c75 tempest-SnapshotsActionsTest-636083438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:15 devstack sudo[98897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3 Jun 24 05:01:15 devstack sudo[98897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:15 devstack sudo[98897]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d6b15c14-ad2b-4b7b-98c9-ae4432513c75 tempest-SnapshotsActionsTest-636083438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3" returned: 0 in 0.779s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d6b15c14-ad2b-4b7b-98c9-ae4432513c75 tempest-SnapshotsActionsTest-636083438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0 1G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:16 devstack sudo[98906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0 1G Jun 24 05:01:16 devstack sudo[98906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:17 devstack sudo[98906]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d6b15c14-ad2b-4b7b-98c9-ae4432513c75 tempest-SnapshotsActionsTest-636083438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0 1G" returned: 0 in 1.209s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d6b15c14-ad2b-4b7b-98c9-ae4432513c75 tempest-SnapshotsActionsTest-636083438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:17 devstack sudo[98950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0 Jun 24 05:01:17 devstack sudo[98950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:17 devstack sudo[98950]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d6b15c14-ad2b-4b7b-98c9-ae4432513c75 tempest-SnapshotsActionsTest-636083438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0" returned: 0 in 0.796s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:17 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-d6b15c14-ad2b-4b7b-98c9-ae4432513c75 tempest-SnapshotsActionsTest-636083438 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0 is being set with open permissions: ugo+rw Jun 24 05:01:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d6b15c14-ad2b-4b7b-98c9-ae4432513c75 tempest-SnapshotsActionsTest-636083438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:17 devstack sudo[98959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0 Jun 24 05:01:17 devstack sudo[98959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:18 devstack sudo[98959]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d6b15c14-ad2b-4b7b-98c9-ae4432513c75 tempest-SnapshotsActionsTest-636083438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0" returned: 0 in 0.736s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d6b15c14-ad2b-4b7b-98c9-ae4432513c75 tempest-SnapshotsActionsTest-636083438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:18 devstack sudo[98964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.info Jun 24 05:01:18 devstack sudo[98964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:19 devstack sudo[98964]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d6b15c14-ad2b-4b7b-98c9-ae4432513c75 tempest-SnapshotsActionsTest-636083438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.info" returned: 0 in 0.671s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:19 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-d6b15c14-ad2b-4b7b-98c9-ae4432513c75 tempest-SnapshotsActionsTest-636083438 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.info is being set with open permissions: ugo+rw Jun 24 05:01:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d6b15c14-ad2b-4b7b-98c9-ae4432513c75 tempest-SnapshotsActionsTest-636083438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:19 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-09079232-40aa-43e3-aee8-1b9df52e6da0 req-1348a2fd-2479-4268-8fa2-7cb15169e997 tempest-AttachVolumeTestJSON-729142982 None] Terminate volume connection completed successfully. Jun 24 05:01:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-09079232-40aa-43e3-aee8-1b9df52e6da0 req-1348a2fd-2479-4268-8fa2-7cb15169e997 tempest-AttachVolumeTestJSON-729142982 None] Deleting attachment a73f3370-99cb-484b-bc53-453b55bfcff6. {{(pid=93830) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 05:01:19 devstack sudo[98972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.info Jun 24 05:01:19 devstack sudo[98972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:20 devstack sudo[98972]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d6b15c14-ad2b-4b7b-98c9-ae4432513c75 tempest-SnapshotsActionsTest-636083438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.info" returned: 0 in 0.653s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-d6b15c14-ad2b-4b7b-98c9-ae4432513c75 tempest-SnapshotsActionsTest-636083438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.948s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:01:20 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-d6b15c14-ad2b-4b7b-98c9-ae4432513c75 tempest-SnapshotsActionsTest-636083438 None] Create snapshot completed successfully Jun 24 05:01:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9a863944-23ab-4bdf-9a00-c054f8ea47c3 tempest-SnapshotsActionsTest-636083438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:01:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9a863944-23ab-4bdf-9a00-c054f8ea47c3 tempest-SnapshotsActionsTest-636083438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:01:20 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-9a863944-23ab-4bdf-9a00-c054f8ea47c3 tempest-SnapshotsActionsTest-636083438 None] Creating offline snapshot a1b7ddec-6877-46b8-bc6c-470746e4494d of volume 843afbc6-3433-46e0-9c9e-d9d9c43fa8d3 {{(pid=93830) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 05:01:20 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[86554036-467a-4a2f-94b5-e5ffc2341933]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:01:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9a863944-23ab-4bdf-9a00-c054f8ea47c3 tempest-SnapshotsActionsTest-636083438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:21 devstack sudo[98977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0 Jun 24 05:01:21 devstack sudo[98977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:21 devstack sudo[98977]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9a863944-23ab-4bdf-9a00-c054f8ea47c3 tempest-SnapshotsActionsTest-636083438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0" returned: 0 in 0.867s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:21 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-9a863944-23ab-4bdf-9a00-c054f8ea47c3 tempest-SnapshotsActionsTest-636083438 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:01:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9a863944-23ab-4bdf-9a00-c054f8ea47c3 tempest-SnapshotsActionsTest-636083438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.a1b7ddec-6877-46b8-bc6c-470746e4494d 1G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:21 devstack sudo[98983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.a1b7ddec-6877-46b8-bc6c-470746e4494d 1G Jun 24 05:01:21 devstack sudo[98983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:23 devstack sudo[98983]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9a863944-23ab-4bdf-9a00-c054f8ea47c3 tempest-SnapshotsActionsTest-636083438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.a1b7ddec-6877-46b8-bc6c-470746e4494d 1G" returned: 0 in 1.625s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9a863944-23ab-4bdf-9a00-c054f8ea47c3 tempest-SnapshotsActionsTest-636083438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.a1b7ddec-6877-46b8-bc6c-470746e4494d {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:23 devstack sudo[99078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.a1b7ddec-6877-46b8-bc6c-470746e4494d Jun 24 05:01:23 devstack sudo[99078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:24 devstack sudo[99078]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9a863944-23ab-4bdf-9a00-c054f8ea47c3 tempest-SnapshotsActionsTest-636083438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.a1b7ddec-6877-46b8-bc6c-470746e4494d" returned: 0 in 0.820s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:24 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-9a863944-23ab-4bdf-9a00-c054f8ea47c3 tempest-SnapshotsActionsTest-636083438 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.a1b7ddec-6877-46b8-bc6c-470746e4494d is being set with open permissions: ugo+rw Jun 24 05:01:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9a863944-23ab-4bdf-9a00-c054f8ea47c3 tempest-SnapshotsActionsTest-636083438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.a1b7ddec-6877-46b8-bc6c-470746e4494d {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:24 devstack sudo[99087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.a1b7ddec-6877-46b8-bc6c-470746e4494d Jun 24 05:01:24 devstack sudo[99087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:25 devstack sudo[99087]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9a863944-23ab-4bdf-9a00-c054f8ea47c3 tempest-SnapshotsActionsTest-636083438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.a1b7ddec-6877-46b8-bc6c-470746e4494d" returned: 0 in 1.103s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9a863944-23ab-4bdf-9a00-c054f8ea47c3 tempest-SnapshotsActionsTest-636083438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.545s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:01:25 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-9a863944-23ab-4bdf-9a00-c054f8ea47c3 tempest-SnapshotsActionsTest-636083438 None] Create snapshot completed successfully Jun 24 05:01:25 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-abaa48ef-8a5b-4c5d-99e2-01c9b2c6b33b tempest-TaggedAttachmentsTest-23923640 None] Acquiring lock "cinder-a2bbebdb-c653-487e-8182-e84c72c3fe7b-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:01:25 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-abaa48ef-8a5b-4c5d-99e2-01c9b2c6b33b tempest-TaggedAttachmentsTest-23923640 None] Lock "cinder-a2bbebdb-c653-487e-8182-e84c72c3fe7b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:01:25 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-abaa48ef-8a5b-4c5d-99e2-01c9b2c6b33b tempest-TaggedAttachmentsTest-23923640 None] Acquiring lock "cinder-quobyte-a2bbebdb-c653-487e-8182-e84c72c3fe7b" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:01:25 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-abaa48ef-8a5b-4c5d-99e2-01c9b2c6b33b tempest-TaggedAttachmentsTest-23923640 None] Lock "cinder-quobyte-a2bbebdb-c653-487e-8182-e84c72c3fe7b" acquired by "delete_volume" :: waited 0.018s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:01:25 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7a9c8b-da6d-4ff0-80f0-661bb0f60a43]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:01:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-abaa48ef-8a5b-4c5d-99e2-01c9b2c6b33b tempest-TaggedAttachmentsTest-23923640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a2bbebdb-c653-487e-8182-e84c72c3fe7b {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:25 devstack sudo[99154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a2bbebdb-c653-487e-8182-e84c72c3fe7b Jun 24 05:01:25 devstack sudo[99154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:26 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-d70fea31-0ec4-4b13-9626-55b1f369160c tempest-SnapshotsActionsTest-204672682 None] Acquiring lock "cinder-a1b7ddec-6877-46b8-bc6c-470746e4494d-delete_snapshot" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:01:26 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-d70fea31-0ec4-4b13-9626-55b1f369160c tempest-SnapshotsActionsTest-204672682 None] Lock "cinder-a1b7ddec-6877-46b8-bc6c-470746e4494d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:01:26 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-d70fea31-0ec4-4b13-9626-55b1f369160c tempest-SnapshotsActionsTest-204672682 None] Acquiring lock "cinder-quobyte-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:01:26 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-d70fea31-0ec4-4b13-9626-55b1f369160c tempest-SnapshotsActionsTest-204672682 None] Lock "cinder-quobyte-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:01:26 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-d70fea31-0ec4-4b13-9626-55b1f369160c tempest-SnapshotsActionsTest-204672682 None] Acquiring lock "cinder-quobyte-a1b7ddec-6877-46b8-bc6c-470746e4494d" by "_delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:01:26 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-d70fea31-0ec4-4b13-9626-55b1f369160c tempest-SnapshotsActionsTest-204672682 None] Lock "cinder-quobyte-a1b7ddec-6877-46b8-bc6c-470746e4494d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:01:26 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-d70fea31-0ec4-4b13-9626-55b1f369160c tempest-SnapshotsActionsTest-204672682 None] Deleting offline snapshot a1b7ddec-6877-46b8-bc6c-470746e4494d of volume 843afbc6-3433-46e0-9c9e-d9d9c43fa8d3 {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 05:01:26 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-d70fea31-0ec4-4b13-9626-55b1f369160c tempest-SnapshotsActionsTest-204672682 None] snapshot_file for this snap is: volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.a1b7ddec-6877-46b8-bc6c-470746e4494d {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 05:01:26 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4680476-00f3-4d7e-8fec-3fc306c59521]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:01:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d70fea31-0ec4-4b13-9626-55b1f369160c tempest-SnapshotsActionsTest-204672682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.a1b7ddec-6877-46b8-bc6c-470746e4494d {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:26 devstack sudo[99158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.a1b7ddec-6877-46b8-bc6c-470746e4494d Jun 24 05:01:26 devstack sudo[99158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:26 devstack sudo[99154]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-abaa48ef-8a5b-4c5d-99e2-01c9b2c6b33b tempest-TaggedAttachmentsTest-23923640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a2bbebdb-c653-487e-8182-e84c72c3fe7b" returned: 0 in 0.830s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-abaa48ef-8a5b-4c5d-99e2-01c9b2c6b33b tempest-TaggedAttachmentsTest-23923640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a2bbebdb-c653-487e-8182-e84c72c3fe7b {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:26 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a2bbebdb-c653-487e-8182-e84c72c3fe7b Jun 24 05:01:26 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:27 devstack sudo[99158]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d70fea31-0ec4-4b13-9626-55b1f369160c tempest-SnapshotsActionsTest-204672682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.a1b7ddec-6877-46b8-bc6c-470746e4494d" returned: 0 in 0.977s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:27 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-d70fea31-0ec4-4b13-9626-55b1f369160c tempest-SnapshotsActionsTest-204672682 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:01:27 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f506672-37a6-437d-b979-266a5990fa6e]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:01:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d70fea31-0ec4-4b13-9626-55b1f369160c tempest-SnapshotsActionsTest-204672682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:27 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:27 devstack sudo[99171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0 Jun 24 05:01:27 devstack sudo[99171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-abaa48ef-8a5b-4c5d-99e2-01c9b2c6b33b tempest-TaggedAttachmentsTest-23923640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a2bbebdb-c653-487e-8182-e84c72c3fe7b" returned: 0 in 0.923s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:27 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-abaa48ef-8a5b-4c5d-99e2-01c9b2c6b33b tempest-TaggedAttachmentsTest-23923640 None] Lock "cinder-quobyte-a2bbebdb-c653-487e-8182-e84c72c3fe7b" released by "delete_volume" :: held 1.798s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:01:27 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-abaa48ef-8a5b-4c5d-99e2-01c9b2c6b33b tempest-TaggedAttachmentsTest-23923640 None] Created reservations ['e5e3e453-876c-4876-b46a-b8bf998952d9', '306026cb-d4a6-4383-ac3d-1b28c919a159', '9e63bc06-07ec-4e52-8245-380621dab1c0', '01c2d909-aa15-4dc7-9921-25af8d2f102f'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:01:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-abaa48ef-8a5b-4c5d-99e2-01c9b2c6b33b tempest-TaggedAttachmentsTest-23923640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:01:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-abaa48ef-8a5b-4c5d-99e2-01c9b2c6b33b tempest-TaggedAttachmentsTest-23923640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:01:27 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-abaa48ef-8a5b-4c5d-99e2-01c9b2c6b33b tempest-TaggedAttachmentsTest-23923640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:01:27 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-abaa48ef-8a5b-4c5d-99e2-01c9b2c6b33b tempest-TaggedAttachmentsTest-23923640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:01:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-abaa48ef-8a5b-4c5d-99e2-01c9b2c6b33b tempest-TaggedAttachmentsTest-23923640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:01:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-abaa48ef-8a5b-4c5d-99e2-01c9b2c6b33b tempest-TaggedAttachmentsTest-23923640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:27 devstack sudo[99173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:01:27 devstack sudo[99173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:28 devstack sudo[99171]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d70fea31-0ec4-4b13-9626-55b1f369160c tempest-SnapshotsActionsTest-204672682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0" returned: 0 in 0.883s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:28 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-d70fea31-0ec4-4b13-9626-55b1f369160c tempest-SnapshotsActionsTest-204672682 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:01:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d70fea31-0ec4-4b13-9626-55b1f369160c tempest-SnapshotsActionsTest-204672682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.a1b7ddec-6877-46b8-bc6c-470746e4494d {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:28 devstack sudo[99179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.a1b7ddec-6877-46b8-bc6c-470746e4494d Jun 24 05:01:28 devstack sudo[99179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:28 devstack sudo[99173]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-abaa48ef-8a5b-4c5d-99e2-01c9b2c6b33b tempest-TaggedAttachmentsTest-23923640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.821s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:28 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-abaa48ef-8a5b-4c5d-99e2-01c9b2c6b33b tempest-TaggedAttachmentsTest-23923640 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:01:28 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-abaa48ef-8a5b-4c5d-99e2-01c9b2c6b33b tempest-TaggedAttachmentsTest-23923640 None] Deleted volume successfully. Jun 24 05:01:28 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-abaa48ef-8a5b-4c5d-99e2-01c9b2c6b33b tempest-TaggedAttachmentsTest-23923640 None] Lock "cinder-a2bbebdb-c653-487e-8182-e84c72c3fe7b-delete_volume" released by "delete_volume" :: held 2.852s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:01:29 devstack sudo[99179]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d70fea31-0ec4-4b13-9626-55b1f369160c tempest-SnapshotsActionsTest-204672682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.a1b7ddec-6877-46b8-bc6c-470746e4494d" returned: 0 in 0.885s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d70fea31-0ec4-4b13-9626-55b1f369160c tempest-SnapshotsActionsTest-204672682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.a1b7ddec-6877-46b8-bc6c-470746e4494d {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:29 devstack sudo[99185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.a1b7ddec-6877-46b8-bc6c-470746e4494d Jun 24 05:01:29 devstack sudo[99185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:30 devstack sudo[99185]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d70fea31-0ec4-4b13-9626-55b1f369160c tempest-SnapshotsActionsTest-204672682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.a1b7ddec-6877-46b8-bc6c-470746e4494d" returned: 0 in 0.723s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:30 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-d70fea31-0ec4-4b13-9626-55b1f369160c tempest-SnapshotsActionsTest-204672682 None] Lock "cinder-quobyte-a1b7ddec-6877-46b8-bc6c-470746e4494d" released by "_delete_snapshot" :: held 3.578s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:01:30 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-d70fea31-0ec4-4b13-9626-55b1f369160c tempest-SnapshotsActionsTest-204672682 None] Lock "cinder-quobyte-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3" released by "delete_snapshot" :: held 3.604s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:01:30 devstack cinder-volume[93830]: WARNING cinder.quota [None req-d70fea31-0ec4-4b13-9626-55b1f369160c tempest-SnapshotsActionsTest-204672682 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 24 05:01:30 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-d70fea31-0ec4-4b13-9626-55b1f369160c tempest-SnapshotsActionsTest-204672682 None] Created reservations ['a5a82631-e3f0-4344-9e29-6d6023f20752', 'c3a5763d-a0f6-4f4d-99d7-48e6f3a4ca9f', '643565a7-4461-449b-ae75-14a8ff62e8e8', '3e72190d-79b8-41e1-9f3e-157c30724689'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:01:30 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-d70fea31-0ec4-4b13-9626-55b1f369160c tempest-SnapshotsActionsTest-204672682 None] Delete snapshot completed successfully. Jun 24 05:01:30 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-d70fea31-0ec4-4b13-9626-55b1f369160c tempest-SnapshotsActionsTest-204672682 None] Lock "cinder-a1b7ddec-6877-46b8-bc6c-470746e4494d-delete_snapshot" released by "delete_snapshot" :: held 3.772s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:01:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-faa7ac9b-dcdc-4f0e-ab55-8fed01640ca0 tempest-SnapshotsActionsTest-636083438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:01:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-faa7ac9b-dcdc-4f0e-ab55-8fed01640ca0 tempest-SnapshotsActionsTest-636083438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:01:31 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-faa7ac9b-dcdc-4f0e-ab55-8fed01640ca0 tempest-SnapshotsActionsTest-636083438 None] Creating offline snapshot bd94806d-345a-4e54-aed9-b5dabb05749f of volume 843afbc6-3433-46e0-9c9e-d9d9c43fa8d3 {{(pid=93830) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 05:01:31 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[853ebe2d-82e4-4a3d-b49a-c80bcdfa93e1]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:01:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-faa7ac9b-dcdc-4f0e-ab55-8fed01640ca0 tempest-SnapshotsActionsTest-636083438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:31 devstack sudo[99191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0 Jun 24 05:01:31 devstack sudo[99191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:32 devstack sudo[99191]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-faa7ac9b-dcdc-4f0e-ab55-8fed01640ca0 tempest-SnapshotsActionsTest-636083438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0" returned: 0 in 1.117s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:32 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-faa7ac9b-dcdc-4f0e-ab55-8fed01640ca0 tempest-SnapshotsActionsTest-636083438 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:01:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-faa7ac9b-dcdc-4f0e-ab55-8fed01640ca0 tempest-SnapshotsActionsTest-636083438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.bd94806d-345a-4e54-aed9-b5dabb05749f 1G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:32 devstack sudo[99202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.bd94806d-345a-4e54-aed9-b5dabb05749f 1G Jun 24 05:01:32 devstack sudo[99202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:32 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-4885658c-37e0-4834-9a84-d9a4dc737a2d tempest-AttachVolumeShelveTestJSON-1590289362 None] Acquiring lock "cinder-f5312a76-36b2-4de5-9efd-0c6e39849629-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:01:32 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-4885658c-37e0-4834-9a84-d9a4dc737a2d tempest-AttachVolumeShelveTestJSON-1590289362 None] Lock "cinder-f5312a76-36b2-4de5-9efd-0c6e39849629-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:01:32 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-4885658c-37e0-4834-9a84-d9a4dc737a2d tempest-AttachVolumeShelveTestJSON-1590289362 None] Acquiring lock "cinder-quobyte-f5312a76-36b2-4de5-9efd-0c6e39849629" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:01:32 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-4885658c-37e0-4834-9a84-d9a4dc737a2d tempest-AttachVolumeShelveTestJSON-1590289362 None] Lock "cinder-quobyte-f5312a76-36b2-4de5-9efd-0c6e39849629" acquired by "delete_volume" :: waited 0.021s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:01:32 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[174bc5dc-3e3e-417e-aa82-56e6a519682e]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:01:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4885658c-37e0-4834-9a84-d9a4dc737a2d tempest-AttachVolumeShelveTestJSON-1590289362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f5312a76-36b2-4de5-9efd-0c6e39849629 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:32 devstack sudo[99214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f5312a76-36b2-4de5-9efd-0c6e39849629 Jun 24 05:01:32 devstack sudo[99214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:33 devstack sudo[99202]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-faa7ac9b-dcdc-4f0e-ab55-8fed01640ca0 tempest-SnapshotsActionsTest-636083438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.bd94806d-345a-4e54-aed9-b5dabb05749f 1G" returned: 0 in 1.124s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-faa7ac9b-dcdc-4f0e-ab55-8fed01640ca0 tempest-SnapshotsActionsTest-636083438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.bd94806d-345a-4e54-aed9-b5dabb05749f {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:33 devstack sudo[99220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.bd94806d-345a-4e54-aed9-b5dabb05749f Jun 24 05:01:33 devstack sudo[99220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:33 devstack sudo[99214]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4885658c-37e0-4834-9a84-d9a4dc737a2d tempest-AttachVolumeShelveTestJSON-1590289362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f5312a76-36b2-4de5-9efd-0c6e39849629" returned: 0 in 0.895s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4885658c-37e0-4834-9a84-d9a4dc737a2d tempest-AttachVolumeShelveTestJSON-1590289362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f5312a76-36b2-4de5-9efd-0c6e39849629 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:33 devstack sudo[99236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f5312a76-36b2-4de5-9efd-0c6e39849629 Jun 24 05:01:33 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:34 devstack sudo[99220]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-faa7ac9b-dcdc-4f0e-ab55-8fed01640ca0 tempest-SnapshotsActionsTest-636083438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.bd94806d-345a-4e54-aed9-b5dabb05749f" returned: 0 in 1.025s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:34 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-faa7ac9b-dcdc-4f0e-ab55-8fed01640ca0 tempest-SnapshotsActionsTest-636083438 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.bd94806d-345a-4e54-aed9-b5dabb05749f is being set with open permissions: ugo+rw Jun 24 05:01:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-faa7ac9b-dcdc-4f0e-ab55-8fed01640ca0 tempest-SnapshotsActionsTest-636083438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.bd94806d-345a-4e54-aed9-b5dabb05749f {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:34 devstack sudo[99267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.bd94806d-345a-4e54-aed9-b5dabb05749f Jun 24 05:01:34 devstack sudo[99267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:34 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4885658c-37e0-4834-9a84-d9a4dc737a2d tempest-AttachVolumeShelveTestJSON-1590289362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f5312a76-36b2-4de5-9efd-0c6e39849629" returned: 0 in 0.998s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:34 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-4885658c-37e0-4834-9a84-d9a4dc737a2d tempest-AttachVolumeShelveTestJSON-1590289362 None] Lock "cinder-quobyte-f5312a76-36b2-4de5-9efd-0c6e39849629" released by "delete_volume" :: held 1.991s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:01:34 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-4885658c-37e0-4834-9a84-d9a4dc737a2d tempest-AttachVolumeShelveTestJSON-1590289362 None] Created reservations ['3ae3c580-05c7-4106-8861-638ce3fcab93', '0067a2fa-65e1-4336-8117-3cd3731842e1', 'e01222e7-c5a3-4b0e-8881-87acae58740b', 'e8468371-805c-4bd8-91ac-97cb7a363b30'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:01:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4885658c-37e0-4834-9a84-d9a4dc737a2d tempest-AttachVolumeShelveTestJSON-1590289362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:01:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4885658c-37e0-4834-9a84-d9a4dc737a2d tempest-AttachVolumeShelveTestJSON-1590289362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:01:35 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-4885658c-37e0-4834-9a84-d9a4dc737a2d tempest-AttachVolumeShelveTestJSON-1590289362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:01:35 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-4885658c-37e0-4834-9a84-d9a4dc737a2d tempest-AttachVolumeShelveTestJSON-1590289362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:01:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4885658c-37e0-4834-9a84-d9a4dc737a2d tempest-AttachVolumeShelveTestJSON-1590289362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:01:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4885658c-37e0-4834-9a84-d9a4dc737a2d tempest-AttachVolumeShelveTestJSON-1590289362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:35 devstack sudo[99306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:01:35 devstack sudo[99306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:35 devstack sudo[99267]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-faa7ac9b-dcdc-4f0e-ab55-8fed01640ca0 tempest-SnapshotsActionsTest-636083438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.bd94806d-345a-4e54-aed9-b5dabb05749f" returned: 0 in 1.200s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-faa7ac9b-dcdc-4f0e-ab55-8fed01640ca0 tempest-SnapshotsActionsTest-636083438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.597s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:01:35 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-faa7ac9b-dcdc-4f0e-ab55-8fed01640ca0 tempest-SnapshotsActionsTest-636083438 None] Create snapshot completed successfully Jun 24 05:01:36 devstack sudo[99306]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4885658c-37e0-4834-9a84-d9a4dc737a2d tempest-AttachVolumeShelveTestJSON-1590289362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 1.004s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:36 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-4885658c-37e0-4834-9a84-d9a4dc737a2d tempest-AttachVolumeShelveTestJSON-1590289362 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:01:36 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-4885658c-37e0-4834-9a84-d9a4dc737a2d tempest-AttachVolumeShelveTestJSON-1590289362 None] Deleted volume successfully. Jun 24 05:01:36 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-4885658c-37e0-4834-9a84-d9a4dc737a2d tempest-AttachVolumeShelveTestJSON-1590289362 None] Lock "cinder-f5312a76-36b2-4de5-9efd-0c6e39849629-delete_volume" released by "delete_volume" :: held 3.383s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:01:36 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-1792abca-c09b-43b1-9828-d3a5d5f526d5 tempest-SnapshotsActionsTest-204672682 None] Acquiring lock "cinder-bd94806d-345a-4e54-aed9-b5dabb05749f-delete_snapshot" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:01:36 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-1792abca-c09b-43b1-9828-d3a5d5f526d5 tempest-SnapshotsActionsTest-204672682 None] Lock "cinder-bd94806d-345a-4e54-aed9-b5dabb05749f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:01:36 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-1792abca-c09b-43b1-9828-d3a5d5f526d5 tempest-SnapshotsActionsTest-204672682 None] Acquiring lock "cinder-quobyte-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:01:36 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-1792abca-c09b-43b1-9828-d3a5d5f526d5 tempest-SnapshotsActionsTest-204672682 None] Lock "cinder-quobyte-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:01:36 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-1792abca-c09b-43b1-9828-d3a5d5f526d5 tempest-SnapshotsActionsTest-204672682 None] Acquiring lock "cinder-quobyte-bd94806d-345a-4e54-aed9-b5dabb05749f" by "_delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:01:36 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-1792abca-c09b-43b1-9828-d3a5d5f526d5 tempest-SnapshotsActionsTest-204672682 None] Lock "cinder-quobyte-bd94806d-345a-4e54-aed9-b5dabb05749f" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:01:36 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-1792abca-c09b-43b1-9828-d3a5d5f526d5 tempest-SnapshotsActionsTest-204672682 None] Deleting offline snapshot bd94806d-345a-4e54-aed9-b5dabb05749f of volume 843afbc6-3433-46e0-9c9e-d9d9c43fa8d3 {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 05:01:36 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-1792abca-c09b-43b1-9828-d3a5d5f526d5 tempest-SnapshotsActionsTest-204672682 None] snapshot_file for this snap is: volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.bd94806d-345a-4e54-aed9-b5dabb05749f {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 05:01:36 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed19a6a0-bd1d-4b1d-896b-029cbf68e0f9]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:01:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1792abca-c09b-43b1-9828-d3a5d5f526d5 tempest-SnapshotsActionsTest-204672682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.bd94806d-345a-4e54-aed9-b5dabb05749f {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:36 devstack sudo[99324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.bd94806d-345a-4e54-aed9-b5dabb05749f Jun 24 05:01:36 devstack sudo[99324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:38 devstack sudo[99324]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1792abca-c09b-43b1-9828-d3a5d5f526d5 tempest-SnapshotsActionsTest-204672682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.bd94806d-345a-4e54-aed9-b5dabb05749f" returned: 0 in 1.411s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:38 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-1792abca-c09b-43b1-9828-d3a5d5f526d5 tempest-SnapshotsActionsTest-204672682 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:01:38 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47a8650-a84a-4f7c-838f-684d9a74f130]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:01:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1792abca-c09b-43b1-9828-d3a5d5f526d5 tempest-SnapshotsActionsTest-204672682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:38 devstack sudo[99332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0 Jun 24 05:01:38 devstack sudo[99332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:39 devstack sudo[99332]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1792abca-c09b-43b1-9828-d3a5d5f526d5 tempest-SnapshotsActionsTest-204672682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0" returned: 0 in 1.125s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:39 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-1792abca-c09b-43b1-9828-d3a5d5f526d5 tempest-SnapshotsActionsTest-204672682 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:01:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1792abca-c09b-43b1-9828-d3a5d5f526d5 tempest-SnapshotsActionsTest-204672682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.bd94806d-345a-4e54-aed9-b5dabb05749f {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:39 devstack sudo[99339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.bd94806d-345a-4e54-aed9-b5dabb05749f Jun 24 05:01:39 devstack sudo[99339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:40 devstack sudo[99339]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1792abca-c09b-43b1-9828-d3a5d5f526d5 tempest-SnapshotsActionsTest-204672682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.bd94806d-345a-4e54-aed9-b5dabb05749f" returned: 0 in 1.018s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1792abca-c09b-43b1-9828-d3a5d5f526d5 tempest-SnapshotsActionsTest-204672682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.bd94806d-345a-4e54-aed9-b5dabb05749f {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:40 devstack sudo[99346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.bd94806d-345a-4e54-aed9-b5dabb05749f Jun 24 05:01:40 devstack sudo[99346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:41 devstack sudo[99346]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1792abca-c09b-43b1-9828-d3a5d5f526d5 tempest-SnapshotsActionsTest-204672682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.bd94806d-345a-4e54-aed9-b5dabb05749f" returned: 0 in 0.861s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:41 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-1792abca-c09b-43b1-9828-d3a5d5f526d5 tempest-SnapshotsActionsTest-204672682 None] Lock "cinder-quobyte-bd94806d-345a-4e54-aed9-b5dabb05749f" released by "_delete_snapshot" :: held 4.568s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:01:41 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-1792abca-c09b-43b1-9828-d3a5d5f526d5 tempest-SnapshotsActionsTest-204672682 None] Lock "cinder-quobyte-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3" released by "delete_snapshot" :: held 4.604s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:01:41 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:SELECT=57,cinder:UPDATE=61,cinder:INSERT=11,cinder:DELETE=1 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:01:41 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-1792abca-c09b-43b1-9828-d3a5d5f526d5 tempest-SnapshotsActionsTest-204672682 None] Created reservations ['3d72bf60-2ab8-4e03-aab7-cd2e20758eea', '4fe474ea-8791-4a03-938e-2bb111959bd9', 'bd44a429-b696-420b-aabc-395f3fd49309', 'd47bb8c8-43fd-4514-a4d6-f5bfd233b068'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:01:41 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-1792abca-c09b-43b1-9828-d3a5d5f526d5 tempest-SnapshotsActionsTest-204672682 None] Delete snapshot completed successfully. Jun 24 05:01:41 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-1792abca-c09b-43b1-9828-d3a5d5f526d5 tempest-SnapshotsActionsTest-204672682 None] Lock "cinder-bd94806d-345a-4e54-aed9-b5dabb05749f-delete_snapshot" released by "delete_snapshot" :: held 4.859s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:01:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-c8012312-695a-4f7b-81d9-635e22e2b188 tempest-SnapshotsActionsTest-636083438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:01:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-c8012312-695a-4f7b-81d9-635e22e2b188 tempest-SnapshotsActionsTest-636083438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:01:42 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-c8012312-695a-4f7b-81d9-635e22e2b188 tempest-SnapshotsActionsTest-636083438 None] Creating offline snapshot 4fd81087-4398-40c4-bbe5-15e791073e3f of volume 843afbc6-3433-46e0-9c9e-d9d9c43fa8d3 {{(pid=93830) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 05:01:42 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e5b9c6-190a-4417-b513-d6751d4a9e2b]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:01:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c8012312-695a-4f7b-81d9-635e22e2b188 tempest-SnapshotsActionsTest-636083438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:42 devstack sudo[99350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0 Jun 24 05:01:42 devstack sudo[99350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:43 devstack sudo[99350]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c8012312-695a-4f7b-81d9-635e22e2b188 tempest-SnapshotsActionsTest-636083438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0" returned: 0 in 1.222s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:43 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-c8012312-695a-4f7b-81d9-635e22e2b188 tempest-SnapshotsActionsTest-636083438 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:01:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c8012312-695a-4f7b-81d9-635e22e2b188 tempest-SnapshotsActionsTest-636083438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.4fd81087-4398-40c4-bbe5-15e791073e3f 1G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:43 devstack sudo[99356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.4fd81087-4398-40c4-bbe5-15e791073e3f 1G Jun 24 05:01:43 devstack sudo[99356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:44 devstack sudo[99356]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c8012312-695a-4f7b-81d9-635e22e2b188 tempest-SnapshotsActionsTest-636083438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.4fd81087-4398-40c4-bbe5-15e791073e3f 1G" returned: 0 in 1.022s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c8012312-695a-4f7b-81d9-635e22e2b188 tempest-SnapshotsActionsTest-636083438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.4fd81087-4398-40c4-bbe5-15e791073e3f {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:44 devstack sudo[99362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.4fd81087-4398-40c4-bbe5-15e791073e3f Jun 24 05:01:44 devstack sudo[99362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:45 devstack sudo[99362]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c8012312-695a-4f7b-81d9-635e22e2b188 tempest-SnapshotsActionsTest-636083438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.4fd81087-4398-40c4-bbe5-15e791073e3f" returned: 0 in 0.882s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:45 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-c8012312-695a-4f7b-81d9-635e22e2b188 tempest-SnapshotsActionsTest-636083438 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.4fd81087-4398-40c4-bbe5-15e791073e3f is being set with open permissions: ugo+rw Jun 24 05:01:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c8012312-695a-4f7b-81d9-635e22e2b188 tempest-SnapshotsActionsTest-636083438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.4fd81087-4398-40c4-bbe5-15e791073e3f {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:45 devstack sudo[99368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.4fd81087-4398-40c4-bbe5-15e791073e3f Jun 24 05:01:45 devstack sudo[99368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:46 devstack sudo[99368]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c8012312-695a-4f7b-81d9-635e22e2b188 tempest-SnapshotsActionsTest-636083438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.4fd81087-4398-40c4-bbe5-15e791073e3f" returned: 0 in 0.745s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-c8012312-695a-4f7b-81d9-635e22e2b188 tempest-SnapshotsActionsTest-636083438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.991s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:01:46 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fc005035-ce15-4f1e-9db6-4bd31734b266 tempest-BackendsCapabilitiesAdminTestsJSON-776187437 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757827758789, 'free_capacity_gb': 1775.757827758789, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93830) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 24 05:01:46 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-c8012312-695a-4f7b-81d9-635e22e2b188 tempest-SnapshotsActionsTest-636083438 None] Create snapshot completed successfully Jun 24 05:01:46 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-489ea233-8222-4eed-b7e6-59dbb7b57516 tempest-SnapshotsActionsTest-204672682 None] Acquiring lock "cinder-4fd81087-4398-40c4-bbe5-15e791073e3f-delete_snapshot" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:01:46 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-489ea233-8222-4eed-b7e6-59dbb7b57516 tempest-SnapshotsActionsTest-204672682 None] Lock "cinder-4fd81087-4398-40c4-bbe5-15e791073e3f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:01:46 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-489ea233-8222-4eed-b7e6-59dbb7b57516 tempest-SnapshotsActionsTest-204672682 None] Acquiring lock "cinder-quobyte-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:01:46 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-489ea233-8222-4eed-b7e6-59dbb7b57516 tempest-SnapshotsActionsTest-204672682 None] Lock "cinder-quobyte-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:01:46 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-489ea233-8222-4eed-b7e6-59dbb7b57516 tempest-SnapshotsActionsTest-204672682 None] Acquiring lock "cinder-quobyte-4fd81087-4398-40c4-bbe5-15e791073e3f" by "_delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:01:46 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-489ea233-8222-4eed-b7e6-59dbb7b57516 tempest-SnapshotsActionsTest-204672682 None] Lock "cinder-quobyte-4fd81087-4398-40c4-bbe5-15e791073e3f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:01:46 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-489ea233-8222-4eed-b7e6-59dbb7b57516 tempest-SnapshotsActionsTest-204672682 None] Deleting offline snapshot 4fd81087-4398-40c4-bbe5-15e791073e3f of volume 843afbc6-3433-46e0-9c9e-d9d9c43fa8d3 {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 05:01:46 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-489ea233-8222-4eed-b7e6-59dbb7b57516 tempest-SnapshotsActionsTest-204672682 None] snapshot_file for this snap is: volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.4fd81087-4398-40c4-bbe5-15e791073e3f {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 05:01:46 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc790b9-97d1-47c0-a44b-200be8c39e37]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:01:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-489ea233-8222-4eed-b7e6-59dbb7b57516 tempest-SnapshotsActionsTest-204672682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.4fd81087-4398-40c4-bbe5-15e791073e3f {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:47 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9f1d47c6-476e-448a-85f8-32c3a31c239f tempest-BackendsCapabilitiesAdminTestsJSON-776187437 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757827758789, 'free_capacity_gb': 1775.757827758789, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93830) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 24 05:01:47 devstack sudo[99371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.4fd81087-4398-40c4-bbe5-15e791073e3f Jun 24 05:01:47 devstack sudo[99371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:48 devstack sudo[99371]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-489ea233-8222-4eed-b7e6-59dbb7b57516 tempest-SnapshotsActionsTest-204672682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.4fd81087-4398-40c4-bbe5-15e791073e3f" returned: 0 in 1.238s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:48 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-489ea233-8222-4eed-b7e6-59dbb7b57516 tempest-SnapshotsActionsTest-204672682 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:01:48 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e944477-b61b-4ff6-aa99-448de2e8545c]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:01:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-489ea233-8222-4eed-b7e6-59dbb7b57516 tempest-SnapshotsActionsTest-204672682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:48 devstack sudo[99376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0 Jun 24 05:01:48 devstack sudo[99376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:49 devstack sudo[99376]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-489ea233-8222-4eed-b7e6-59dbb7b57516 tempest-SnapshotsActionsTest-204672682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0" returned: 0 in 1.027s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:49 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-489ea233-8222-4eed-b7e6-59dbb7b57516 tempest-SnapshotsActionsTest-204672682 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:01:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-489ea233-8222-4eed-b7e6-59dbb7b57516 tempest-SnapshotsActionsTest-204672682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.4fd81087-4398-40c4-bbe5-15e791073e3f {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:49 devstack sudo[99390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.4fd81087-4398-40c4-bbe5-15e791073e3f Jun 24 05:01:49 devstack sudo[99390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:50 devstack sudo[99390]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-489ea233-8222-4eed-b7e6-59dbb7b57516 tempest-SnapshotsActionsTest-204672682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.4fd81087-4398-40c4-bbe5-15e791073e3f" returned: 0 in 0.917s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-489ea233-8222-4eed-b7e6-59dbb7b57516 tempest-SnapshotsActionsTest-204672682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.4fd81087-4398-40c4-bbe5-15e791073e3f {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:50 devstack sudo[99398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.4fd81087-4398-40c4-bbe5-15e791073e3f Jun 24 05:01:50 devstack sudo[99398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:50 devstack sudo[99398]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-489ea233-8222-4eed-b7e6-59dbb7b57516 tempest-SnapshotsActionsTest-204672682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.4fd81087-4398-40c4-bbe5-15e791073e3f" returned: 0 in 0.848s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:51 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-489ea233-8222-4eed-b7e6-59dbb7b57516 tempest-SnapshotsActionsTest-204672682 None] Lock "cinder-quobyte-4fd81087-4398-40c4-bbe5-15e791073e3f" released by "_delete_snapshot" :: held 4.142s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:01:51 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-489ea233-8222-4eed-b7e6-59dbb7b57516 tempest-SnapshotsActionsTest-204672682 None] Lock "cinder-quobyte-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3" released by "delete_snapshot" :: held 4.165s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:01:51 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-489ea233-8222-4eed-b7e6-59dbb7b57516 tempest-SnapshotsActionsTest-204672682 None] Created reservations ['971d7839-296f-4087-8f79-c265dd9977e9', '7e1ebcfd-7a03-4360-8e8f-6907edb13eaa', 'c9ea4aa4-6487-4f5f-af95-53b419915767', '058c1ea8-a0aa-4d4e-9055-221ec4a8c024'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:01:51 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-489ea233-8222-4eed-b7e6-59dbb7b57516 tempest-SnapshotsActionsTest-204672682 None] Delete snapshot completed successfully. Jun 24 05:01:51 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-489ea233-8222-4eed-b7e6-59dbb7b57516 tempest-SnapshotsActionsTest-204672682 None] Lock "cinder-4fd81087-4398-40c4-bbe5-15e791073e3f-delete_snapshot" released by "delete_snapshot" :: held 4.366s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:01:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-85a420cb-4e04-4f94-b537-30463c21edd5 tempest-SnapshotsActionsTest-636083438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:01:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-85a420cb-4e04-4f94-b537-30463c21edd5 tempest-SnapshotsActionsTest-636083438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:01:52 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-85a420cb-4e04-4f94-b537-30463c21edd5 tempest-SnapshotsActionsTest-636083438 None] Creating offline snapshot 726b4418-4d85-4f72-bc65-d2299c63c34d of volume 843afbc6-3433-46e0-9c9e-d9d9c43fa8d3 {{(pid=93830) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 05:01:52 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d563f69-8b5d-4900-9d4b-0f6413f032cf]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:01:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-85a420cb-4e04-4f94-b537-30463c21edd5 tempest-SnapshotsActionsTest-636083438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:52 devstack sudo[99401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0 Jun 24 05:01:52 devstack sudo[99401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:53 devstack sudo[99401]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-85a420cb-4e04-4f94-b537-30463c21edd5 tempest-SnapshotsActionsTest-636083438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0" returned: 0 in 0.851s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:53 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-85a420cb-4e04-4f94-b537-30463c21edd5 tempest-SnapshotsActionsTest-636083438 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:01:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-85a420cb-4e04-4f94-b537-30463c21edd5 tempest-SnapshotsActionsTest-636083438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.726b4418-4d85-4f72-bc65-d2299c63c34d 1G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:53 devstack sudo[99406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.726b4418-4d85-4f72-bc65-d2299c63c34d 1G Jun 24 05:01:53 devstack sudo[99406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:53 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-d77cb899-9e4b-4e8f-8ffb-5b0a46c8c6ec tempest-GroupSnapshotsTest-1374070386 None] Group tempest-GroupSnapshotsTest-Group-1850096873: creating Jun 24 05:01:53 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:UPDATE=60,cinder:SELECT=61,cinder:INSERT=17,cinder:DELETE=6 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:01:53 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-d77cb899-9e4b-4e8f-8ffb-5b0a46c8c6ec tempest-GroupSnapshotsTest-1374070386 None] Group tempest-GroupSnapshotsTest-Group-1850096873: created successfully Jun 24 05:01:53 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-d77cb899-9e4b-4e8f-8ffb-5b0a46c8c6ec tempest-GroupSnapshotsTest-1374070386 None] Create group completed successfully. Jun 24 05:01:54 devstack sudo[99406]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-85a420cb-4e04-4f94-b537-30463c21edd5 tempest-SnapshotsActionsTest-636083438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.726b4418-4d85-4f72-bc65-d2299c63c34d 1G" returned: 0 in 0.920s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-85a420cb-4e04-4f94-b537-30463c21edd5 tempest-SnapshotsActionsTest-636083438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.726b4418-4d85-4f72-bc65-d2299c63c34d {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:54 devstack sudo[99412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.726b4418-4d85-4f72-bc65-d2299c63c34d Jun 24 05:01:54 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:55 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-85a420cb-4e04-4f94-b537-30463c21edd5 tempest-SnapshotsActionsTest-636083438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.726b4418-4d85-4f72-bc65-d2299c63c34d" returned: 0 in 0.770s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:55 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-85a420cb-4e04-4f94-b537-30463c21edd5 tempest-SnapshotsActionsTest-636083438 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.726b4418-4d85-4f72-bc65-d2299c63c34d is being set with open permissions: ugo+rw Jun 24 05:01:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-85a420cb-4e04-4f94-b537-30463c21edd5 tempest-SnapshotsActionsTest-636083438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.726b4418-4d85-4f72-bc65-d2299c63c34d {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:55 devstack sudo[99417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.726b4418-4d85-4f72-bc65-d2299c63c34d Jun 24 05:01:55 devstack sudo[99417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:55 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa2f1fe9-037e-4c74-b700-5665af8ac087 tempest-GroupSnapshotsTest-1374070386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:01:55 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fa2f1fe9-037e-4c74-b700-5665af8ac087 tempest-GroupSnapshotsTest-1374070386 None] Flow 'volume_create_manager' (4f98808d-4ea4-4c5c-872d-a330aae1e3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:01:55 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fa2f1fe9-037e-4c74-b700-5665af8ac087 tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (298d016a-7c3f-4f94-b8a3-99f3da0af1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:01:55 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fa2f1fe9-037e-4c74-b700-5665af8ac087 tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (298d016a-7c3f-4f94-b8a3-99f3da0af1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:01:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-149112587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e7876d1a-952d-45c4-bb7c-7742e1fb8783,host='devstack@QuobyteHD#QuobyteHD',id=d785a9e2-a2b0-44ef-855b-afbc680e7bca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='468985bfe8844337a5741f9806c71d29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:01:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:01:55Z,use_quota=True,user_id='e18311c9dd0a4efd992192892804432b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e7d1755f-b1e5-4bbd-9559-05b890f4bc07),volume_type_id=e7d1755f-b1e5-4bbd-9559-05b890f4bc07)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:01:55 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fa2f1fe9-037e-4c74-b700-5665af8ac087 tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e003a2a1-9818-4cbe-96c7-7fcbe5ef4982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:01:55 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fa2f1fe9-037e-4c74-b700-5665af8ac087 tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e003a2a1-9818-4cbe-96c7-7fcbe5ef4982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:01:55 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fa2f1fe9-037e-4c74-b700-5665af8ac087 tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab1cafb0-fb15-4732-ba44-2d0ceefe5bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:01:55 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fa2f1fe9-037e-4c74-b700-5665af8ac087 tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab1cafb0-fb15-4732-ba44-2d0ceefe5bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd785a9e2-a2b0-44ef-855b-afbc680e7bca', 'volume_name': 'volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:01:55 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fa2f1fe9-037e-4c74-b700-5665af8ac087 tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65a4165f-7225-42c8-abd3-46a69e3be9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:01:55 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fa2f1fe9-037e-4c74-b700-5665af8ac087 tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65a4165f-7225-42c8-abd3-46a69e3be9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:01:55 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fa2f1fe9-037e-4c74-b700-5665af8ac087 tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dfeab81-fccf-449f-af7d-339da81db527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:01:55 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-fa2f1fe9-037e-4c74-b700-5665af8ac087 tempest-GroupSnapshotsTest-1374070386 None] Volume d785a9e2-a2b0-44ef-855b-afbc680e7bca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca', 'volume_size': 1} Jun 24 05:01:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fa2f1fe9-037e-4c74-b700-5665af8ac087 tempest-GroupSnapshotsTest-1374070386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:01:55 devstack sudo[99417]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-85a420cb-4e04-4f94-b537-30463c21edd5 tempest-SnapshotsActionsTest-636083438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.726b4418-4d85-4f72-bc65-d2299c63c34d" returned: 0 in 0.712s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-85a420cb-4e04-4f94-b537-30463c21edd5 tempest-SnapshotsActionsTest-636083438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.374s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:01:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fa2f1fe9-037e-4c74-b700-5665af8ac087 tempest-GroupSnapshotsTest-1374070386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.489s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:01:55 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-fa2f1fe9-037e-4c74-b700-5665af8ac087 tempest-GroupSnapshotsTest-1374070386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e7876d1a-952d-45c4-bb7c-7742e1fb8783,created_at=2026-06-24T03:01:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-149112587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e7876d1a-952d-45c4-bb7c-7742e1fb8783,host='devstack@QuobyteHD#QuobyteHD',id=d785a9e2-a2b0-44ef-855b-afbc680e7bca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='468985bfe8844337a5741f9806c71d29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:01:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:01:55Z,use_quota=True,user_id='e18311c9dd0a4efd992192892804432b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e7d1755f-b1e5-4bbd-9559-05b890f4bc07),volume_type_id=e7d1755f-b1e5-4bbd-9559-05b890f4bc07)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:01:55 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-fa2f1fe9-037e-4c74-b700-5665af8ac087 tempest-GroupSnapshotsTest-1374070386 None] Creating volume d785a9e2-a2b0-44ef-855b-afbc680e7bca {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:01:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fa2f1fe9-037e-4c74-b700-5665af8ac087 tempest-GroupSnapshotsTest-1374070386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:01:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fa2f1fe9-037e-4c74-b700-5665af8ac087 tempest-GroupSnapshotsTest-1374070386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:01:55 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-fa2f1fe9-037e-4c74-b700-5665af8ac087 tempest-GroupSnapshotsTest-1374070386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:01:55 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-fa2f1fe9-037e-4c74-b700-5665af8ac087 tempest-GroupSnapshotsTest-1374070386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:01:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fa2f1fe9-037e-4c74-b700-5665af8ac087 tempest-GroupSnapshotsTest-1374070386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:01:55 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-fa2f1fe9-037e-4c74-b700-5665af8ac087 tempest-GroupSnapshotsTest-1374070386 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:01:55 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-fa2f1fe9-037e-4c74-b700-5665af8ac087 tempest-GroupSnapshotsTest-1374070386 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:01:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fa2f1fe9-037e-4c74-b700-5665af8ac087 tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:55 devstack sudo[99420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca 1073741824 Jun 24 05:01:55 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:55 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-85a420cb-4e04-4f94-b537-30463c21edd5 tempest-SnapshotsActionsTest-636083438 None] Create snapshot completed successfully Jun 24 05:01:56 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-07f5de0e-1038-4d03-bd5f-1aeebe7eda58 tempest-SnapshotsActionsTest-204672682 None] Acquiring lock "cinder-726b4418-4d85-4f72-bc65-d2299c63c34d-delete_snapshot" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:01:56 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-07f5de0e-1038-4d03-bd5f-1aeebe7eda58 tempest-SnapshotsActionsTest-204672682 None] Lock "cinder-726b4418-4d85-4f72-bc65-d2299c63c34d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:01:56 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-07f5de0e-1038-4d03-bd5f-1aeebe7eda58 tempest-SnapshotsActionsTest-204672682 None] Acquiring lock "cinder-quobyte-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:01:56 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-07f5de0e-1038-4d03-bd5f-1aeebe7eda58 tempest-SnapshotsActionsTest-204672682 None] Lock "cinder-quobyte-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:01:56 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-07f5de0e-1038-4d03-bd5f-1aeebe7eda58 tempest-SnapshotsActionsTest-204672682 None] Acquiring lock "cinder-quobyte-726b4418-4d85-4f72-bc65-d2299c63c34d" by "_delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:01:56 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-07f5de0e-1038-4d03-bd5f-1aeebe7eda58 tempest-SnapshotsActionsTest-204672682 None] Lock "cinder-quobyte-726b4418-4d85-4f72-bc65-d2299c63c34d" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:01:56 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-07f5de0e-1038-4d03-bd5f-1aeebe7eda58 tempest-SnapshotsActionsTest-204672682 None] Deleting offline snapshot 726b4418-4d85-4f72-bc65-d2299c63c34d of volume 843afbc6-3433-46e0-9c9e-d9d9c43fa8d3 {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 05:01:56 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-07f5de0e-1038-4d03-bd5f-1aeebe7eda58 tempest-SnapshotsActionsTest-204672682 None] snapshot_file for this snap is: volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.726b4418-4d85-4f72-bc65-d2299c63c34d {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 05:01:56 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[803aa071-6156-4da1-a983-a8d25116bee2]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:01:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-07f5de0e-1038-4d03-bd5f-1aeebe7eda58 tempest-SnapshotsActionsTest-204672682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.726b4418-4d85-4f72-bc65-d2299c63c34d {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:56 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fa2f1fe9-037e-4c74-b700-5665af8ac087 tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca 1073741824" returned: 0 in 1.125s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fa2f1fe9-037e-4c74-b700-5665af8ac087 tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:57 devstack sudo[99427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca Jun 24 05:01:57 devstack sudo[99427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:57 devstack sudo[99426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.726b4418-4d85-4f72-bc65-d2299c63c34d Jun 24 05:01:57 devstack sudo[99426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:57 devstack sudo[99427]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fa2f1fe9-037e-4c74-b700-5665af8ac087 tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca" returned: 0 in 0.660s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:57 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-fa2f1fe9-037e-4c74-b700-5665af8ac087 tempest-GroupSnapshotsTest-1374070386 None] <== create_volume: return (1856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:01:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fa2f1fe9-037e-4c74-b700-5665af8ac087 tempest-GroupSnapshotsTest-1374070386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.858s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:01:57 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fa2f1fe9-037e-4c74-b700-5665af8ac087 tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dfeab81-fccf-449f-af7d-339da81db527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:01:57 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fa2f1fe9-037e-4c74-b700-5665af8ac087 tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd36ec81-5510-4512-b776-4f9fcba28fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:01:57 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-fa2f1fe9-037e-4c74-b700-5665af8ac087 tempest-GroupSnapshotsTest-1374070386 None] Volume volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca (d785a9e2-a2b0-44ef-855b-afbc680e7bca): created successfully Jun 24 05:01:57 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fa2f1fe9-037e-4c74-b700-5665af8ac087 tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd36ec81-5510-4512-b776-4f9fcba28fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:01:57 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fa2f1fe9-037e-4c74-b700-5665af8ac087 tempest-GroupSnapshotsTest-1374070386 None] Flow 'volume_create_manager' (4f98808d-4ea4-4c5c-872d-a330aae1e3a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:01:57 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-fa2f1fe9-037e-4c74-b700-5665af8ac087 tempest-GroupSnapshotsTest-1374070386 None] Created volume successfully. Jun 24 05:01:57 devstack sudo[99426]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-07f5de0e-1038-4d03-bd5f-1aeebe7eda58 tempest-SnapshotsActionsTest-204672682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.726b4418-4d85-4f72-bc65-d2299c63c34d" returned: 0 in 0.814s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:57 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-07f5de0e-1038-4d03-bd5f-1aeebe7eda58 tempest-SnapshotsActionsTest-204672682 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:01:57 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[53fec63f-e4a3-4d59-8cd3-cafafba86967]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:01:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-07f5de0e-1038-4d03-bd5f-1aeebe7eda58 tempest-SnapshotsActionsTest-204672682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:57 devstack sudo[99434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0 Jun 24 05:01:57 devstack sudo[99434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:58 devstack sudo[99434]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-07f5de0e-1038-4d03-bd5f-1aeebe7eda58 tempest-SnapshotsActionsTest-204672682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0" returned: 0 in 0.789s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:58 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-07f5de0e-1038-4d03-bd5f-1aeebe7eda58 tempest-SnapshotsActionsTest-204672682 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:01:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-07f5de0e-1038-4d03-bd5f-1aeebe7eda58 tempest-SnapshotsActionsTest-204672682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.726b4418-4d85-4f72-bc65-d2299c63c34d {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:58 devstack sudo[99439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.726b4418-4d85-4f72-bc65-d2299c63c34d Jun 24 05:01:58 devstack sudo[99439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:59 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-9af103ae-b13b-43e7-a8c7-c01d8939d28b tempest-GroupSnapshotsTest-1374070386 None] GroupSnapshot 29b5cc47-6f35-4723-8dc0-23fb4518294d: creating. Jun 24 05:01:59 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9af103ae-b13b-43e7-a8c7-c01d8939d28b tempest-GroupSnapshotsTest-1374070386 None] Group snapshot 29b5cc47-6f35-4723-8dc0-23fb4518294d: creating. {{(pid=93830) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 24 05:01:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9af103ae-b13b-43e7-a8c7-c01d8939d28b tempest-GroupSnapshotsTest-1374070386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:01:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9af103ae-b13b-43e7-a8c7-c01d8939d28b tempest-GroupSnapshotsTest-1374070386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:01:59 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-9af103ae-b13b-43e7-a8c7-c01d8939d28b tempest-GroupSnapshotsTest-1374070386 None] Creating offline snapshot 22864e9e-3df2-4967-ab7e-8d18e061a408 of volume d785a9e2-a2b0-44ef-855b-afbc680e7bca {{(pid=93830) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 05:01:59 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[da82a6ba-6f5f-4a65-b9e9-c577196e15ce]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:01:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9af103ae-b13b-43e7-a8c7-c01d8939d28b tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:59 devstack sudo[99443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca Jun 24 05:01:59 devstack sudo[99443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:01:59 devstack sudo[99439]: pam_unix(sudo:session): session closed for user root Jun 24 05:01:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-07f5de0e-1038-4d03-bd5f-1aeebe7eda58 tempest-SnapshotsActionsTest-204672682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.726b4418-4d85-4f72-bc65-d2299c63c34d" returned: 0 in 1.174s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:01:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-07f5de0e-1038-4d03-bd5f-1aeebe7eda58 tempest-SnapshotsActionsTest-204672682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.726b4418-4d85-4f72-bc65-d2299c63c34d {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:01:59 devstack sudo[99453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.726b4418-4d85-4f72-bc65-d2299c63c34d Jun 24 05:01:59 devstack sudo[99453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:00 devstack sudo[99443]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9af103ae-b13b-43e7-a8c7-c01d8939d28b tempest-GroupSnapshotsTest-1374070386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca" returned: 0 in 1.026s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9af103ae-b13b-43e7-a8c7-c01d8939d28b tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca.22864e9e-3df2-4967-ab7e-8d18e061a408 1G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:00 devstack sudo[99460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca.22864e9e-3df2-4967-ab7e-8d18e061a408 1G Jun 24 05:02:00 devstack sudo[99460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:00 devstack sudo[99453]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-07f5de0e-1038-4d03-bd5f-1aeebe7eda58 tempest-SnapshotsActionsTest-204672682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.726b4418-4d85-4f72-bc65-d2299c63c34d" returned: 0 in 0.765s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:00 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-07f5de0e-1038-4d03-bd5f-1aeebe7eda58 tempest-SnapshotsActionsTest-204672682 None] Lock "cinder-quobyte-726b4418-4d85-4f72-bc65-d2299c63c34d" released by "_delete_snapshot" :: held 3.661s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:02:00 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-07f5de0e-1038-4d03-bd5f-1aeebe7eda58 tempest-SnapshotsActionsTest-204672682 None] Lock "cinder-quobyte-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3" released by "delete_snapshot" :: held 3.702s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:02:00 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-07f5de0e-1038-4d03-bd5f-1aeebe7eda58 tempest-SnapshotsActionsTest-204672682 None] Created reservations ['c70c1279-64de-4e30-823b-2448b4a41504', 'c1f4e407-2d86-4c09-a354-506257475488', 'f6381d66-6c43-41e4-a95d-37ca76e7f987', '3d518638-8ce8-418c-883e-e3dc6421b67e'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:02:00 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-07f5de0e-1038-4d03-bd5f-1aeebe7eda58 tempest-SnapshotsActionsTest-204672682 None] Delete snapshot completed successfully. Jun 24 05:02:00 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-07f5de0e-1038-4d03-bd5f-1aeebe7eda58 tempest-SnapshotsActionsTest-204672682 None] Lock "cinder-726b4418-4d85-4f72-bc65-d2299c63c34d-delete_snapshot" released by "delete_snapshot" :: held 4.012s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:02:01 devstack sudo[99460]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9af103ae-b13b-43e7-a8c7-c01d8939d28b tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca.22864e9e-3df2-4967-ab7e-8d18e061a408 1G" returned: 0 in 1.259s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9af103ae-b13b-43e7-a8c7-c01d8939d28b tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca.22864e9e-3df2-4967-ab7e-8d18e061a408 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:01 devstack sudo[99507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca.22864e9e-3df2-4967-ab7e-8d18e061a408 Jun 24 05:02:01 devstack sudo[99507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:01 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-cd6bd6c8-97f7-44a1-bc72-68b72200deea tempest-SnapshotsActionsTest-636083438 None] Acquiring lock "cinder-23109391-1063-4402-abbc-8a084bc76da0-delete_snapshot" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:02:01 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-cd6bd6c8-97f7-44a1-bc72-68b72200deea tempest-SnapshotsActionsTest-636083438 None] Lock "cinder-23109391-1063-4402-abbc-8a084bc76da0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:02:01 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-cd6bd6c8-97f7-44a1-bc72-68b72200deea tempest-SnapshotsActionsTest-636083438 None] Acquiring lock "cinder-quobyte-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:02:01 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-cd6bd6c8-97f7-44a1-bc72-68b72200deea tempest-SnapshotsActionsTest-636083438 None] Lock "cinder-quobyte-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:02:01 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-cd6bd6c8-97f7-44a1-bc72-68b72200deea tempest-SnapshotsActionsTest-636083438 None] Acquiring lock "cinder-quobyte-23109391-1063-4402-abbc-8a084bc76da0" by "_delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:02:01 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-cd6bd6c8-97f7-44a1-bc72-68b72200deea tempest-SnapshotsActionsTest-636083438 None] Lock "cinder-quobyte-23109391-1063-4402-abbc-8a084bc76da0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:02:01 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-cd6bd6c8-97f7-44a1-bc72-68b72200deea tempest-SnapshotsActionsTest-636083438 None] Deleting offline snapshot 23109391-1063-4402-abbc-8a084bc76da0 of volume 843afbc6-3433-46e0-9c9e-d9d9c43fa8d3 {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 05:02:01 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-cd6bd6c8-97f7-44a1-bc72-68b72200deea tempest-SnapshotsActionsTest-636083438 None] snapshot_file for this snap is: volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0 {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 05:02:01 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c137aa-a037-44a9-ad44-c0694b50d42f]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:02:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-cd6bd6c8-97f7-44a1-bc72-68b72200deea tempest-SnapshotsActionsTest-636083438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:02 devstack sudo[99510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0 Jun 24 05:02:02 devstack sudo[99510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:02 devstack sudo[99507]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9af103ae-b13b-43e7-a8c7-c01d8939d28b tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca.22864e9e-3df2-4967-ab7e-8d18e061a408" returned: 0 in 0.851s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:02 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-9af103ae-b13b-43e7-a8c7-c01d8939d28b tempest-GroupSnapshotsTest-1374070386 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca.22864e9e-3df2-4967-ab7e-8d18e061a408 is being set with open permissions: ugo+rw: NotImplementedError Jun 24 05:02:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9af103ae-b13b-43e7-a8c7-c01d8939d28b tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca.22864e9e-3df2-4967-ab7e-8d18e061a408 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:02 devstack sudo[99516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca.22864e9e-3df2-4967-ab7e-8d18e061a408 Jun 24 05:02:02 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:02 devstack sudo[99510]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-cd6bd6c8-97f7-44a1-bc72-68b72200deea tempest-SnapshotsActionsTest-636083438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0" returned: 0 in 0.826s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:02 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-cd6bd6c8-97f7-44a1-bc72-68b72200deea tempest-SnapshotsActionsTest-636083438 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:02:02 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[17bf140d-c8cc-4b6a-8bd6-7216fac8e3fd]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:02:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-cd6bd6c8-97f7-44a1-bc72-68b72200deea tempest-SnapshotsActionsTest-636083438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:02 devstack sudo[99522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3 Jun 24 05:02:02 devstack sudo[99522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:03 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9af103ae-b13b-43e7-a8c7-c01d8939d28b tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca.22864e9e-3df2-4967-ab7e-8d18e061a408" returned: 0 in 0.895s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9af103ae-b13b-43e7-a8c7-c01d8939d28b tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:03 devstack sudo[99528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca.info Jun 24 05:02:03 devstack sudo[99528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:03 devstack sudo[99522]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-cd6bd6c8-97f7-44a1-bc72-68b72200deea tempest-SnapshotsActionsTest-636083438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3" returned: 0 in 0.987s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-cd6bd6c8-97f7-44a1-bc72-68b72200deea tempest-SnapshotsActionsTest-636083438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:03 devstack sudo[99537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0 Jun 24 05:02:03 devstack sudo[99537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:04 devstack sudo[99528]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9af103ae-b13b-43e7-a8c7-c01d8939d28b tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca.info" returned: 0 in 0.695s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:04 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-9af103ae-b13b-43e7-a8c7-c01d8939d28b tempest-GroupSnapshotsTest-1374070386 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca.info is being set with open permissions: ugo+rw: NotImplementedError Jun 24 05:02:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9af103ae-b13b-43e7-a8c7-c01d8939d28b tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:04 devstack sudo[99540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca.info Jun 24 05:02:04 devstack sudo[99540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:04 devstack sudo[99537]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-cd6bd6c8-97f7-44a1-bc72-68b72200deea tempest-SnapshotsActionsTest-636083438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0" returned: 0 in 0.810s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-cd6bd6c8-97f7-44a1-bc72-68b72200deea tempest-SnapshotsActionsTest-636083438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:04 devstack sudo[99545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0 Jun 24 05:02:04 devstack sudo[99545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:04 devstack sudo[99540]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9af103ae-b13b-43e7-a8c7-c01d8939d28b tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca.info" returned: 0 in 0.668s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9af103ae-b13b-43e7-a8c7-c01d8939d28b tempest-GroupSnapshotsTest-1374070386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.501s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:02:04 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-9af103ae-b13b-43e7-a8c7-c01d8939d28b tempest-GroupSnapshotsTest-1374070386 None] group_snapshot 29b5cc47-6f35-4723-8dc0-23fb4518294d: created successfully Jun 24 05:02:05 devstack sudo[99545]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-cd6bd6c8-97f7-44a1-bc72-68b72200deea tempest-SnapshotsActionsTest-636083438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3.23109391-1063-4402-abbc-8a084bc76da0" returned: 0 in 0.679s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:05 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-cd6bd6c8-97f7-44a1-bc72-68b72200deea tempest-SnapshotsActionsTest-636083438 None] Lock "cinder-quobyte-23109391-1063-4402-abbc-8a084bc76da0" released by "_delete_snapshot" :: held 3.444s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:02:05 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-cd6bd6c8-97f7-44a1-bc72-68b72200deea tempest-SnapshotsActionsTest-636083438 None] Lock "cinder-quobyte-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3" released by "delete_snapshot" :: held 3.467s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:02:05 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-cd6bd6c8-97f7-44a1-bc72-68b72200deea tempest-SnapshotsActionsTest-636083438 None] Created reservations ['bef58008-0ada-4018-86e4-5c45330e8c54', '655f76f7-2adf-4926-9f35-903615785a9f', 'ca28cbda-4505-4140-84c3-5aeb36a974fc', '94c52bc8-239f-4a1a-9888-7cdbf54c1161'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:02:05 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-cd6bd6c8-97f7-44a1-bc72-68b72200deea tempest-SnapshotsActionsTest-636083438 None] Delete snapshot completed successfully. Jun 24 05:02:05 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-cd6bd6c8-97f7-44a1-bc72-68b72200deea tempest-SnapshotsActionsTest-636083438 None] Lock "cinder-23109391-1063-4402-abbc-8a084bc76da0-delete_snapshot" released by "delete_snapshot" :: held 3.620s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:02:06 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-69bde7ea-9797-4bc6-8875-9cae9b18069a tempest-SnapshotsActionsTest-636083438 None] Acquiring lock "cinder-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:02:06 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-69bde7ea-9797-4bc6-8875-9cae9b18069a tempest-SnapshotsActionsTest-636083438 None] Lock "cinder-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:02:06 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-69bde7ea-9797-4bc6-8875-9cae9b18069a tempest-SnapshotsActionsTest-636083438 None] Acquiring lock "cinder-quobyte-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:02:06 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-69bde7ea-9797-4bc6-8875-9cae9b18069a tempest-SnapshotsActionsTest-636083438 None] Lock "cinder-quobyte-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3" acquired by "delete_volume" :: waited 0.015s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:02:06 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5ca2c9-d23c-40b9-8d78-8051520bbb93]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:02:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-69bde7ea-9797-4bc6-8875-9cae9b18069a tempest-SnapshotsActionsTest-636083438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:06 devstack sudo[99549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3 Jun 24 05:02:06 devstack sudo[99549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-61f17d5b-e621-4a6a-9909-0e69e233043b tempest-GroupSnapshotsTest-1374070386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:02:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-61f17d5b-e621-4a6a-9909-0e69e233043b tempest-GroupSnapshotsTest-1374070386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:02:06 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-61f17d5b-e621-4a6a-9909-0e69e233043b tempest-GroupSnapshotsTest-1374070386 None] Acquiring lock "cinder-quobyte-22864e9e-3df2-4967-ab7e-8d18e061a408-9f6e582d-108a-4f3f-b1da-d5c157b4d48b" by "_create_volume_from_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:02:06 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-61f17d5b-e621-4a6a-9909-0e69e233043b tempest-GroupSnapshotsTest-1374070386 None] Lock "cinder-quobyte-22864e9e-3df2-4967-ab7e-8d18e061a408-9f6e582d-108a-4f3f-b1da-d5c157b4d48b" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:02:06 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-61f17d5b-e621-4a6a-9909-0e69e233043b tempest-GroupSnapshotsTest-1374070386 None] Creating volume 9f6e582d-108a-4f3f-b1da-d5c157b4d48b from snapshot 22864e9e-3df2-4967-ab7e-8d18e061a408 {{(pid=93830) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 24 05:02:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-61f17d5b-e621-4a6a-9909-0e69e233043b tempest-GroupSnapshotsTest-1374070386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:02:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-61f17d5b-e621-4a6a-9909-0e69e233043b tempest-GroupSnapshotsTest-1374070386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:02:06 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-61f17d5b-e621-4a6a-9909-0e69e233043b tempest-GroupSnapshotsTest-1374070386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:02:06 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-61f17d5b-e621-4a6a-9909-0e69e233043b tempest-GroupSnapshotsTest-1374070386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:02:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-61f17d5b-e621-4a6a-9909-0e69e233043b tempest-GroupSnapshotsTest-1374070386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:02:06 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-61f17d5b-e621-4a6a-9909-0e69e233043b tempest-GroupSnapshotsTest-1374070386 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:02:06 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-61f17d5b-e621-4a6a-9909-0e69e233043b tempest-GroupSnapshotsTest-1374070386 None] Acquiring lock "cinder-quobyte-9f6e582d-108a-4f3f-b1da-d5c157b4d48b" by "_copy_volume_from_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:02:07 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-61f17d5b-e621-4a6a-9909-0e69e233043b tempest-GroupSnapshotsTest-1374070386 None] Lock "cinder-quobyte-9f6e582d-108a-4f3f-b1da-d5c157b4d48b" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:02:07 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-61f17d5b-e621-4a6a-9909-0e69e233043b tempest-GroupSnapshotsTest-1374070386 None] snapshot: 22864e9e-3df2-4967-ab7e-8d18e061a408, volume: 9f6e582d-108a-4f3f-b1da-d5c157b4d48b, {{(pid=93830) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 05:02:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-61f17d5b-e621-4a6a-9909-0e69e233043b tempest-GroupSnapshotsTest-1374070386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:02:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-61f17d5b-e621-4a6a-9909-0e69e233043b tempest-GroupSnapshotsTest-1374070386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:02:07 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-61f17d5b-e621-4a6a-9909-0e69e233043b tempest-GroupSnapshotsTest-1374070386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:02:07 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-61f17d5b-e621-4a6a-9909-0e69e233043b tempest-GroupSnapshotsTest-1374070386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:02:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-61f17d5b-e621-4a6a-9909-0e69e233043b tempest-GroupSnapshotsTest-1374070386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:02:07 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc920ef6-57fe-4a0c-8b09-113f16674333]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:02:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-61f17d5b-e621-4a6a-9909-0e69e233043b tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca.22864e9e-3df2-4967-ab7e-8d18e061a408 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:07 devstack sudo[99552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca.22864e9e-3df2-4967-ab7e-8d18e061a408 Jun 24 05:02:07 devstack sudo[99552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:07 devstack sudo[99549]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-69bde7ea-9797-4bc6-8875-9cae9b18069a tempest-SnapshotsActionsTest-636083438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3" returned: 0 in 1.168s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-69bde7ea-9797-4bc6-8875-9cae9b18069a tempest-SnapshotsActionsTest-636083438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:07 devstack sudo[99561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3 Jun 24 05:02:07 devstack sudo[99561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:08 devstack sudo[99552]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-61f17d5b-e621-4a6a-9909-0e69e233043b tempest-GroupSnapshotsTest-1374070386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca.22864e9e-3df2-4967-ab7e-8d18e061a408" returned: 0 in 0.949s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:08 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-61f17d5b-e621-4a6a-9909-0e69e233043b tempest-GroupSnapshotsTest-1374070386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:02:08 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-61f17d5b-e621-4a6a-9909-0e69e233043b tempest-GroupSnapshotsTest-1374070386 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca {{(pid=93830) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 05:02:08 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-61f17d5b-e621-4a6a-9909-0e69e233043b tempest-GroupSnapshotsTest-1374070386 None] Creating direct copy from snapshot {{(pid=93830) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 05:02:08 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7c6dc0-59a7-4d54-81d6-9387288b0857]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:02:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-61f17d5b-e621-4a6a-9909-0e69e233043b tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:08 devstack sudo[99561]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-69bde7ea-9797-4bc6-8875-9cae9b18069a tempest-SnapshotsActionsTest-636083438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3" returned: 0 in 0.792s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:08 devstack sudo[99580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca Jun 24 05:02:08 devstack sudo[99580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:08 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-69bde7ea-9797-4bc6-8875-9cae9b18069a tempest-SnapshotsActionsTest-636083438 None] Lock "cinder-quobyte-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3" released by "delete_volume" :: held 2.040s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:02:08 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-69bde7ea-9797-4bc6-8875-9cae9b18069a tempest-SnapshotsActionsTest-636083438 None] Created reservations ['ce6f8a22-116f-4a6d-827e-929c6dea96a7', '19dec81f-d218-487d-b8b5-ae76ab231d6d', '8d7990e8-a2c0-4274-9237-6bc810451fc8', '84fb465a-c2d7-4cec-bf4b-334a14836d06'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:02:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-69bde7ea-9797-4bc6-8875-9cae9b18069a tempest-SnapshotsActionsTest-636083438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:02:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-69bde7ea-9797-4bc6-8875-9cae9b18069a tempest-SnapshotsActionsTest-636083438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:02:08 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-69bde7ea-9797-4bc6-8875-9cae9b18069a tempest-SnapshotsActionsTest-636083438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:02:08 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-69bde7ea-9797-4bc6-8875-9cae9b18069a tempest-SnapshotsActionsTest-636083438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:02:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-69bde7ea-9797-4bc6-8875-9cae9b18069a tempest-SnapshotsActionsTest-636083438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:02:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-69bde7ea-9797-4bc6-8875-9cae9b18069a tempest-SnapshotsActionsTest-636083438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:08 devstack sudo[99582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:02:08 devstack sudo[99582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:09 devstack sudo[99580]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-61f17d5b-e621-4a6a-9909-0e69e233043b tempest-GroupSnapshotsTest-1374070386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca" returned: 0 in 1.008s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:09 devstack cinder-volume[93830]: DEBUG cinder.utils [None req-61f17d5b-e621-4a6a-9909-0e69e233043b tempest-GroupSnapshotsTest-1374070386 None] Path /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9f6e582d-108a-4f3f-b1da-d5c157b4d48b not found in is_blk_device check {{(pid=93830) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 05:02:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-61f17d5b-e621-4a6a-9909-0e69e233043b tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9f6e582d-108a-4f3f-b1da-d5c157b4d48b {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:09 devstack sudo[99587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9f6e582d-108a-4f3f-b1da-d5c157b4d48b Jun 24 05:02:09 devstack sudo[99587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:09 devstack sudo[99582]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-69bde7ea-9797-4bc6-8875-9cae9b18069a tempest-SnapshotsActionsTest-636083438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 1.017s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:09 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-69bde7ea-9797-4bc6-8875-9cae9b18069a tempest-SnapshotsActionsTest-636083438 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:02:09 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-69bde7ea-9797-4bc6-8875-9cae9b18069a tempest-SnapshotsActionsTest-636083438 None] Deleted volume successfully. Jun 24 05:02:09 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-69bde7ea-9797-4bc6-8875-9cae9b18069a tempest-SnapshotsActionsTest-636083438 None] Lock "cinder-843afbc6-3433-46e0-9c9e-d9d9c43fa8d3-delete_volume" released by "delete_volume" :: held 3.319s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:02:09 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 05:02:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:02:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:02:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:02:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:02:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:02:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:09 devstack sudo[99593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:02:09 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:11 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 1.763s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:11 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:02:11 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager._thread_info {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 05:02:11 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread count: 8 {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 05:02:11 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread info: [<_MainThread(MainThread, started 130211312517248)>, , , , , , , ] {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 05:02:15 devstack sudo[99587]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-61f17d5b-e621-4a6a-9909-0e69e233043b tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9f6e582d-108a-4f3f-b1da-d5c157b4d48b" returned: 0 in 6.412s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:15 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c375290-af64-46b7-9c2a-776dbf9a0bbc]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:02:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-61f17d5b-e621-4a6a-9909-0e69e233043b tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:15 devstack sudo[99609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca Jun 24 05:02:15 devstack sudo[99609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:16 devstack sudo[99609]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-61f17d5b-e621-4a6a-9909-0e69e233043b tempest-GroupSnapshotsTest-1374070386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca" returned: 0 in 1.029s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:16 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-61f17d5b-e621-4a6a-9909-0e69e233043b tempest-GroupSnapshotsTest-1374070386 None] Image conversion details: src /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca, size 1024.00 MB, duration 6.41 sec, destination /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9f6e582d-108a-4f3f-b1da-d5c157b4d48b {{(pid=93830) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 05:02:16 devstack cinder-volume[93830]: INFO cinder.image.image_utils [None req-61f17d5b-e621-4a6a-9909-0e69e233043b tempest-GroupSnapshotsTest-1374070386 None] Converted 1024.00 MB image at 159.67 MB/s Jun 24 05:02:16 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-61f17d5b-e621-4a6a-9909-0e69e233043b tempest-GroupSnapshotsTest-1374070386 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9f6e582d-108a-4f3f-b1da-d5c157b4d48b is being set with open permissions: ugo+rw: NotImplementedError Jun 24 05:02:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-61f17d5b-e621-4a6a-9909-0e69e233043b tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9f6e582d-108a-4f3f-b1da-d5c157b4d48b {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:16 devstack sudo[99617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9f6e582d-108a-4f3f-b1da-d5c157b4d48b Jun 24 05:02:16 devstack sudo[99617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:17 devstack sudo[99617]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-61f17d5b-e621-4a6a-9909-0e69e233043b tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9f6e582d-108a-4f3f-b1da-d5c157b4d48b" returned: 0 in 0.720s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:17 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-61f17d5b-e621-4a6a-9909-0e69e233043b tempest-GroupSnapshotsTest-1374070386 None] Lock "cinder-quobyte-9f6e582d-108a-4f3f-b1da-d5c157b4d48b" released by "_copy_volume_from_snapshot" :: held 10.274s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:02:17 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-61f17d5b-e621-4a6a-9909-0e69e233043b tempest-GroupSnapshotsTest-1374070386 None] Lock "cinder-quobyte-22864e9e-3df2-4967-ab7e-8d18e061a408-9f6e582d-108a-4f3f-b1da-d5c157b4d48b" released by "_create_volume_from_snapshot" :: held 10.344s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:02:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-61f17d5b-e621-4a6a-9909-0e69e233043b tempest-GroupSnapshotsTest-1374070386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.368s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:02:17 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-61f17d5b-e621-4a6a-9909-0e69e233043b tempest-GroupSnapshotsTest-1374070386 None] Create group from source-snapshot-29b5cc47-6f35-4723-8dc0-23fb4518294d completed successfully. Jun 24 05:02:19 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-19ad5d61-39d7-47f4-bfad-1421480f4745 tempest-GroupSnapshotsTest-1374070386 None] Acquiring lock "cinder-quobyte-9f6e582d-108a-4f3f-b1da-d5c157b4d48b" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:02:19 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-19ad5d61-39d7-47f4-bfad-1421480f4745 tempest-GroupSnapshotsTest-1374070386 None] Lock "cinder-quobyte-9f6e582d-108a-4f3f-b1da-d5c157b4d48b" acquired by "delete_volume" :: waited 0.024s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:02:19 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[9332fae9-88cc-4a14-b12c-ecad5aefad3c]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:02:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-19ad5d61-39d7-47f4-bfad-1421480f4745 tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9f6e582d-108a-4f3f-b1da-d5c157b4d48b {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:19 devstack sudo[99700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9f6e582d-108a-4f3f-b1da-d5c157b4d48b Jun 24 05:02:19 devstack sudo[99700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:20 devstack sudo[99700]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-19ad5d61-39d7-47f4-bfad-1421480f4745 tempest-GroupSnapshotsTest-1374070386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9f6e582d-108a-4f3f-b1da-d5c157b4d48b" returned: 0 in 0.898s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-19ad5d61-39d7-47f4-bfad-1421480f4745 tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9f6e582d-108a-4f3f-b1da-d5c157b4d48b {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:20 devstack sudo[99708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9f6e582d-108a-4f3f-b1da-d5c157b4d48b Jun 24 05:02:20 devstack sudo[99708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:21 devstack sudo[99708]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-19ad5d61-39d7-47f4-bfad-1421480f4745 tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9f6e582d-108a-4f3f-b1da-d5c157b4d48b" returned: 0 in 1.053s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:21 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-19ad5d61-39d7-47f4-bfad-1421480f4745 tempest-GroupSnapshotsTest-1374070386 None] Lock "cinder-quobyte-9f6e582d-108a-4f3f-b1da-d5c157b4d48b" released by "delete_volume" :: held 2.053s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:02:21 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-19ad5d61-39d7-47f4-bfad-1421480f4745 tempest-GroupSnapshotsTest-1374070386 None] Created reservations ['3cd9aa16-dff8-4146-bfb0-f515620b5471'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:02:21 devstack cinder-volume[93830]: WARNING cinder.quota [None req-19ad5d61-39d7-47f4-bfad-1421480f4745 tempest-GroupSnapshotsTest-1374070386 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-999668273 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-999668273, it is now deprecated. Please use the default quota class for default quota. Jun 24 05:02:21 devstack cinder-volume[93830]: WARNING cinder.quota [None req-19ad5d61-39d7-47f4-bfad-1421480f4745 tempest-GroupSnapshotsTest-1374070386 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-999668273 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-999668273, it is now deprecated. Please use the default quota class for default quota. Jun 24 05:02:21 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-19ad5d61-39d7-47f4-bfad-1421480f4745 tempest-GroupSnapshotsTest-1374070386 None] Created reservations ['d4cda3b5-5f90-4a1c-bc0a-5a1893a34679', '97e3cacf-b2bc-4be5-8609-99a5272b8ce3', '9da6625f-bfb5-433f-8e96-cb7300039b4f', '1bede558-256e-4145-965e-0d88d193b957'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:02:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-19ad5d61-39d7-47f4-bfad-1421480f4745 tempest-GroupSnapshotsTest-1374070386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:02:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-19ad5d61-39d7-47f4-bfad-1421480f4745 tempest-GroupSnapshotsTest-1374070386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:02:21 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-19ad5d61-39d7-47f4-bfad-1421480f4745 tempest-GroupSnapshotsTest-1374070386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:02:21 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-19ad5d61-39d7-47f4-bfad-1421480f4745 tempest-GroupSnapshotsTest-1374070386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:02:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-19ad5d61-39d7-47f4-bfad-1421480f4745 tempest-GroupSnapshotsTest-1374070386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:02:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-19ad5d61-39d7-47f4-bfad-1421480f4745 tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:21 devstack sudo[99712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:02:21 devstack sudo[99712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:21 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-48490c09-73b3-4ae5-90c2-ffa2c2b3b41f tempest-GroupSnapshotsTest-1374070386 None] group_snapshot 29b5cc47-6f35-4723-8dc0-23fb4518294d: deleting Jun 24 05:02:22 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-48490c09-73b3-4ae5-90c2-ffa2c2b3b41f tempest-GroupSnapshotsTest-1374070386 None] group_snapshot 29b5cc47-6f35-4723-8dc0-23fb4518294d: deleting {{(pid=93830) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 24 05:02:22 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-48490c09-73b3-4ae5-90c2-ffa2c2b3b41f tempest-GroupSnapshotsTest-1374070386 None] Acquiring lock "cinder-quobyte-d785a9e2-a2b0-44ef-855b-afbc680e7bca" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:02:22 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-48490c09-73b3-4ae5-90c2-ffa2c2b3b41f tempest-GroupSnapshotsTest-1374070386 None] Lock "cinder-quobyte-d785a9e2-a2b0-44ef-855b-afbc680e7bca" acquired by "delete_snapshot" :: waited 0.063s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:02:22 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-48490c09-73b3-4ae5-90c2-ffa2c2b3b41f tempest-GroupSnapshotsTest-1374070386 None] Acquiring lock "cinder-quobyte-22864e9e-3df2-4967-ab7e-8d18e061a408" by "_delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:02:22 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-48490c09-73b3-4ae5-90c2-ffa2c2b3b41f tempest-GroupSnapshotsTest-1374070386 None] Lock "cinder-quobyte-22864e9e-3df2-4967-ab7e-8d18e061a408" acquired by "_delete_snapshot" :: waited 0.076s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:02:22 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-48490c09-73b3-4ae5-90c2-ffa2c2b3b41f tempest-GroupSnapshotsTest-1374070386 None] Deleting offline snapshot 22864e9e-3df2-4967-ab7e-8d18e061a408 of volume d785a9e2-a2b0-44ef-855b-afbc680e7bca {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 05:02:22 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-48490c09-73b3-4ae5-90c2-ffa2c2b3b41f tempest-GroupSnapshotsTest-1374070386 None] snapshot_file for this snap is: volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca.22864e9e-3df2-4967-ab7e-8d18e061a408 {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 05:02:22 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[0217c1ab-4f2c-4a4b-98f3-2387decc367a]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:02:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-48490c09-73b3-4ae5-90c2-ffa2c2b3b41f tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca.22864e9e-3df2-4967-ab7e-8d18e061a408 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:22 devstack sudo[99714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca.22864e9e-3df2-4967-ab7e-8d18e061a408 Jun 24 05:02:22 devstack sudo[99714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:23 devstack sudo[99712]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-19ad5d61-39d7-47f4-bfad-1421480f4745 tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 2.242s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:23 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-19ad5d61-39d7-47f4-bfad-1421480f4745 tempest-GroupSnapshotsTest-1374070386 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:02:23 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-19ad5d61-39d7-47f4-bfad-1421480f4745 tempest-GroupSnapshotsTest-1374070386 None] Delete group completed successfully. Jun 24 05:02:24 devstack sudo[99714]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-48490c09-73b3-4ae5-90c2-ffa2c2b3b41f tempest-GroupSnapshotsTest-1374070386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca.22864e9e-3df2-4967-ab7e-8d18e061a408" returned: 0 in 1.771s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:24 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-48490c09-73b3-4ae5-90c2-ffa2c2b3b41f tempest-GroupSnapshotsTest-1374070386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:02:24 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d8b0b6-36e8-4b24-8d95-4370a34645ad]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:02:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-48490c09-73b3-4ae5-90c2-ffa2c2b3b41f tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:24 devstack sudo[99780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca Jun 24 05:02:24 devstack sudo[99780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:25 devstack sudo[99780]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-48490c09-73b3-4ae5-90c2-ffa2c2b3b41f tempest-GroupSnapshotsTest-1374070386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca" returned: 0 in 1.466s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-48490c09-73b3-4ae5-90c2-ffa2c2b3b41f tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca.22864e9e-3df2-4967-ab7e-8d18e061a408 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:25 devstack sudo[99790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca.22864e9e-3df2-4967-ab7e-8d18e061a408 Jun 24 05:02:25 devstack sudo[99790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:26 devstack sudo[99790]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-48490c09-73b3-4ae5-90c2-ffa2c2b3b41f tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca.22864e9e-3df2-4967-ab7e-8d18e061a408" returned: 0 in 1.184s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-48490c09-73b3-4ae5-90c2-ffa2c2b3b41f tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca.22864e9e-3df2-4967-ab7e-8d18e061a408 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:26 devstack sudo[99796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca.22864e9e-3df2-4967-ab7e-8d18e061a408 Jun 24 05:02:26 devstack sudo[99796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:27 devstack sudo[99796]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-48490c09-73b3-4ae5-90c2-ffa2c2b3b41f tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca.22864e9e-3df2-4967-ab7e-8d18e061a408" returned: 0 in 0.843s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:27 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-48490c09-73b3-4ae5-90c2-ffa2c2b3b41f tempest-GroupSnapshotsTest-1374070386 None] Lock "cinder-quobyte-22864e9e-3df2-4967-ab7e-8d18e061a408" released by "_delete_snapshot" :: held 5.598s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:02:27 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-48490c09-73b3-4ae5-90c2-ffa2c2b3b41f tempest-GroupSnapshotsTest-1374070386 None] Lock "cinder-quobyte-d785a9e2-a2b0-44ef-855b-afbc680e7bca" released by "delete_snapshot" :: held 5.699s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:02:27 devstack cinder-volume[93830]: WARNING cinder.quota [None req-48490c09-73b3-4ae5-90c2-ffa2c2b3b41f tempest-GroupSnapshotsTest-1374070386 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-999668273 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-999668273, it is now deprecated. Please use the default quota class for default quota. Jun 24 05:02:28 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-48490c09-73b3-4ae5-90c2-ffa2c2b3b41f tempest-GroupSnapshotsTest-1374070386 None] Created reservations ['e7cacfcd-b07b-495f-8104-a615d04fceba', 'a8f75631-5d61-438e-8424-e3ae4c0f1564', 'c5a93d79-5b74-41c5-aed2-af734c711cd5', '6acad716-0412-4763-986f-7813d92250e2'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:02:28 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-48490c09-73b3-4ae5-90c2-ffa2c2b3b41f tempest-GroupSnapshotsTest-1374070386 None] group_snapshot 29b5cc47-6f35-4723-8dc0-23fb4518294d: deleted successfully Jun 24 05:02:29 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-5a6b9eb1-3e3b-4f7c-8a75-1cf1f901e59a tempest-GroupSnapshotsTest-1374070386 None] Acquiring lock "cinder-quobyte-d785a9e2-a2b0-44ef-855b-afbc680e7bca" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:02:29 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-5a6b9eb1-3e3b-4f7c-8a75-1cf1f901e59a tempest-GroupSnapshotsTest-1374070386 None] Lock "cinder-quobyte-d785a9e2-a2b0-44ef-855b-afbc680e7bca" acquired by "delete_volume" :: waited 0.031s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:02:29 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[84601f05-2bd6-4333-88dd-e48ce454bbce]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:02:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5a6b9eb1-3e3b-4f7c-8a75-1cf1f901e59a tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:29 devstack sudo[99799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca Jun 24 05:02:29 devstack sudo[99799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:30 devstack sudo[99799]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5a6b9eb1-3e3b-4f7c-8a75-1cf1f901e59a tempest-GroupSnapshotsTest-1374070386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca" returned: 0 in 0.878s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5a6b9eb1-3e3b-4f7c-8a75-1cf1f901e59a tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:30 devstack sudo[99808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca Jun 24 05:02:30 devstack sudo[99808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:31 devstack sudo[99808]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5a6b9eb1-3e3b-4f7c-8a75-1cf1f901e59a tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d785a9e2-a2b0-44ef-855b-afbc680e7bca" returned: 0 in 0.828s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:31 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-5a6b9eb1-3e3b-4f7c-8a75-1cf1f901e59a tempest-GroupSnapshotsTest-1374070386 None] Lock "cinder-quobyte-d785a9e2-a2b0-44ef-855b-afbc680e7bca" released by "delete_volume" :: held 1.788s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:02:31 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-5a6b9eb1-3e3b-4f7c-8a75-1cf1f901e59a tempest-GroupSnapshotsTest-1374070386 None] Created reservations ['55213fac-b8b9-49d1-8af7-211319bbbb16'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:02:31 devstack cinder-volume[93830]: WARNING cinder.db.api [None req-5a6b9eb1-3e3b-4f7c-8a75-1cf1f901e59a tempest-GroupSnapshotsTest-1374070386 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-999668273'] Jun 24 05:02:31 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-5a6b9eb1-3e3b-4f7c-8a75-1cf1f901e59a tempest-GroupSnapshotsTest-1374070386 None] Created reservations ['2c3496db-5b98-416b-b7b3-543a3e4a78fd', '60ee7c6c-dfd2-4ac5-9dff-72bb35d79f23', 'd959abd3-b60c-4765-95e9-2ea04f79ab70', 'e1199cd1-f430-46b2-8dbd-3447731e13ff'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:02:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5a6b9eb1-3e3b-4f7c-8a75-1cf1f901e59a tempest-GroupSnapshotsTest-1374070386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:02:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5a6b9eb1-3e3b-4f7c-8a75-1cf1f901e59a tempest-GroupSnapshotsTest-1374070386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:02:31 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-5a6b9eb1-3e3b-4f7c-8a75-1cf1f901e59a tempest-GroupSnapshotsTest-1374070386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:02:31 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-5a6b9eb1-3e3b-4f7c-8a75-1cf1f901e59a tempest-GroupSnapshotsTest-1374070386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:02:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5a6b9eb1-3e3b-4f7c-8a75-1cf1f901e59a tempest-GroupSnapshotsTest-1374070386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:02:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5a6b9eb1-3e3b-4f7c-8a75-1cf1f901e59a tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:31 devstack sudo[99814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:02:31 devstack sudo[99814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:32 devstack sudo[99814]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5a6b9eb1-3e3b-4f7c-8a75-1cf1f901e59a tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 1.108s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:32 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-5a6b9eb1-3e3b-4f7c-8a75-1cf1f901e59a tempest-GroupSnapshotsTest-1374070386 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:02:32 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-5a6b9eb1-3e3b-4f7c-8a75-1cf1f901e59a tempest-GroupSnapshotsTest-1374070386 None] Delete group completed successfully. Jun 24 05:02:33 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-c64944b0-9fce-40e4-b0e8-aa50eec8e240 tempest-GroupSnapshotsTest-1374070386 None] Group tempest-GroupSnapshotsTest-Group-593727172: creating Jun 24 05:02:33 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-c64944b0-9fce-40e4-b0e8-aa50eec8e240 tempest-GroupSnapshotsTest-1374070386 None] Group tempest-GroupSnapshotsTest-Group-593727172: created successfully Jun 24 05:02:33 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-c64944b0-9fce-40e4-b0e8-aa50eec8e240 tempest-GroupSnapshotsTest-1374070386 None] Create group completed successfully. Jun 24 05:02:35 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c98deee-88ce-4114-bdd1-b9cea31e78b3 tempest-GroupSnapshotsTest-1374070386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:02:35 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3c98deee-88ce-4114-bdd1-b9cea31e78b3 tempest-GroupSnapshotsTest-1374070386 None] Flow 'volume_create_manager' (270eaf1e-6083-4fe5-a2f2-8355b491a44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:02:35 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3c98deee-88ce-4114-bdd1-b9cea31e78b3 tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39714ee4-430d-42ff-9956-5d693cffb6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:02:35 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3c98deee-88ce-4114-bdd1-b9cea31e78b3 tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39714ee4-430d-42ff-9956-5d693cffb6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-855497125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b654e623-da6f-4a6a-8273-da97d59fc0ea,host='devstack@QuobyteHD#QuobyteHD',id=df167255-8e13-4971-a71b-a9578cb3c6fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='468985bfe8844337a5741f9806c71d29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:02:35Z,use_quota=True,user_id='e18311c9dd0a4efd992192892804432b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee4e93e6-2b71-4076-8cc3-94b12d0db4f6),volume_type_id=ee4e93e6-2b71-4076-8cc3-94b12d0db4f6)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:02:35 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3c98deee-88ce-4114-bdd1-b9cea31e78b3 tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a76e6bda-eeb4-49dd-baf9-640ef938e4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:02:35 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3c98deee-88ce-4114-bdd1-b9cea31e78b3 tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a76e6bda-eeb4-49dd-baf9-640ef938e4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:02:35 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3c98deee-88ce-4114-bdd1-b9cea31e78b3 tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (500083f6-eeb8-4599-8981-b678e615af5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:02:35 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3c98deee-88ce-4114-bdd1-b9cea31e78b3 tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (500083f6-eeb8-4599-8981-b678e615af5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df167255-8e13-4971-a71b-a9578cb3c6fc', 'volume_name': 'volume-df167255-8e13-4971-a71b-a9578cb3c6fc', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:02:35 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3c98deee-88ce-4114-bdd1-b9cea31e78b3 tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc085ef8-9fea-4bf4-9f72-aa4d97a1cc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:02:35 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3c98deee-88ce-4114-bdd1-b9cea31e78b3 tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc085ef8-9fea-4bf4-9f72-aa4d97a1cc56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:02:35 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3c98deee-88ce-4114-bdd1-b9cea31e78b3 tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b707925-8f1a-434f-86a8-a2245b0890c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:02:35 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-3c98deee-88ce-4114-bdd1-b9cea31e78b3 tempest-GroupSnapshotsTest-1374070386 None] Volume df167255-8e13-4971-a71b-a9578cb3c6fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df167255-8e13-4971-a71b-a9578cb3c6fc', 'volume_size': 1} Jun 24 05:02:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3c98deee-88ce-4114-bdd1-b9cea31e78b3 tempest-GroupSnapshotsTest-1374070386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:02:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3c98deee-88ce-4114-bdd1-b9cea31e78b3 tempest-GroupSnapshotsTest-1374070386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:02:35 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-3c98deee-88ce-4114-bdd1-b9cea31e78b3 tempest-GroupSnapshotsTest-1374070386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b654e623-da6f-4a6a-8273-da97d59fc0ea,created_at=2026-06-24T03:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-855497125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b654e623-da6f-4a6a-8273-da97d59fc0ea,host='devstack@QuobyteHD#QuobyteHD',id=df167255-8e13-4971-a71b-a9578cb3c6fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='468985bfe8844337a5741f9806c71d29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:02:35Z,use_quota=True,user_id='e18311c9dd0a4efd992192892804432b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee4e93e6-2b71-4076-8cc3-94b12d0db4f6),volume_type_id=ee4e93e6-2b71-4076-8cc3-94b12d0db4f6)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:02:35 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-3c98deee-88ce-4114-bdd1-b9cea31e78b3 tempest-GroupSnapshotsTest-1374070386 None] Creating volume df167255-8e13-4971-a71b-a9578cb3c6fc {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:02:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3c98deee-88ce-4114-bdd1-b9cea31e78b3 tempest-GroupSnapshotsTest-1374070386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:02:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3c98deee-88ce-4114-bdd1-b9cea31e78b3 tempest-GroupSnapshotsTest-1374070386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:02:35 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-3c98deee-88ce-4114-bdd1-b9cea31e78b3 tempest-GroupSnapshotsTest-1374070386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:02:35 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-3c98deee-88ce-4114-bdd1-b9cea31e78b3 tempest-GroupSnapshotsTest-1374070386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:02:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3c98deee-88ce-4114-bdd1-b9cea31e78b3 tempest-GroupSnapshotsTest-1374070386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:02:35 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-3c98deee-88ce-4114-bdd1-b9cea31e78b3 tempest-GroupSnapshotsTest-1374070386 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:02:35 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-3c98deee-88ce-4114-bdd1-b9cea31e78b3 tempest-GroupSnapshotsTest-1374070386 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:02:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3c98deee-88ce-4114-bdd1-b9cea31e78b3 tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:35 devstack sudo[99926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc 1073741824 Jun 24 05:02:35 devstack sudo[99926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:36 devstack sudo[99926]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3c98deee-88ce-4114-bdd1-b9cea31e78b3 tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc 1073741824" returned: 0 in 1.407s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3c98deee-88ce-4114-bdd1-b9cea31e78b3 tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:36 devstack sudo[99932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc Jun 24 05:02:36 devstack sudo[99932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:37 devstack sudo[99932]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3c98deee-88ce-4114-bdd1-b9cea31e78b3 tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc" returned: 0 in 0.987s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:37 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-3c98deee-88ce-4114-bdd1-b9cea31e78b3 tempest-GroupSnapshotsTest-1374070386 None] <== create_volume: return (2469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:02:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3c98deee-88ce-4114-bdd1-b9cea31e78b3 tempest-GroupSnapshotsTest-1374070386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.473s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:02:37 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3c98deee-88ce-4114-bdd1-b9cea31e78b3 tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b707925-8f1a-434f-86a8-a2245b0890c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df167255-8e13-4971-a71b-a9578cb3c6fc', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:02:37 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3c98deee-88ce-4114-bdd1-b9cea31e78b3 tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a71adff-8882-46ac-aed8-390513566724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:02:37 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-3c98deee-88ce-4114-bdd1-b9cea31e78b3 tempest-GroupSnapshotsTest-1374070386 None] Volume volume-df167255-8e13-4971-a71b-a9578cb3c6fc (df167255-8e13-4971-a71b-a9578cb3c6fc): created successfully Jun 24 05:02:37 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3c98deee-88ce-4114-bdd1-b9cea31e78b3 tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a71adff-8882-46ac-aed8-390513566724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:02:37 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3c98deee-88ce-4114-bdd1-b9cea31e78b3 tempest-GroupSnapshotsTest-1374070386 None] Flow 'volume_create_manager' (270eaf1e-6083-4fe5-a2f2-8355b491a44b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:02:37 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-3c98deee-88ce-4114-bdd1-b9cea31e78b3 tempest-GroupSnapshotsTest-1374070386 None] Created volume successfully. Jun 24 05:02:39 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-4911a8b7-2781-4b49-965e-67f4e61387d1 tempest-VolumesServicesTestJSON-1380463948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:02:39 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4911a8b7-2781-4b49-965e-67f4e61387d1 tempest-VolumesServicesTestJSON-1380463948 None] Flow 'volume_create_manager' (360f8f87-d8c2-4d84-a42d-0115b60bec58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:02:39 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4911a8b7-2781-4b49-965e-67f4e61387d1 tempest-VolumesServicesTestJSON-1380463948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ac00404-a777-4fa2-b9ff-7480c9460a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:02:39 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4911a8b7-2781-4b49-965e-67f4e61387d1 tempest-VolumesServicesTestJSON-1380463948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ac00404-a777-4fa2-b9ff-7480c9460a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:02:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-598183746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1f1014e-daba-431e-acbb-686deeba129b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2777bf857630437abf0af9a95f33741c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:02:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:02:39Z,use_quota=True,user_id='4bf79e4c5f074b7ab4117412c5a9fc02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:02:39 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4911a8b7-2781-4b49-965e-67f4e61387d1 tempest-VolumesServicesTestJSON-1380463948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ff646f3-c09c-4570-836c-ce853c910a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:02:39 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4911a8b7-2781-4b49-965e-67f4e61387d1 tempest-VolumesServicesTestJSON-1380463948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ff646f3-c09c-4570-836c-ce853c910a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:02:39 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4911a8b7-2781-4b49-965e-67f4e61387d1 tempest-VolumesServicesTestJSON-1380463948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55bace94-c7ea-4a4e-8221-88ed5d202c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:02:39 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4911a8b7-2781-4b49-965e-67f4e61387d1 tempest-VolumesServicesTestJSON-1380463948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55bace94-c7ea-4a4e-8221-88ed5d202c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1f1014e-daba-431e-acbb-686deeba129b', 'volume_name': 'volume-e1f1014e-daba-431e-acbb-686deeba129b', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:02:39 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4911a8b7-2781-4b49-965e-67f4e61387d1 tempest-VolumesServicesTestJSON-1380463948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f4604ad-c100-4c7e-9d8a-dc5942bd04d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:02:39 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4911a8b7-2781-4b49-965e-67f4e61387d1 tempest-VolumesServicesTestJSON-1380463948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f4604ad-c100-4c7e-9d8a-dc5942bd04d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:02:39 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4911a8b7-2781-4b49-965e-67f4e61387d1 tempest-VolumesServicesTestJSON-1380463948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ff1713f-c9a8-4823-b264-41b1b9107df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:02:39 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-4911a8b7-2781-4b49-965e-67f4e61387d1 tempest-VolumesServicesTestJSON-1380463948 None] Volume e1f1014e-daba-431e-acbb-686deeba129b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1f1014e-daba-431e-acbb-686deeba129b', 'volume_size': 1} Jun 24 05:02:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4911a8b7-2781-4b49-965e-67f4e61387d1 tempest-VolumesServicesTestJSON-1380463948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:02:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4911a8b7-2781-4b49-965e-67f4e61387d1 tempest-VolumesServicesTestJSON-1380463948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:02:39 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-4911a8b7-2781-4b49-965e-67f4e61387d1 tempest-VolumesServicesTestJSON-1380463948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:02:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-598183746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1f1014e-daba-431e-acbb-686deeba129b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2777bf857630437abf0af9a95f33741c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:02:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:02:39Z,use_quota=True,user_id='4bf79e4c5f074b7ab4117412c5a9fc02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:02:39 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-4911a8b7-2781-4b49-965e-67f4e61387d1 tempest-VolumesServicesTestJSON-1380463948 None] Creating volume e1f1014e-daba-431e-acbb-686deeba129b {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:02:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4911a8b7-2781-4b49-965e-67f4e61387d1 tempest-VolumesServicesTestJSON-1380463948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:02:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4911a8b7-2781-4b49-965e-67f4e61387d1 tempest-VolumesServicesTestJSON-1380463948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:02:39 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-4911a8b7-2781-4b49-965e-67f4e61387d1 tempest-VolumesServicesTestJSON-1380463948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:02:39 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-4911a8b7-2781-4b49-965e-67f4e61387d1 tempest-VolumesServicesTestJSON-1380463948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:02:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4911a8b7-2781-4b49-965e-67f4e61387d1 tempest-VolumesServicesTestJSON-1380463948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:02:39 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-4911a8b7-2781-4b49-965e-67f4e61387d1 tempest-VolumesServicesTestJSON-1380463948 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:02:39 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-4911a8b7-2781-4b49-965e-67f4e61387d1 tempest-VolumesServicesTestJSON-1380463948 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:02:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4911a8b7-2781-4b49-965e-67f4e61387d1 tempest-VolumesServicesTestJSON-1380463948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e1f1014e-daba-431e-acbb-686deeba129b 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:39 devstack sudo[99937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e1f1014e-daba-431e-acbb-686deeba129b 1073741824 Jun 24 05:02:39 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:39 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-5190743e-1189-45d4-9c64-acadb4aa0e7e tempest-GroupSnapshotsTest-1374070386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:02:39 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5190743e-1189-45d4-9c64-acadb4aa0e7e tempest-GroupSnapshotsTest-1374070386 None] Flow 'volume_create_manager' (feaec33b-8975-4a94-9299-ec96c45204bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:02:39 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5190743e-1189-45d4-9c64-acadb4aa0e7e tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f06603bb-14b6-45cf-9636-b68841ea5a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:02:39 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5190743e-1189-45d4-9c64-acadb4aa0e7e tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f06603bb-14b6-45cf-9636-b68841ea5a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:02:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2136702979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b654e623-da6f-4a6a-8273-da97d59fc0ea,host='devstack@QuobyteHD#QuobyteHD',id=cf7012b3-c032-4237-b080-20a2adf6d231,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='468985bfe8844337a5741f9806c71d29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:02:40Z,use_quota=True,user_id='e18311c9dd0a4efd992192892804432b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee4e93e6-2b71-4076-8cc3-94b12d0db4f6),volume_type_id=ee4e93e6-2b71-4076-8cc3-94b12d0db4f6)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:02:39 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5190743e-1189-45d4-9c64-acadb4aa0e7e tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f5ef9c7-9dcc-470a-8060-72ae6ef1c71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:02:39 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5190743e-1189-45d4-9c64-acadb4aa0e7e tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f5ef9c7-9dcc-470a-8060-72ae6ef1c71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:02:39 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5190743e-1189-45d4-9c64-acadb4aa0e7e tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3148f3f2-2c34-4f2e-a9c3-5d53363f6a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:02:39 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5190743e-1189-45d4-9c64-acadb4aa0e7e tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3148f3f2-2c34-4f2e-a9c3-5d53363f6a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf7012b3-c032-4237-b080-20a2adf6d231', 'volume_name': 'volume-cf7012b3-c032-4237-b080-20a2adf6d231', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:02:39 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5190743e-1189-45d4-9c64-acadb4aa0e7e tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59174147-4d69-497b-8730-642af6d0adab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:02:39 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5190743e-1189-45d4-9c64-acadb4aa0e7e tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59174147-4d69-497b-8730-642af6d0adab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:02:39 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5190743e-1189-45d4-9c64-acadb4aa0e7e tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b397d91-942d-4616-ab84-3ef1d8c00a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:02:39 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-5190743e-1189-45d4-9c64-acadb4aa0e7e tempest-GroupSnapshotsTest-1374070386 None] Volume cf7012b3-c032-4237-b080-20a2adf6d231: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf7012b3-c032-4237-b080-20a2adf6d231', 'volume_size': 1} Jun 24 05:02:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5190743e-1189-45d4-9c64-acadb4aa0e7e tempest-GroupSnapshotsTest-1374070386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:02:40 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4911a8b7-2781-4b49-965e-67f4e61387d1 tempest-VolumesServicesTestJSON-1380463948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e1f1014e-daba-431e-acbb-686deeba129b 1073741824" returned: 0 in 0.940s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4911a8b7-2781-4b49-965e-67f4e61387d1 tempest-VolumesServicesTestJSON-1380463948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e1f1014e-daba-431e-acbb-686deeba129b {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:40 devstack sudo[99944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e1f1014e-daba-431e-acbb-686deeba129b Jun 24 05:02:40 devstack sudo[99944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:41 devstack sudo[99944]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4911a8b7-2781-4b49-965e-67f4e61387d1 tempest-VolumesServicesTestJSON-1380463948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e1f1014e-daba-431e-acbb-686deeba129b" returned: 0 in 0.658s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:41 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-4911a8b7-2781-4b49-965e-67f4e61387d1 tempest-VolumesServicesTestJSON-1380463948 None] <== create_volume: return (1643ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:02:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4911a8b7-2781-4b49-965e-67f4e61387d1 tempest-VolumesServicesTestJSON-1380463948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.646s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:02:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5190743e-1189-45d4-9c64-acadb4aa0e7e tempest-GroupSnapshotsTest-1374070386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.193s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:02:41 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-5190743e-1189-45d4-9c64-acadb4aa0e7e tempest-GroupSnapshotsTest-1374070386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b654e623-da6f-4a6a-8273-da97d59fc0ea,created_at=2026-06-24T03:02:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2136702979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b654e623-da6f-4a6a-8273-da97d59fc0ea,host='devstack@QuobyteHD#QuobyteHD',id=cf7012b3-c032-4237-b080-20a2adf6d231,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='468985bfe8844337a5741f9806c71d29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:02:40Z,use_quota=True,user_id='e18311c9dd0a4efd992192892804432b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee4e93e6-2b71-4076-8cc3-94b12d0db4f6),volume_type_id=ee4e93e6-2b71-4076-8cc3-94b12d0db4f6)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:02:41 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-5190743e-1189-45d4-9c64-acadb4aa0e7e tempest-GroupSnapshotsTest-1374070386 None] Creating volume cf7012b3-c032-4237-b080-20a2adf6d231 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:02:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5190743e-1189-45d4-9c64-acadb4aa0e7e tempest-GroupSnapshotsTest-1374070386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:02:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5190743e-1189-45d4-9c64-acadb4aa0e7e tempest-GroupSnapshotsTest-1374070386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:02:41 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-5190743e-1189-45d4-9c64-acadb4aa0e7e tempest-GroupSnapshotsTest-1374070386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:02:41 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-5190743e-1189-45d4-9c64-acadb4aa0e7e tempest-GroupSnapshotsTest-1374070386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:02:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5190743e-1189-45d4-9c64-acadb4aa0e7e tempest-GroupSnapshotsTest-1374070386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:02:41 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-5190743e-1189-45d4-9c64-acadb4aa0e7e tempest-GroupSnapshotsTest-1374070386 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:02:41 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-5190743e-1189-45d4-9c64-acadb4aa0e7e tempest-GroupSnapshotsTest-1374070386 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:02:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5190743e-1189-45d4-9c64-acadb4aa0e7e tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:41 devstack sudo[99947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231 1073741824 Jun 24 05:02:41 devstack sudo[99947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4911a8b7-2781-4b49-965e-67f4e61387d1 tempest-VolumesServicesTestJSON-1380463948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ff1713f-c9a8-4823-b264-41b1b9107df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1f1014e-daba-431e-acbb-686deeba129b', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:02:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4911a8b7-2781-4b49-965e-67f4e61387d1 tempest-VolumesServicesTestJSON-1380463948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45199ff1-dc94-4119-abfb-f91cf24b67dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:02:41 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-4911a8b7-2781-4b49-965e-67f4e61387d1 tempest-VolumesServicesTestJSON-1380463948 None] Volume volume-e1f1014e-daba-431e-acbb-686deeba129b (e1f1014e-daba-431e-acbb-686deeba129b): created successfully Jun 24 05:02:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4911a8b7-2781-4b49-965e-67f4e61387d1 tempest-VolumesServicesTestJSON-1380463948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45199ff1-dc94-4119-abfb-f91cf24b67dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:02:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4911a8b7-2781-4b49-965e-67f4e61387d1 tempest-VolumesServicesTestJSON-1380463948 None] Flow 'volume_create_manager' (360f8f87-d8c2-4d84-a42d-0115b60bec58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:02:41 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-4911a8b7-2781-4b49-965e-67f4e61387d1 tempest-VolumesServicesTestJSON-1380463948 None] Created volume successfully. Jun 24 05:02:41 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3668c43f-a088-4fb5-aab3-b2f42af4da64 tempest-VolumesServicesTestJSON-1380463948 None] Acquiring lock "cinder-e1f1014e-daba-431e-acbb-686deeba129b-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:02:41 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3668c43f-a088-4fb5-aab3-b2f42af4da64 tempest-VolumesServicesTestJSON-1380463948 None] Lock "cinder-e1f1014e-daba-431e-acbb-686deeba129b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:02:41 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:SELECT=76,cinder:INSERT=21,cinder:UPDATE=77,cinder:DELETE=3 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:02:41 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3668c43f-a088-4fb5-aab3-b2f42af4da64 tempest-VolumesServicesTestJSON-1380463948 None] Acquiring lock "cinder-quobyte-e1f1014e-daba-431e-acbb-686deeba129b" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:02:41 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3668c43f-a088-4fb5-aab3-b2f42af4da64 tempest-VolumesServicesTestJSON-1380463948 None] Lock "cinder-quobyte-e1f1014e-daba-431e-acbb-686deeba129b" acquired by "delete_volume" :: waited 0.020s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:02:41 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[80bd4c03-498a-45ea-be82-f2cb54b1066a]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:02:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3668c43f-a088-4fb5-aab3-b2f42af4da64 tempest-VolumesServicesTestJSON-1380463948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e1f1014e-daba-431e-acbb-686deeba129b {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:41 devstack sudo[99949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e1f1014e-daba-431e-acbb-686deeba129b Jun 24 05:02:41 devstack sudo[99949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:42 devstack sudo[99947]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5190743e-1189-45d4-9c64-acadb4aa0e7e tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231 1073741824" returned: 0 in 0.862s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5190743e-1189-45d4-9c64-acadb4aa0e7e tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:42 devstack sudo[99955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231 Jun 24 05:02:42 devstack sudo[99955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:42 devstack sudo[99949]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3668c43f-a088-4fb5-aab3-b2f42af4da64 tempest-VolumesServicesTestJSON-1380463948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e1f1014e-daba-431e-acbb-686deeba129b" returned: 0 in 0.810s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3668c43f-a088-4fb5-aab3-b2f42af4da64 tempest-VolumesServicesTestJSON-1380463948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e1f1014e-daba-431e-acbb-686deeba129b {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:42 devstack sudo[99960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e1f1014e-daba-431e-acbb-686deeba129b Jun 24 05:02:42 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:42 devstack sudo[99955]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5190743e-1189-45d4-9c64-acadb4aa0e7e tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231" returned: 0 in 0.705s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:42 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-5190743e-1189-45d4-9c64-acadb4aa0e7e tempest-GroupSnapshotsTest-1374070386 None] <== create_volume: return (1620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:02:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5190743e-1189-45d4-9c64-acadb4aa0e7e tempest-GroupSnapshotsTest-1374070386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:02:42 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5190743e-1189-45d4-9c64-acadb4aa0e7e tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b397d91-942d-4616-ab84-3ef1d8c00a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf7012b3-c032-4237-b080-20a2adf6d231', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:02:42 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5190743e-1189-45d4-9c64-acadb4aa0e7e tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f067284-315c-4bb9-a573-99e5f669f537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:02:42 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-5190743e-1189-45d4-9c64-acadb4aa0e7e tempest-GroupSnapshotsTest-1374070386 None] Volume volume-cf7012b3-c032-4237-b080-20a2adf6d231 (cf7012b3-c032-4237-b080-20a2adf6d231): created successfully Jun 24 05:02:42 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5190743e-1189-45d4-9c64-acadb4aa0e7e tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f067284-315c-4bb9-a573-99e5f669f537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:02:42 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5190743e-1189-45d4-9c64-acadb4aa0e7e tempest-GroupSnapshotsTest-1374070386 None] Flow 'volume_create_manager' (feaec33b-8975-4a94-9299-ec96c45204bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:02:42 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-5190743e-1189-45d4-9c64-acadb4aa0e7e tempest-GroupSnapshotsTest-1374070386 None] Created volume successfully. Jun 24 05:02:43 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3668c43f-a088-4fb5-aab3-b2f42af4da64 tempest-VolumesServicesTestJSON-1380463948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e1f1014e-daba-431e-acbb-686deeba129b" returned: 0 in 0.721s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:43 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3668c43f-a088-4fb5-aab3-b2f42af4da64 tempest-VolumesServicesTestJSON-1380463948 None] Lock "cinder-quobyte-e1f1014e-daba-431e-acbb-686deeba129b" released by "delete_volume" :: held 1.594s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:02:43 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-3668c43f-a088-4fb5-aab3-b2f42af4da64 tempest-VolumesServicesTestJSON-1380463948 None] Created reservations ['b3bb5f56-edba-4776-8867-67b309ec4c49', '2f3eb649-92a3-4cdb-b6db-6ac7c8d5ccb2', '249a58cf-10e1-4281-8ca9-6646f19c4e04', '3c9827d9-2f47-4815-894e-8db03b1ced21'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:02:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3668c43f-a088-4fb5-aab3-b2f42af4da64 tempest-VolumesServicesTestJSON-1380463948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:02:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3668c43f-a088-4fb5-aab3-b2f42af4da64 tempest-VolumesServicesTestJSON-1380463948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:02:43 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-3668c43f-a088-4fb5-aab3-b2f42af4da64 tempest-VolumesServicesTestJSON-1380463948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:02:43 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-3668c43f-a088-4fb5-aab3-b2f42af4da64 tempest-VolumesServicesTestJSON-1380463948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:02:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3668c43f-a088-4fb5-aab3-b2f42af4da64 tempest-VolumesServicesTestJSON-1380463948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:02:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3668c43f-a088-4fb5-aab3-b2f42af4da64 tempest-VolumesServicesTestJSON-1380463948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:43 devstack sudo[99964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:02:43 devstack sudo[99964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:43 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-2dbcd0ed-a0e8-4909-aa82-2683afd6e01b tempest-GroupSnapshotsTest-1374070386 None] Update group completed successfully. Jun 24 05:02:44 devstack sudo[99964]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3668c43f-a088-4fb5-aab3-b2f42af4da64 tempest-VolumesServicesTestJSON-1380463948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.708s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:44 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-3668c43f-a088-4fb5-aab3-b2f42af4da64 tempest-VolumesServicesTestJSON-1380463948 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:02:44 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-3668c43f-a088-4fb5-aab3-b2f42af4da64 tempest-VolumesServicesTestJSON-1380463948 None] Deleted volume successfully. Jun 24 05:02:44 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3668c43f-a088-4fb5-aab3-b2f42af4da64 tempest-VolumesServicesTestJSON-1380463948 None] Lock "cinder-e1f1014e-daba-431e-acbb-686deeba129b-delete_volume" released by "delete_volume" :: held 2.552s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:02:44 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-46de8043-4baa-4901-8dc7-76ffe46be746 tempest-GroupSnapshotsTest-1374070386 None] Update group completed successfully. Jun 24 05:02:45 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5bdca0b-8881-404b-a1e7-27b4967bdc6b tempest-ServerActionsTestOtherA-1758477181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:02:46 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b5bdca0b-8881-404b-a1e7-27b4967bdc6b tempest-ServerActionsTestOtherA-1758477181 None] Flow 'volume_create_manager' (06c00f3e-076a-4530-b6d7-4a0d36fcd12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:02:46 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b5bdca0b-8881-404b-a1e7-27b4967bdc6b tempest-ServerActionsTestOtherA-1758477181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16cf7558-69db-493e-9dc5-2becf6caa597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:02:46 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b5bdca0b-8881-404b-a1e7-27b4967bdc6b tempest-ServerActionsTestOtherA-1758477181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16cf7558-69db-493e-9dc5-2becf6caa597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-989967544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee9ad562-6754-4f5e-bb59-e29c736fa7f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='505120531f6d49ff8a30208ebaa989ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:02:46Z,use_quota=True,user_id='17031dd5735241f4ae55a6cd875af028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:02:46 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b5bdca0b-8881-404b-a1e7-27b4967bdc6b tempest-ServerActionsTestOtherA-1758477181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40cc9a86-0c72-4eed-a3de-d2b489dc243e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:02:46 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b5bdca0b-8881-404b-a1e7-27b4967bdc6b tempest-ServerActionsTestOtherA-1758477181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40cc9a86-0c72-4eed-a3de-d2b489dc243e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:02:46 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b5bdca0b-8881-404b-a1e7-27b4967bdc6b tempest-ServerActionsTestOtherA-1758477181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e08be0fc-d50d-4bc4-b1de-40648dc74b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:02:46 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b5bdca0b-8881-404b-a1e7-27b4967bdc6b tempest-ServerActionsTestOtherA-1758477181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e08be0fc-d50d-4bc4-b1de-40648dc74b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee9ad562-6754-4f5e-bb59-e29c736fa7f4', 'volume_name': 'volume-ee9ad562-6754-4f5e-bb59-e29c736fa7f4', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:02:46 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b5bdca0b-8881-404b-a1e7-27b4967bdc6b tempest-ServerActionsTestOtherA-1758477181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (575ca644-cb12-4304-aa5d-9695d4d34c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:02:46 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b5bdca0b-8881-404b-a1e7-27b4967bdc6b tempest-ServerActionsTestOtherA-1758477181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (575ca644-cb12-4304-aa5d-9695d4d34c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:02:46 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b5bdca0b-8881-404b-a1e7-27b4967bdc6b tempest-ServerActionsTestOtherA-1758477181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a78849f-d322-4445-b1c7-b9637ab7b170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:02:46 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-b5bdca0b-8881-404b-a1e7-27b4967bdc6b tempest-ServerActionsTestOtherA-1758477181 None] Volume ee9ad562-6754-4f5e-bb59-e29c736fa7f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee9ad562-6754-4f5e-bb59-e29c736fa7f4', 'volume_size': 1} Jun 24 05:02:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-b5bdca0b-8881-404b-a1e7-27b4967bdc6b tempest-ServerActionsTestOtherA-1758477181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:02:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-b5bdca0b-8881-404b-a1e7-27b4967bdc6b tempest-ServerActionsTestOtherA-1758477181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:02:46 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-b5bdca0b-8881-404b-a1e7-27b4967bdc6b tempest-ServerActionsTestOtherA-1758477181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-989967544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee9ad562-6754-4f5e-bb59-e29c736fa7f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='505120531f6d49ff8a30208ebaa989ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:02:46Z,use_quota=True,user_id='17031dd5735241f4ae55a6cd875af028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:02:46 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-b5bdca0b-8881-404b-a1e7-27b4967bdc6b tempest-ServerActionsTestOtherA-1758477181 None] Creating volume ee9ad562-6754-4f5e-bb59-e29c736fa7f4 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:02:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-b5bdca0b-8881-404b-a1e7-27b4967bdc6b tempest-ServerActionsTestOtherA-1758477181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:02:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-b5bdca0b-8881-404b-a1e7-27b4967bdc6b tempest-ServerActionsTestOtherA-1758477181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:02:46 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-b5bdca0b-8881-404b-a1e7-27b4967bdc6b tempest-ServerActionsTestOtherA-1758477181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:02:46 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-b5bdca0b-8881-404b-a1e7-27b4967bdc6b tempest-ServerActionsTestOtherA-1758477181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:02:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-b5bdca0b-8881-404b-a1e7-27b4967bdc6b tempest-ServerActionsTestOtherA-1758477181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:02:46 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-b5bdca0b-8881-404b-a1e7-27b4967bdc6b tempest-ServerActionsTestOtherA-1758477181 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:02:46 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-b5bdca0b-8881-404b-a1e7-27b4967bdc6b tempest-ServerActionsTestOtherA-1758477181 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:02:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-b5bdca0b-8881-404b-a1e7-27b4967bdc6b tempest-ServerActionsTestOtherA-1758477181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ee9ad562-6754-4f5e-bb59-e29c736fa7f4 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:46 devstack sudo[99992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ee9ad562-6754-4f5e-bb59-e29c736fa7f4 1073741824 Jun 24 05:02:46 devstack sudo[99992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:46 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-835e2872-8057-4ddd-a948-f2967973a795 tempest-GroupSnapshotsTest-1374070386 None] Update group completed successfully. Jun 24 05:02:47 devstack sudo[99992]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-b5bdca0b-8881-404b-a1e7-27b4967bdc6b tempest-ServerActionsTestOtherA-1758477181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ee9ad562-6754-4f5e-bb59-e29c736fa7f4 1073741824" returned: 0 in 1.152s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-b5bdca0b-8881-404b-a1e7-27b4967bdc6b tempest-ServerActionsTestOtherA-1758477181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ee9ad562-6754-4f5e-bb59-e29c736fa7f4 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:47 devstack sudo[99998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ee9ad562-6754-4f5e-bb59-e29c736fa7f4 Jun 24 05:02:47 devstack sudo[99998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:47 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-dcd97c4b-0347-4893-a447-132845ca45e6 tempest-GroupSnapshotsTest-1374070386 None] Update group completed successfully. Jun 24 05:02:48 devstack sudo[99998]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-b5bdca0b-8881-404b-a1e7-27b4967bdc6b tempest-ServerActionsTestOtherA-1758477181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ee9ad562-6754-4f5e-bb59-e29c736fa7f4" returned: 0 in 0.709s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:48 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-b5bdca0b-8881-404b-a1e7-27b4967bdc6b tempest-ServerActionsTestOtherA-1758477181 None] <== create_volume: return (1923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:02:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-b5bdca0b-8881-404b-a1e7-27b4967bdc6b tempest-ServerActionsTestOtherA-1758477181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.926s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:02:48 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b5bdca0b-8881-404b-a1e7-27b4967bdc6b tempest-ServerActionsTestOtherA-1758477181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a78849f-d322-4445-b1c7-b9637ab7b170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee9ad562-6754-4f5e-bb59-e29c736fa7f4', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:02:48 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b5bdca0b-8881-404b-a1e7-27b4967bdc6b tempest-ServerActionsTestOtherA-1758477181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9781745-007f-405b-9ebd-7352dcd32e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:02:48 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-b5bdca0b-8881-404b-a1e7-27b4967bdc6b tempest-ServerActionsTestOtherA-1758477181 None] Volume volume-ee9ad562-6754-4f5e-bb59-e29c736fa7f4 (ee9ad562-6754-4f5e-bb59-e29c736fa7f4): created successfully Jun 24 05:02:48 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b5bdca0b-8881-404b-a1e7-27b4967bdc6b tempest-ServerActionsTestOtherA-1758477181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9781745-007f-405b-9ebd-7352dcd32e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:02:48 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b5bdca0b-8881-404b-a1e7-27b4967bdc6b tempest-ServerActionsTestOtherA-1758477181 None] Flow 'volume_create_manager' (06c00f3e-076a-4530-b6d7-4a0d36fcd12d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:02:48 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-b5bdca0b-8881-404b-a1e7-27b4967bdc6b tempest-ServerActionsTestOtherA-1758477181 None] Created volume successfully. Jun 24 05:02:49 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-5fb22626-bc8b-4090-9ff4-f4a34b00a7cf tempest-GroupSnapshotsTest-1374070386 None] GroupSnapshot 5ab36615-3099-4fab-8bbb-3be3602cdf7d: creating. Jun 24 05:02:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5fb22626-bc8b-4090-9ff4-f4a34b00a7cf tempest-GroupSnapshotsTest-1374070386 None] Group snapshot 5ab36615-3099-4fab-8bbb-3be3602cdf7d: creating. {{(pid=93830) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 24 05:02:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5fb22626-bc8b-4090-9ff4-f4a34b00a7cf tempest-GroupSnapshotsTest-1374070386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:02:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5fb22626-bc8b-4090-9ff4-f4a34b00a7cf tempest-GroupSnapshotsTest-1374070386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:02:49 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-5fb22626-bc8b-4090-9ff4-f4a34b00a7cf tempest-GroupSnapshotsTest-1374070386 None] Creating offline snapshot 1c51b154-1396-4d1e-b69d-594ede69f8b2 of volume df167255-8e13-4971-a71b-a9578cb3c6fc {{(pid=93830) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 05:02:49 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[8932dfe6-9d8d-481b-b042-31af47ec63f6]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:02:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fb22626-bc8b-4090-9ff4-f4a34b00a7cf tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:49 devstack sudo[100001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc Jun 24 05:02:49 devstack sudo[100001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:50 devstack sudo[100001]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fb22626-bc8b-4090-9ff4-f4a34b00a7cf tempest-GroupSnapshotsTest-1374070386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc" returned: 0 in 0.867s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fb22626-bc8b-4090-9ff4-f4a34b00a7cf tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc.1c51b154-1396-4d1e-b69d-594ede69f8b2 1G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:50 devstack sudo[100011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc.1c51b154-1396-4d1e-b69d-594ede69f8b2 1G Jun 24 05:02:50 devstack sudo[100011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:50 devstack sudo[100011]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fb22626-bc8b-4090-9ff4-f4a34b00a7cf tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc.1c51b154-1396-4d1e-b69d-594ede69f8b2 1G" returned: 0 in 0.904s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fb22626-bc8b-4090-9ff4-f4a34b00a7cf tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df167255-8e13-4971-a71b-a9578cb3c6fc -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc.1c51b154-1396-4d1e-b69d-594ede69f8b2 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:50 devstack sudo[100018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df167255-8e13-4971-a71b-a9578cb3c6fc -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc.1c51b154-1396-4d1e-b69d-594ede69f8b2 Jun 24 05:02:50 devstack sudo[100018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:51 devstack sudo[100018]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fb22626-bc8b-4090-9ff4-f4a34b00a7cf tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df167255-8e13-4971-a71b-a9578cb3c6fc -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc.1c51b154-1396-4d1e-b69d-594ede69f8b2" returned: 0 in 0.708s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:51 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-5fb22626-bc8b-4090-9ff4-f4a34b00a7cf tempest-GroupSnapshotsTest-1374070386 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc.1c51b154-1396-4d1e-b69d-594ede69f8b2 is being set with open permissions: ugo+rw: NotImplementedError Jun 24 05:02:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fb22626-bc8b-4090-9ff4-f4a34b00a7cf tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc.1c51b154-1396-4d1e-b69d-594ede69f8b2 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:51 devstack sudo[100023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc.1c51b154-1396-4d1e-b69d-594ede69f8b2 Jun 24 05:02:51 devstack sudo[100023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:52 devstack sudo[100023]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fb22626-bc8b-4090-9ff4-f4a34b00a7cf tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc.1c51b154-1396-4d1e-b69d-594ede69f8b2" returned: 0 in 0.777s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fb22626-bc8b-4090-9ff4-f4a34b00a7cf tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:52 devstack sudo[100026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc.info Jun 24 05:02:52 devstack sudo[100026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:53 devstack sudo[100026]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fb22626-bc8b-4090-9ff4-f4a34b00a7cf tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc.info" returned: 0 in 1.003s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:53 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-5fb22626-bc8b-4090-9ff4-f4a34b00a7cf tempest-GroupSnapshotsTest-1374070386 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc.info is being set with open permissions: ugo+rw: NotImplementedError Jun 24 05:02:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fb22626-bc8b-4090-9ff4-f4a34b00a7cf tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:53 devstack sudo[100029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc.info Jun 24 05:02:53 devstack sudo[100029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:54 devstack sudo[100029]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fb22626-bc8b-4090-9ff4-f4a34b00a7cf tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc.info" returned: 0 in 0.845s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5fb22626-bc8b-4090-9ff4-f4a34b00a7cf tempest-GroupSnapshotsTest-1374070386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.221s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:02:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5fb22626-bc8b-4090-9ff4-f4a34b00a7cf tempest-GroupSnapshotsTest-1374070386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:02:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5fb22626-bc8b-4090-9ff4-f4a34b00a7cf tempest-GroupSnapshotsTest-1374070386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:02:54 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:SELECT=80,cinder:UPDATE=77,cinder:INSERT=16,cinder:DELETE=4 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:02:54 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-5fb22626-bc8b-4090-9ff4-f4a34b00a7cf tempest-GroupSnapshotsTest-1374070386 None] Creating offline snapshot 7f7109fc-e8d2-47e8-9cd0-182f248a1719 of volume cf7012b3-c032-4237-b080-20a2adf6d231 {{(pid=93830) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 05:02:54 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5b8d71-3059-4901-bc7d-e067258c252e]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:02:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fb22626-bc8b-4090-9ff4-f4a34b00a7cf tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:54 devstack sudo[100032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231 Jun 24 05:02:54 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:55 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fb22626-bc8b-4090-9ff4-f4a34b00a7cf tempest-GroupSnapshotsTest-1374070386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231" returned: 0 in 0.930s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fb22626-bc8b-4090-9ff4-f4a34b00a7cf tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231.7f7109fc-e8d2-47e8-9cd0-182f248a1719 1G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:55 devstack sudo[100037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231.7f7109fc-e8d2-47e8-9cd0-182f248a1719 1G Jun 24 05:02:55 devstack sudo[100037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:56 devstack sudo[100037]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fb22626-bc8b-4090-9ff4-f4a34b00a7cf tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231.7f7109fc-e8d2-47e8-9cd0-182f248a1719 1G" returned: 0 in 1.199s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fb22626-bc8b-4090-9ff4-f4a34b00a7cf tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf7012b3-c032-4237-b080-20a2adf6d231 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231.7f7109fc-e8d2-47e8-9cd0-182f248a1719 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:56 devstack sudo[100050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf7012b3-c032-4237-b080-20a2adf6d231 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231.7f7109fc-e8d2-47e8-9cd0-182f248a1719 Jun 24 05:02:56 devstack sudo[100050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:57 devstack sudo[100050]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fb22626-bc8b-4090-9ff4-f4a34b00a7cf tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf7012b3-c032-4237-b080-20a2adf6d231 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231.7f7109fc-e8d2-47e8-9cd0-182f248a1719" returned: 0 in 0.799s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:57 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-5fb22626-bc8b-4090-9ff4-f4a34b00a7cf tempest-GroupSnapshotsTest-1374070386 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231.7f7109fc-e8d2-47e8-9cd0-182f248a1719 is being set with open permissions: ugo+rw: NotImplementedError Jun 24 05:02:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fb22626-bc8b-4090-9ff4-f4a34b00a7cf tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231.7f7109fc-e8d2-47e8-9cd0-182f248a1719 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:57 devstack sudo[100067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231.7f7109fc-e8d2-47e8-9cd0-182f248a1719 Jun 24 05:02:57 devstack sudo[100067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:58 devstack sudo[100067]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fb22626-bc8b-4090-9ff4-f4a34b00a7cf tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231.7f7109fc-e8d2-47e8-9cd0-182f248a1719" returned: 0 in 0.826s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:58 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-5095f8d6-0b3c-41d9-af1d-34d7e9d4d457 tempest-AttachVolumeTestJSON-729142982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:02:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5095f8d6-0b3c-41d9-af1d-34d7e9d4d457 tempest-AttachVolumeTestJSON-729142982 None] Flow 'volume_create_manager' (48a8ae39-1428-498f-8ab9-f3d04dd11efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:02:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5095f8d6-0b3c-41d9-af1d-34d7e9d4d457 tempest-AttachVolumeTestJSON-729142982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc0f71a4-11e2-456e-9053-222b53662d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:02:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5095f8d6-0b3c-41d9-af1d-34d7e9d4d457 tempest-AttachVolumeTestJSON-729142982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc0f71a4-11e2-456e-9053-222b53662d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1770283754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98c32053-bcb0-42eb-9381-cd3ba2759e8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86bb7834debb40eca1cb8980d588eee3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:02:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:02:58Z,use_quota=True,user_id='42525aab0b21446b8739e354bf85f2be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:02:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5095f8d6-0b3c-41d9-af1d-34d7e9d4d457 tempest-AttachVolumeTestJSON-729142982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (074af707-b0ae-449e-a150-d073ff05f180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:02:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5095f8d6-0b3c-41d9-af1d-34d7e9d4d457 tempest-AttachVolumeTestJSON-729142982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (074af707-b0ae-449e-a150-d073ff05f180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:02:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5095f8d6-0b3c-41d9-af1d-34d7e9d4d457 tempest-AttachVolumeTestJSON-729142982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f658a85a-d87c-4f98-8c7c-0ae52bf8055d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:02:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5095f8d6-0b3c-41d9-af1d-34d7e9d4d457 tempest-AttachVolumeTestJSON-729142982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f658a85a-d87c-4f98-8c7c-0ae52bf8055d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98c32053-bcb0-42eb-9381-cd3ba2759e8a', 'volume_name': 'volume-98c32053-bcb0-42eb-9381-cd3ba2759e8a', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:02:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5095f8d6-0b3c-41d9-af1d-34d7e9d4d457 tempest-AttachVolumeTestJSON-729142982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a968925a-8284-4be6-86c9-af3f869b27c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:02:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5095f8d6-0b3c-41d9-af1d-34d7e9d4d457 tempest-AttachVolumeTestJSON-729142982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a968925a-8284-4be6-86c9-af3f869b27c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:02:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5095f8d6-0b3c-41d9-af1d-34d7e9d4d457 tempest-AttachVolumeTestJSON-729142982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a66c7569-aa6c-4724-9dd5-47cb2242c5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:02:58 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-5095f8d6-0b3c-41d9-af1d-34d7e9d4d457 tempest-AttachVolumeTestJSON-729142982 None] Volume 98c32053-bcb0-42eb-9381-cd3ba2759e8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98c32053-bcb0-42eb-9381-cd3ba2759e8a', 'volume_size': 1} Jun 24 05:02:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5095f8d6-0b3c-41d9-af1d-34d7e9d4d457 tempest-AttachVolumeTestJSON-729142982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:02:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fb22626-bc8b-4090-9ff4-f4a34b00a7cf tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:58 devstack sudo[100070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231.info Jun 24 05:02:58 devstack sudo[100070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:59 devstack sudo[100070]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fb22626-bc8b-4090-9ff4-f4a34b00a7cf tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231.info" returned: 0 in 0.689s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:59 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-5fb22626-bc8b-4090-9ff4-f4a34b00a7cf tempest-GroupSnapshotsTest-1374070386 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231.info is being set with open permissions: ugo+rw: NotImplementedError Jun 24 05:02:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fb22626-bc8b-4090-9ff4-f4a34b00a7cf tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:59 devstack sudo[100073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231.info Jun 24 05:02:59 devstack sudo[100073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:02:59 devstack sudo[100073]: pam_unix(sudo:session): session closed for user root Jun 24 05:02:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fb22626-bc8b-4090-9ff4-f4a34b00a7cf tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231.info" returned: 0 in 0.727s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:02:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5fb22626-bc8b-4090-9ff4-f4a34b00a7cf tempest-GroupSnapshotsTest-1374070386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.416s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:02:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5095f8d6-0b3c-41d9-af1d-34d7e9d4d457 tempest-AttachVolumeTestJSON-729142982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.463s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:02:59 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-5095f8d6-0b3c-41d9-af1d-34d7e9d4d457 tempest-AttachVolumeTestJSON-729142982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1770283754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98c32053-bcb0-42eb-9381-cd3ba2759e8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86bb7834debb40eca1cb8980d588eee3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:02:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:02:58Z,use_quota=True,user_id='42525aab0b21446b8739e354bf85f2be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:02:59 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-5095f8d6-0b3c-41d9-af1d-34d7e9d4d457 tempest-AttachVolumeTestJSON-729142982 None] Creating volume 98c32053-bcb0-42eb-9381-cd3ba2759e8a {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:02:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5095f8d6-0b3c-41d9-af1d-34d7e9d4d457 tempest-AttachVolumeTestJSON-729142982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:02:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5095f8d6-0b3c-41d9-af1d-34d7e9d4d457 tempest-AttachVolumeTestJSON-729142982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:02:59 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-5095f8d6-0b3c-41d9-af1d-34d7e9d4d457 tempest-AttachVolumeTestJSON-729142982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:02:59 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-5095f8d6-0b3c-41d9-af1d-34d7e9d4d457 tempest-AttachVolumeTestJSON-729142982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:02:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5095f8d6-0b3c-41d9-af1d-34d7e9d4d457 tempest-AttachVolumeTestJSON-729142982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:02:59 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-5095f8d6-0b3c-41d9-af1d-34d7e9d4d457 tempest-AttachVolumeTestJSON-729142982 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:02:59 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-5095f8d6-0b3c-41d9-af1d-34d7e9d4d457 tempest-AttachVolumeTestJSON-729142982 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:02:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5095f8d6-0b3c-41d9-af1d-34d7e9d4d457 tempest-AttachVolumeTestJSON-729142982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-98c32053-bcb0-42eb-9381-cd3ba2759e8a 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:02:59 devstack sudo[100081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-98c32053-bcb0-42eb-9381-cd3ba2759e8a 1073741824 Jun 24 05:02:59 devstack sudo[100081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:00 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-5fb22626-bc8b-4090-9ff4-f4a34b00a7cf tempest-GroupSnapshotsTest-1374070386 None] group_snapshot 5ab36615-3099-4fab-8bbb-3be3602cdf7d: created successfully Jun 24 05:03:00 devstack sudo[100081]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5095f8d6-0b3c-41d9-af1d-34d7e9d4d457 tempest-AttachVolumeTestJSON-729142982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-98c32053-bcb0-42eb-9381-cd3ba2759e8a 1073741824" returned: 0 in 1.001s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5095f8d6-0b3c-41d9-af1d-34d7e9d4d457 tempest-AttachVolumeTestJSON-729142982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-98c32053-bcb0-42eb-9381-cd3ba2759e8a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:00 devstack sudo[100087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-98c32053-bcb0-42eb-9381-cd3ba2759e8a Jun 24 05:03:00 devstack sudo[100087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:00 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-f2268a6d-0a29-4914-a9cd-06267d27b1c3 tempest-GroupSnapshotsTest-1374070386 None] group_snapshot 5ab36615-3099-4fab-8bbb-3be3602cdf7d: deleting Jun 24 05:03:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f2268a6d-0a29-4914-a9cd-06267d27b1c3 tempest-GroupSnapshotsTest-1374070386 None] group_snapshot 5ab36615-3099-4fab-8bbb-3be3602cdf7d: deleting {{(pid=93830) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 24 05:03:01 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f2268a6d-0a29-4914-a9cd-06267d27b1c3 tempest-GroupSnapshotsTest-1374070386 None] Acquiring lock "cinder-quobyte-df167255-8e13-4971-a71b-a9578cb3c6fc" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:03:01 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f2268a6d-0a29-4914-a9cd-06267d27b1c3 tempest-GroupSnapshotsTest-1374070386 None] Lock "cinder-quobyte-df167255-8e13-4971-a71b-a9578cb3c6fc" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:03:01 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f2268a6d-0a29-4914-a9cd-06267d27b1c3 tempest-GroupSnapshotsTest-1374070386 None] Acquiring lock "cinder-quobyte-1c51b154-1396-4d1e-b69d-594ede69f8b2" by "_delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:03:01 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f2268a6d-0a29-4914-a9cd-06267d27b1c3 tempest-GroupSnapshotsTest-1374070386 None] Lock "cinder-quobyte-1c51b154-1396-4d1e-b69d-594ede69f8b2" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:03:01 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-f2268a6d-0a29-4914-a9cd-06267d27b1c3 tempest-GroupSnapshotsTest-1374070386 None] Deleting offline snapshot 1c51b154-1396-4d1e-b69d-594ede69f8b2 of volume df167255-8e13-4971-a71b-a9578cb3c6fc {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 05:03:01 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-f2268a6d-0a29-4914-a9cd-06267d27b1c3 tempest-GroupSnapshotsTest-1374070386 None] snapshot_file for this snap is: volume-df167255-8e13-4971-a71b-a9578cb3c6fc.1c51b154-1396-4d1e-b69d-594ede69f8b2 {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 05:03:01 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[69872c09-b77d-4ce6-9b0d-d75dc39fdaf1]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:03:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f2268a6d-0a29-4914-a9cd-06267d27b1c3 tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc.1c51b154-1396-4d1e-b69d-594ede69f8b2 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:01 devstack sudo[100089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc.1c51b154-1396-4d1e-b69d-594ede69f8b2 Jun 24 05:03:01 devstack sudo[100089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:01 devstack sudo[100087]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5095f8d6-0b3c-41d9-af1d-34d7e9d4d457 tempest-AttachVolumeTestJSON-729142982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-98c32053-bcb0-42eb-9381-cd3ba2759e8a" returned: 0 in 0.781s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:01 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-5095f8d6-0b3c-41d9-af1d-34d7e9d4d457 tempest-AttachVolumeTestJSON-729142982 None] <== create_volume: return (1844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:03:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5095f8d6-0b3c-41d9-af1d-34d7e9d4d457 tempest-AttachVolumeTestJSON-729142982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.863s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:03:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5095f8d6-0b3c-41d9-af1d-34d7e9d4d457 tempest-AttachVolumeTestJSON-729142982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a66c7569-aa6c-4724-9dd5-47cb2242c5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98c32053-bcb0-42eb-9381-cd3ba2759e8a', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:03:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5095f8d6-0b3c-41d9-af1d-34d7e9d4d457 tempest-AttachVolumeTestJSON-729142982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aabf2904-a0a0-4a6f-aa83-d5935c072897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:03:01 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-5095f8d6-0b3c-41d9-af1d-34d7e9d4d457 tempest-AttachVolumeTestJSON-729142982 None] Volume volume-98c32053-bcb0-42eb-9381-cd3ba2759e8a (98c32053-bcb0-42eb-9381-cd3ba2759e8a): created successfully Jun 24 05:03:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5095f8d6-0b3c-41d9-af1d-34d7e9d4d457 tempest-AttachVolumeTestJSON-729142982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aabf2904-a0a0-4a6f-aa83-d5935c072897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:03:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5095f8d6-0b3c-41d9-af1d-34d7e9d4d457 tempest-AttachVolumeTestJSON-729142982 None] Flow 'volume_create_manager' (48a8ae39-1428-498f-8ab9-f3d04dd11efb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:03:01 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-5095f8d6-0b3c-41d9-af1d-34d7e9d4d457 tempest-AttachVolumeTestJSON-729142982 None] Created volume successfully. Jun 24 05:03:02 devstack sudo[100089]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f2268a6d-0a29-4914-a9cd-06267d27b1c3 tempest-GroupSnapshotsTest-1374070386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc.1c51b154-1396-4d1e-b69d-594ede69f8b2" returned: 0 in 1.086s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:02 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-f2268a6d-0a29-4914-a9cd-06267d27b1c3 tempest-GroupSnapshotsTest-1374070386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df167255-8e13-4971-a71b-a9578cb3c6fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:03:02 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0866be-fe07-4999-afe5-2b68db12524a]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:03:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f2268a6d-0a29-4914-a9cd-06267d27b1c3 tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:02 devstack sudo[100127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc Jun 24 05:03:02 devstack sudo[100127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:03 devstack sudo[100127]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f2268a6d-0a29-4914-a9cd-06267d27b1c3 tempest-GroupSnapshotsTest-1374070386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc" returned: 0 in 1.136s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f2268a6d-0a29-4914-a9cd-06267d27b1c3 tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc.1c51b154-1396-4d1e-b69d-594ede69f8b2 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:03 devstack sudo[100159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc.1c51b154-1396-4d1e-b69d-594ede69f8b2 Jun 24 05:03:03 devstack sudo[100159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:04 devstack sudo[100159]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f2268a6d-0a29-4914-a9cd-06267d27b1c3 tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc.1c51b154-1396-4d1e-b69d-594ede69f8b2" returned: 0 in 0.825s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f2268a6d-0a29-4914-a9cd-06267d27b1c3 tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc.1c51b154-1396-4d1e-b69d-594ede69f8b2 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:04 devstack sudo[100170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc.1c51b154-1396-4d1e-b69d-594ede69f8b2 Jun 24 05:03:04 devstack sudo[100170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:04 devstack sudo[100170]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f2268a6d-0a29-4914-a9cd-06267d27b1c3 tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc.1c51b154-1396-4d1e-b69d-594ede69f8b2" returned: 0 in 0.746s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:05 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f2268a6d-0a29-4914-a9cd-06267d27b1c3 tempest-GroupSnapshotsTest-1374070386 None] Lock "cinder-quobyte-1c51b154-1396-4d1e-b69d-594ede69f8b2" released by "_delete_snapshot" :: held 3.966s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:03:05 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f2268a6d-0a29-4914-a9cd-06267d27b1c3 tempest-GroupSnapshotsTest-1374070386 None] Lock "cinder-quobyte-df167255-8e13-4971-a71b-a9578cb3c6fc" released by "delete_snapshot" :: held 3.992s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:03:05 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f2268a6d-0a29-4914-a9cd-06267d27b1c3 tempest-GroupSnapshotsTest-1374070386 None] Acquiring lock "cinder-quobyte-cf7012b3-c032-4237-b080-20a2adf6d231" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:03:05 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f2268a6d-0a29-4914-a9cd-06267d27b1c3 tempest-GroupSnapshotsTest-1374070386 None] Lock "cinder-quobyte-cf7012b3-c032-4237-b080-20a2adf6d231" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:03:05 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f2268a6d-0a29-4914-a9cd-06267d27b1c3 tempest-GroupSnapshotsTest-1374070386 None] Acquiring lock "cinder-quobyte-7f7109fc-e8d2-47e8-9cd0-182f248a1719" by "_delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:03:05 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f2268a6d-0a29-4914-a9cd-06267d27b1c3 tempest-GroupSnapshotsTest-1374070386 None] Lock "cinder-quobyte-7f7109fc-e8d2-47e8-9cd0-182f248a1719" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:03:05 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-f2268a6d-0a29-4914-a9cd-06267d27b1c3 tempest-GroupSnapshotsTest-1374070386 None] Deleting offline snapshot 7f7109fc-e8d2-47e8-9cd0-182f248a1719 of volume cf7012b3-c032-4237-b080-20a2adf6d231 {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 05:03:05 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-f2268a6d-0a29-4914-a9cd-06267d27b1c3 tempest-GroupSnapshotsTest-1374070386 None] snapshot_file for this snap is: volume-cf7012b3-c032-4237-b080-20a2adf6d231.7f7109fc-e8d2-47e8-9cd0-182f248a1719 {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 05:03:05 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[50350e64-566c-4a78-8f0a-af948e21afd2]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:03:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f2268a6d-0a29-4914-a9cd-06267d27b1c3 tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231.7f7109fc-e8d2-47e8-9cd0-182f248a1719 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:05 devstack sudo[100174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231.7f7109fc-e8d2-47e8-9cd0-182f248a1719 Jun 24 05:03:05 devstack sudo[100174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-e6ec8f8d-b08d-49fc-b59b-6ad680eb19dc req-8409e5f5-6d87-418c-bc02-a12cefd370ec tempest-AttachVolumeTestJSON-729142982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:03:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-e6ec8f8d-b08d-49fc-b59b-6ad680eb19dc req-8409e5f5-6d87-418c-bc02-a12cefd370ec tempest-AttachVolumeTestJSON-729142982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:03:05 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ada5490-b1e7-4fc5-807c-9fd031249cba]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:03:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-e6ec8f8d-b08d-49fc-b59b-6ad680eb19dc req-8409e5f5-6d87-418c-bc02-a12cefd370ec tempest-AttachVolumeTestJSON-729142982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-98c32053-bcb0-42eb-9381-cd3ba2759e8a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:05 devstack sudo[100187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-98c32053-bcb0-42eb-9381-cd3ba2759e8a Jun 24 05:03:05 devstack sudo[100187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:06 devstack sudo[100174]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f2268a6d-0a29-4914-a9cd-06267d27b1c3 tempest-GroupSnapshotsTest-1374070386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231.7f7109fc-e8d2-47e8-9cd0-182f248a1719" returned: 0 in 0.879s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:06 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-f2268a6d-0a29-4914-a9cd-06267d27b1c3 tempest-GroupSnapshotsTest-1374070386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf7012b3-c032-4237-b080-20a2adf6d231(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:03:06 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b346b53-7896-4668-b707-861e87d90108]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:03:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f2268a6d-0a29-4914-a9cd-06267d27b1c3 tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:06 devstack sudo[100189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231 Jun 24 05:03:06 devstack sudo[100189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:06 devstack sudo[100187]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-e6ec8f8d-b08d-49fc-b59b-6ad680eb19dc req-8409e5f5-6d87-418c-bc02-a12cefd370ec tempest-AttachVolumeTestJSON-729142982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-98c32053-bcb0-42eb-9381-cd3ba2759e8a" returned: 0 in 1.052s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-e6ec8f8d-b08d-49fc-b59b-6ad680eb19dc req-8409e5f5-6d87-418c-bc02-a12cefd370ec tempest-AttachVolumeTestJSON-729142982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.079s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:03:06 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-e6ec8f8d-b08d-49fc-b59b-6ad680eb19dc req-8409e5f5-6d87-418c-bc02-a12cefd370ec tempest-AttachVolumeTestJSON-729142982 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05', 'name': 'volume-98c32053-bcb0-42eb-9381-cd3ba2759e8a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '82ed4e52-3075-445d-b229-46a6ba144d84', 'enforce_multipath': True} {{(pid=93830) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 05:03:07 devstack sudo[100189]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f2268a6d-0a29-4914-a9cd-06267d27b1c3 tempest-GroupSnapshotsTest-1374070386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231" returned: 0 in 0.898s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f2268a6d-0a29-4914-a9cd-06267d27b1c3 tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231.7f7109fc-e8d2-47e8-9cd0-182f248a1719 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:07 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-e6ec8f8d-b08d-49fc-b59b-6ad680eb19dc req-8409e5f5-6d87-418c-bc02-a12cefd370ec tempest-AttachVolumeTestJSON-729142982 None] attachment_update completed successfully. Jun 24 05:03:07 devstack sudo[100198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231.7f7109fc-e8d2-47e8-9cd0-182f248a1719 Jun 24 05:03:07 devstack sudo[100198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:07 devstack sudo[100198]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f2268a6d-0a29-4914-a9cd-06267d27b1c3 tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231.7f7109fc-e8d2-47e8-9cd0-182f248a1719" returned: 0 in 0.839s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f2268a6d-0a29-4914-a9cd-06267d27b1c3 tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231.7f7109fc-e8d2-47e8-9cd0-182f248a1719 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:07 devstack sudo[100271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231.7f7109fc-e8d2-47e8-9cd0-182f248a1719 Jun 24 05:03:07 devstack sudo[100271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:08 devstack sudo[100271]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f2268a6d-0a29-4914-a9cd-06267d27b1c3 tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231.7f7109fc-e8d2-47e8-9cd0-182f248a1719" returned: 0 in 0.796s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:08 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f2268a6d-0a29-4914-a9cd-06267d27b1c3 tempest-GroupSnapshotsTest-1374070386 None] Lock "cinder-quobyte-7f7109fc-e8d2-47e8-9cd0-182f248a1719" released by "_delete_snapshot" :: held 3.660s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:03:08 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f2268a6d-0a29-4914-a9cd-06267d27b1c3 tempest-GroupSnapshotsTest-1374070386 None] Lock "cinder-quobyte-cf7012b3-c032-4237-b080-20a2adf6d231" released by "delete_snapshot" :: held 3.698s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:03:08 devstack cinder-volume[93830]: WARNING cinder.quota [None req-f2268a6d-0a29-4914-a9cd-06267d27b1c3 tempest-GroupSnapshotsTest-1374070386 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1641804064 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1641804064, it is now deprecated. Please use the default quota class for default quota. Jun 24 05:03:08 devstack cinder-volume[93830]: WARNING cinder.quota [None req-f2268a6d-0a29-4914-a9cd-06267d27b1c3 tempest-GroupSnapshotsTest-1374070386 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1641804064 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1641804064, it is now deprecated. Please use the default quota class for default quota. Jun 24 05:03:08 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-f2268a6d-0a29-4914-a9cd-06267d27b1c3 tempest-GroupSnapshotsTest-1374070386 None] Created reservations ['21cec5e2-321e-4a74-94bc-9144a289b905', '1b6538ab-5365-41d7-a5ce-2546c7838f5f', 'e3705d2c-b7d3-4063-a9c8-f45be3eb3de8', '78b17bf2-2161-4a74-be6a-3d61624ef9ee'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:03:09 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-f2268a6d-0a29-4914-a9cd-06267d27b1c3 tempest-GroupSnapshotsTest-1374070386 None] Created reservations ['640307dc-2dda-4ff3-a122-701c2b7da862', 'e49c34ef-be6c-4e50-a5c9-40b775ac411e', '8ccf54e0-25e8-49b7-a18e-86df849c1825', 'c9e55e82-8d0c-4e5c-9611-471b93d3c667'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:03:09 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-f2268a6d-0a29-4914-a9cd-06267d27b1c3 tempest-GroupSnapshotsTest-1374070386 None] group_snapshot 5ab36615-3099-4fab-8bbb-3be3602cdf7d: deleted successfully Jun 24 05:03:09 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 05:03:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:03:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:03:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:03:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:03:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:03:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:09 devstack sudo[100598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:03:09 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:10 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f8ad453d-8e61-47ba-b7af-3d4b76abffaa tempest-GroupSnapshotsTest-1374070386 None] Acquiring lock "cinder-quobyte-cf7012b3-c032-4237-b080-20a2adf6d231" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:03:10 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f8ad453d-8e61-47ba-b7af-3d4b76abffaa tempest-GroupSnapshotsTest-1374070386 None] Lock "cinder-quobyte-cf7012b3-c032-4237-b080-20a2adf6d231" acquired by "delete_volume" :: waited 0.030s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:03:10 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[395c534c-009f-4e23-9896-eaf5429b1430]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:03:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f8ad453d-8e61-47ba-b7af-3d4b76abffaa tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:11 devstack sudo[100601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231 Jun 24 05:03:11 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:11 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 1.433s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:11 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:03:11 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager._thread_info {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 05:03:11 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread count: 8 {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 05:03:11 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread info: [<_MainThread(MainThread, started 130211312517248)>, , , , , , , ] {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 05:03:12 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f8ad453d-8e61-47ba-b7af-3d4b76abffaa tempest-GroupSnapshotsTest-1374070386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231" returned: 0 in 1.278s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f8ad453d-8e61-47ba-b7af-3d4b76abffaa tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:12 devstack sudo[100607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231 Jun 24 05:03:12 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:13 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f8ad453d-8e61-47ba-b7af-3d4b76abffaa tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cf7012b3-c032-4237-b080-20a2adf6d231" returned: 0 in 0.980s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:13 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f8ad453d-8e61-47ba-b7af-3d4b76abffaa tempest-GroupSnapshotsTest-1374070386 None] Lock "cinder-quobyte-cf7012b3-c032-4237-b080-20a2adf6d231" released by "delete_volume" :: held 2.440s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:03:13 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f8ad453d-8e61-47ba-b7af-3d4b76abffaa tempest-GroupSnapshotsTest-1374070386 None] Acquiring lock "cinder-quobyte-df167255-8e13-4971-a71b-a9578cb3c6fc" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:03:13 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f8ad453d-8e61-47ba-b7af-3d4b76abffaa tempest-GroupSnapshotsTest-1374070386 None] Lock "cinder-quobyte-df167255-8e13-4971-a71b-a9578cb3c6fc" acquired by "delete_volume" :: waited 0.028s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:03:13 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e2a39e-ab94-4818-a99e-411120f84338]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:03:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f8ad453d-8e61-47ba-b7af-3d4b76abffaa tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:13 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-3528cfa1-c702-4fc4-8c2e-a6b92ae80990 tempest-AttachVolumeTestJSON-729142982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:03:13 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3528cfa1-c702-4fc4-8c2e-a6b92ae80990 tempest-AttachVolumeTestJSON-729142982 None] Flow 'volume_create_manager' (f0957c7b-7824-475f-acf6-ac5fe9ac3b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:03:13 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3528cfa1-c702-4fc4-8c2e-a6b92ae80990 tempest-AttachVolumeTestJSON-729142982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (731b459e-a5f7-4497-91e2-89574d8d2d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:03:13 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3528cfa1-c702-4fc4-8c2e-a6b92ae80990 tempest-AttachVolumeTestJSON-729142982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (731b459e-a5f7-4497-91e2-89574d8d2d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-863549755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b069076e-be02-42d5-a3e4-7f8c98b97371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86bb7834debb40eca1cb8980d588eee3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:03:13Z,use_quota=True,user_id='42525aab0b21446b8739e354bf85f2be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:03:13 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3528cfa1-c702-4fc4-8c2e-a6b92ae80990 tempest-AttachVolumeTestJSON-729142982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (933b23f8-d7d6-432f-a8f5-7866ba1df72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:03:13 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3528cfa1-c702-4fc4-8c2e-a6b92ae80990 tempest-AttachVolumeTestJSON-729142982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (933b23f8-d7d6-432f-a8f5-7866ba1df72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:03:13 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3528cfa1-c702-4fc4-8c2e-a6b92ae80990 tempest-AttachVolumeTestJSON-729142982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (854dc8ec-bf6c-4544-9a01-3c4ddf85959f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:03:13 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3528cfa1-c702-4fc4-8c2e-a6b92ae80990 tempest-AttachVolumeTestJSON-729142982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (854dc8ec-bf6c-4544-9a01-3c4ddf85959f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b069076e-be02-42d5-a3e4-7f8c98b97371', 'volume_name': 'volume-b069076e-be02-42d5-a3e4-7f8c98b97371', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:03:13 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3528cfa1-c702-4fc4-8c2e-a6b92ae80990 tempest-AttachVolumeTestJSON-729142982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0810d422-8761-493f-afa8-d7fc332c4a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:03:13 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3528cfa1-c702-4fc4-8c2e-a6b92ae80990 tempest-AttachVolumeTestJSON-729142982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0810d422-8761-493f-afa8-d7fc332c4a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:03:13 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3528cfa1-c702-4fc4-8c2e-a6b92ae80990 tempest-AttachVolumeTestJSON-729142982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9021837d-a204-4e2d-9885-a681796a9ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:03:13 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-3528cfa1-c702-4fc4-8c2e-a6b92ae80990 tempest-AttachVolumeTestJSON-729142982 None] Volume b069076e-be02-42d5-a3e4-7f8c98b97371: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b069076e-be02-42d5-a3e4-7f8c98b97371', 'volume_size': 1} Jun 24 05:03:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3528cfa1-c702-4fc4-8c2e-a6b92ae80990 tempest-AttachVolumeTestJSON-729142982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:03:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3528cfa1-c702-4fc4-8c2e-a6b92ae80990 tempest-AttachVolumeTestJSON-729142982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:03:13 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-3528cfa1-c702-4fc4-8c2e-a6b92ae80990 tempest-AttachVolumeTestJSON-729142982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-863549755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b069076e-be02-42d5-a3e4-7f8c98b97371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86bb7834debb40eca1cb8980d588eee3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:03:13Z,use_quota=True,user_id='42525aab0b21446b8739e354bf85f2be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:03:13 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-3528cfa1-c702-4fc4-8c2e-a6b92ae80990 tempest-AttachVolumeTestJSON-729142982 None] Creating volume b069076e-be02-42d5-a3e4-7f8c98b97371 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:03:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3528cfa1-c702-4fc4-8c2e-a6b92ae80990 tempest-AttachVolumeTestJSON-729142982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:03:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3528cfa1-c702-4fc4-8c2e-a6b92ae80990 tempest-AttachVolumeTestJSON-729142982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:03:13 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-3528cfa1-c702-4fc4-8c2e-a6b92ae80990 tempest-AttachVolumeTestJSON-729142982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:03:13 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-3528cfa1-c702-4fc4-8c2e-a6b92ae80990 tempest-AttachVolumeTestJSON-729142982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:03:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3528cfa1-c702-4fc4-8c2e-a6b92ae80990 tempest-AttachVolumeTestJSON-729142982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:03:13 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-3528cfa1-c702-4fc4-8c2e-a6b92ae80990 tempest-AttachVolumeTestJSON-729142982 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:03:13 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-3528cfa1-c702-4fc4-8c2e-a6b92ae80990 tempest-AttachVolumeTestJSON-729142982 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:03:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3528cfa1-c702-4fc4-8c2e-a6b92ae80990 tempest-AttachVolumeTestJSON-729142982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b069076e-be02-42d5-a3e4-7f8c98b97371 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:13 devstack sudo[100612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b069076e-be02-42d5-a3e4-7f8c98b97371 1073741824 Jun 24 05:03:13 devstack sudo[100612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:13 devstack sudo[100611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc Jun 24 05:03:13 devstack sudo[100611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:14 devstack sudo[100611]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:14 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f8ad453d-8e61-47ba-b7af-3d4b76abffaa tempest-GroupSnapshotsTest-1374070386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc" returned: 0 in 1.425s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:14 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f8ad453d-8e61-47ba-b7af-3d4b76abffaa tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:14 devstack sudo[100612]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:14 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3528cfa1-c702-4fc4-8c2e-a6b92ae80990 tempest-AttachVolumeTestJSON-729142982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b069076e-be02-42d5-a3e4-7f8c98b97371 1073741824" returned: 0 in 1.259s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:14 devstack sudo[100623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc Jun 24 05:03:14 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:14 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3528cfa1-c702-4fc4-8c2e-a6b92ae80990 tempest-AttachVolumeTestJSON-729142982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b069076e-be02-42d5-a3e4-7f8c98b97371 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:15 devstack sudo[100625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b069076e-be02-42d5-a3e4-7f8c98b97371 Jun 24 05:03:15 devstack sudo[100625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:15 devstack sudo[100625]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3528cfa1-c702-4fc4-8c2e-a6b92ae80990 tempest-AttachVolumeTestJSON-729142982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b069076e-be02-42d5-a3e4-7f8c98b97371" returned: 0 in 0.864s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:15 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-3528cfa1-c702-4fc4-8c2e-a6b92ae80990 tempest-AttachVolumeTestJSON-729142982 None] <== create_volume: return (2218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:03:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3528cfa1-c702-4fc4-8c2e-a6b92ae80990 tempest-AttachVolumeTestJSON-729142982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.221s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:03:15 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3528cfa1-c702-4fc4-8c2e-a6b92ae80990 tempest-AttachVolumeTestJSON-729142982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9021837d-a204-4e2d-9885-a681796a9ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b069076e-be02-42d5-a3e4-7f8c98b97371', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:03:15 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3528cfa1-c702-4fc4-8c2e-a6b92ae80990 tempest-AttachVolumeTestJSON-729142982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07d8e6bb-420d-4f93-bf79-ca337480ab17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:03:15 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-3528cfa1-c702-4fc4-8c2e-a6b92ae80990 tempest-AttachVolumeTestJSON-729142982 None] Volume volume-b069076e-be02-42d5-a3e4-7f8c98b97371 (b069076e-be02-42d5-a3e4-7f8c98b97371): created successfully Jun 24 05:03:15 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3528cfa1-c702-4fc4-8c2e-a6b92ae80990 tempest-AttachVolumeTestJSON-729142982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07d8e6bb-420d-4f93-bf79-ca337480ab17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:03:15 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3528cfa1-c702-4fc4-8c2e-a6b92ae80990 tempest-AttachVolumeTestJSON-729142982 None] Flow 'volume_create_manager' (f0957c7b-7824-475f-acf6-ac5fe9ac3b69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:03:15 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-3528cfa1-c702-4fc4-8c2e-a6b92ae80990 tempest-AttachVolumeTestJSON-729142982 None] Created volume successfully. Jun 24 05:03:15 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f8ad453d-8e61-47ba-b7af-3d4b76abffaa tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-df167255-8e13-4971-a71b-a9578cb3c6fc" returned: 0 in 1.079s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:15 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f8ad453d-8e61-47ba-b7af-3d4b76abffaa tempest-GroupSnapshotsTest-1374070386 None] Lock "cinder-quobyte-df167255-8e13-4971-a71b-a9578cb3c6fc" released by "delete_volume" :: held 2.632s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:03:16 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-f8ad453d-8e61-47ba-b7af-3d4b76abffaa tempest-GroupSnapshotsTest-1374070386 None] Created reservations ['ee8c83a4-4d3e-471f-bebe-7e95235010ba'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:03:16 devstack cinder-volume[93830]: WARNING cinder.quota [None req-f8ad453d-8e61-47ba-b7af-3d4b76abffaa tempest-GroupSnapshotsTest-1374070386 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1641804064 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1641804064, it is now deprecated. Please use the default quota class for default quota. Jun 24 05:03:16 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-f8ad453d-8e61-47ba-b7af-3d4b76abffaa tempest-GroupSnapshotsTest-1374070386 None] Created reservations ['aa933047-9d97-4e92-b74d-f350f77aaa27', '025c894c-07c6-4464-9cc9-ac80b9a70732', 'be631bae-27ff-4db5-a83e-b9e1c63b7125', '5800ed2b-089f-4232-9466-15dff8284c3d'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:03:16 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-f8ad453d-8e61-47ba-b7af-3d4b76abffaa tempest-GroupSnapshotsTest-1374070386 None] Created reservations ['0854df14-a371-431e-ac81-bdd99175454a', 'fa9b5bf9-c685-4155-a9d8-be02868413e4', 'c0b87c1d-65f5-4908-8516-cfb0ceffa9d4', '5753aabf-fbf7-41ba-81fb-325ad4ed67b1'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:03:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f8ad453d-8e61-47ba-b7af-3d4b76abffaa tempest-GroupSnapshotsTest-1374070386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:03:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f8ad453d-8e61-47ba-b7af-3d4b76abffaa tempest-GroupSnapshotsTest-1374070386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:03:16 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f8ad453d-8e61-47ba-b7af-3d4b76abffaa tempest-GroupSnapshotsTest-1374070386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:03:16 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f8ad453d-8e61-47ba-b7af-3d4b76abffaa tempest-GroupSnapshotsTest-1374070386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:03:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f8ad453d-8e61-47ba-b7af-3d4b76abffaa tempest-GroupSnapshotsTest-1374070386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:03:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f8ad453d-8e61-47ba-b7af-3d4b76abffaa tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:16 devstack sudo[100629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:03:16 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:17 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f8ad453d-8e61-47ba-b7af-3d4b76abffaa tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 1.170s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:17 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-f8ad453d-8e61-47ba-b7af-3d4b76abffaa tempest-GroupSnapshotsTest-1374070386 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:03:17 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-f8ad453d-8e61-47ba-b7af-3d4b76abffaa tempest-GroupSnapshotsTest-1374070386 None] Delete group completed successfully. Jun 24 05:03:17 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-14409dd6-8fe2-485f-8aa0-89c571ec7cde tempest-GroupSnapshotsTest-1374070386 None] Group tempest-GroupSnapshotsTest-Group-1046397654: creating Jun 24 05:03:17 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-14409dd6-8fe2-485f-8aa0-89c571ec7cde tempest-GroupSnapshotsTest-1374070386 None] Group tempest-GroupSnapshotsTest-Group-1046397654: created successfully Jun 24 05:03:17 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-14409dd6-8fe2-485f-8aa0-89c571ec7cde tempest-GroupSnapshotsTest-1374070386 None] Create group completed successfully. Jun 24 05:03:19 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-a87e3df9-127d-4ad3-a08a-fb5122343e8f tempest-GroupSnapshotsTest-1374070386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:03:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a87e3df9-127d-4ad3-a08a-fb5122343e8f tempest-GroupSnapshotsTest-1374070386 None] Flow 'volume_create_manager' (1617d011-789a-4376-8d2b-0d1b5c641921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:03:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a87e3df9-127d-4ad3-a08a-fb5122343e8f tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a420f62-2404-4f75-ad3e-64e9ebba3d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:03:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a87e3df9-127d-4ad3-a08a-fb5122343e8f tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a420f62-2404-4f75-ad3e-64e9ebba3d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-932179231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=57658dec-692f-4080-af5a-d3423a91ff12,host='devstack@QuobyteHD#QuobyteHD',id=b4a49e1c-181b-4445-9b4d-d3b34f704c2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='468985bfe8844337a5741f9806c71d29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:03:20Z,use_quota=True,user_id='e18311c9dd0a4efd992192892804432b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd0b36fa-75ea-4f7b-ac9f-0b9e71a9b736),volume_type_id=fd0b36fa-75ea-4f7b-ac9f-0b9e71a9b736)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:03:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a87e3df9-127d-4ad3-a08a-fb5122343e8f tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5e17b51-4cdd-48f9-bdd0-9effde0e981b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:03:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a87e3df9-127d-4ad3-a08a-fb5122343e8f tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5e17b51-4cdd-48f9-bdd0-9effde0e981b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:03:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a87e3df9-127d-4ad3-a08a-fb5122343e8f tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3a204bf-5429-4ae7-840f-469ea133b908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:03:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a87e3df9-127d-4ad3-a08a-fb5122343e8f tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3a204bf-5429-4ae7-840f-469ea133b908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4a49e1c-181b-4445-9b4d-d3b34f704c2f', 'volume_name': 'volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:03:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a87e3df9-127d-4ad3-a08a-fb5122343e8f tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec505b24-c104-4b11-9686-8661ddf52e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:03:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a87e3df9-127d-4ad3-a08a-fb5122343e8f tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec505b24-c104-4b11-9686-8661ddf52e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:03:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a87e3df9-127d-4ad3-a08a-fb5122343e8f tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af975c75-b992-4570-bdcd-693974e14f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:03:19 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-a87e3df9-127d-4ad3-a08a-fb5122343e8f tempest-GroupSnapshotsTest-1374070386 None] Volume b4a49e1c-181b-4445-9b4d-d3b34f704c2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f', 'volume_size': 1} Jun 24 05:03:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a87e3df9-127d-4ad3-a08a-fb5122343e8f tempest-GroupSnapshotsTest-1374070386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:03:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a87e3df9-127d-4ad3-a08a-fb5122343e8f tempest-GroupSnapshotsTest-1374070386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:03:19 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a87e3df9-127d-4ad3-a08a-fb5122343e8f tempest-GroupSnapshotsTest-1374070386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=57658dec-692f-4080-af5a-d3423a91ff12,created_at=2026-06-24T03:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-932179231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=57658dec-692f-4080-af5a-d3423a91ff12,host='devstack@QuobyteHD#QuobyteHD',id=b4a49e1c-181b-4445-9b4d-d3b34f704c2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='468985bfe8844337a5741f9806c71d29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:03:20Z,use_quota=True,user_id='e18311c9dd0a4efd992192892804432b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd0b36fa-75ea-4f7b-ac9f-0b9e71a9b736),volume_type_id=fd0b36fa-75ea-4f7b-ac9f-0b9e71a9b736)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:03:19 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-a87e3df9-127d-4ad3-a08a-fb5122343e8f tempest-GroupSnapshotsTest-1374070386 None] Creating volume b4a49e1c-181b-4445-9b4d-d3b34f704c2f {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:03:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a87e3df9-127d-4ad3-a08a-fb5122343e8f tempest-GroupSnapshotsTest-1374070386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:03:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a87e3df9-127d-4ad3-a08a-fb5122343e8f tempest-GroupSnapshotsTest-1374070386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:03:19 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a87e3df9-127d-4ad3-a08a-fb5122343e8f tempest-GroupSnapshotsTest-1374070386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:03:19 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a87e3df9-127d-4ad3-a08a-fb5122343e8f tempest-GroupSnapshotsTest-1374070386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:03:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a87e3df9-127d-4ad3-a08a-fb5122343e8f tempest-GroupSnapshotsTest-1374070386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:03:19 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a87e3df9-127d-4ad3-a08a-fb5122343e8f tempest-GroupSnapshotsTest-1374070386 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:03:19 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-a87e3df9-127d-4ad3-a08a-fb5122343e8f tempest-GroupSnapshotsTest-1374070386 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:03:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a87e3df9-127d-4ad3-a08a-fb5122343e8f tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:19 devstack sudo[100644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f 1073741824 Jun 24 05:03:19 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-8b44f5ad-cd1a-4720-9303-ee1f1a979dc2 req-f1ceaedf-f9e9-40f6-bd68-f8b6008edb10 tempest-AttachVolumeTestJSON-729142982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:03:20 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a87e3df9-127d-4ad3-a08a-fb5122343e8f tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f 1073741824" returned: 0 in 0.981s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a87e3df9-127d-4ad3-a08a-fb5122343e8f tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:21 devstack sudo[100675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f Jun 24 05:03:21 devstack sudo[100675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:21 devstack sudo[100675]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a87e3df9-127d-4ad3-a08a-fb5122343e8f tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f" returned: 0 in 0.679s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:21 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a87e3df9-127d-4ad3-a08a-fb5122343e8f tempest-GroupSnapshotsTest-1374070386 None] <== create_volume: return (1723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:03:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a87e3df9-127d-4ad3-a08a-fb5122343e8f tempest-GroupSnapshotsTest-1374070386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:03:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-8b44f5ad-cd1a-4720-9303-ee1f1a979dc2 req-f1ceaedf-f9e9-40f6-bd68-f8b6008edb10 tempest-AttachVolumeTestJSON-729142982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.472s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:03:21 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a87e3df9-127d-4ad3-a08a-fb5122343e8f tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af975c75-b992-4570-bdcd-693974e14f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:03:21 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a87e3df9-127d-4ad3-a08a-fb5122343e8f tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9fc2182-4094-4cf5-ad3d-61c11077be99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:03:21 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec4f9dd-f886-4907-8647-8477b9f3bcd2]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:03:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-8b44f5ad-cd1a-4720-9303-ee1f1a979dc2 req-f1ceaedf-f9e9-40f6-bd68-f8b6008edb10 tempest-AttachVolumeTestJSON-729142982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b069076e-be02-42d5-a3e4-7f8c98b97371 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:21 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-a87e3df9-127d-4ad3-a08a-fb5122343e8f tempest-GroupSnapshotsTest-1374070386 None] Volume volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f (b4a49e1c-181b-4445-9b4d-d3b34f704c2f): created successfully Jun 24 05:03:21 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a87e3df9-127d-4ad3-a08a-fb5122343e8f tempest-GroupSnapshotsTest-1374070386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9fc2182-4094-4cf5-ad3d-61c11077be99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:03:21 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a87e3df9-127d-4ad3-a08a-fb5122343e8f tempest-GroupSnapshotsTest-1374070386 None] Flow 'volume_create_manager' (1617d011-789a-4376-8d2b-0d1b5c641921) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:03:21 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-a87e3df9-127d-4ad3-a08a-fb5122343e8f tempest-GroupSnapshotsTest-1374070386 None] Created volume successfully. Jun 24 05:03:21 devstack sudo[100678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b069076e-be02-42d5-a3e4-7f8c98b97371 Jun 24 05:03:21 devstack sudo[100678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:22 devstack sudo[100678]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:22 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-c8a30cb9-544a-44dc-8afb-b8825cc860fb tempest-GroupSnapshotsTest-1374070386 None] GroupSnapshot 7ea56e24-976d-4b63-afe7-dc6a5caa72a3: creating. Jun 24 05:03:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-8b44f5ad-cd1a-4720-9303-ee1f1a979dc2 req-f1ceaedf-f9e9-40f6-bd68-f8b6008edb10 tempest-AttachVolumeTestJSON-729142982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b069076e-be02-42d5-a3e4-7f8c98b97371" returned: 0 in 0.756s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-8b44f5ad-cd1a-4720-9303-ee1f1a979dc2 req-f1ceaedf-f9e9-40f6-bd68-f8b6008edb10 tempest-AttachVolumeTestJSON-729142982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.788s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:03:22 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-c8a30cb9-544a-44dc-8afb-b8825cc860fb tempest-GroupSnapshotsTest-1374070386 None] Group snapshot 7ea56e24-976d-4b63-afe7-dc6a5caa72a3: creating. {{(pid=93830) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 24 05:03:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-c8a30cb9-544a-44dc-8afb-b8825cc860fb tempest-GroupSnapshotsTest-1374070386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:03:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-c8a30cb9-544a-44dc-8afb-b8825cc860fb tempest-GroupSnapshotsTest-1374070386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:03:22 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-8b44f5ad-cd1a-4720-9303-ee1f1a979dc2 req-f1ceaedf-f9e9-40f6-bd68-f8b6008edb10 tempest-AttachVolumeTestJSON-729142982 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05', 'name': 'volume-b069076e-be02-42d5-a3e4-7f8c98b97371', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '52d0d74e-0d91-45d8-a4b8-ccf596a39d6b', 'enforce_multipath': True} {{(pid=93830) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 05:03:22 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-c8a30cb9-544a-44dc-8afb-b8825cc860fb tempest-GroupSnapshotsTest-1374070386 None] Creating offline snapshot 5c628326-3f99-4f0c-94a1-e20c8abcf49c of volume b4a49e1c-181b-4445-9b4d-d3b34f704c2f {{(pid=93830) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 05:03:22 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f527b2b-28d1-42bb-8c38-6e88a2885229]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:03:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c8a30cb9-544a-44dc-8afb-b8825cc860fb tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:22 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-8b44f5ad-cd1a-4720-9303-ee1f1a979dc2 req-f1ceaedf-f9e9-40f6-bd68-f8b6008edb10 tempest-AttachVolumeTestJSON-729142982 None] attachment_update completed successfully. Jun 24 05:03:22 devstack sudo[100683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f Jun 24 05:03:22 devstack sudo[100683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:23 devstack sudo[100683]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c8a30cb9-544a-44dc-8afb-b8825cc860fb tempest-GroupSnapshotsTest-1374070386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f" returned: 0 in 0.899s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c8a30cb9-544a-44dc-8afb-b8825cc860fb tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f.5c628326-3f99-4f0c-94a1-e20c8abcf49c 1G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:23 devstack sudo[100694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f.5c628326-3f99-4f0c-94a1-e20c8abcf49c 1G Jun 24 05:03:23 devstack sudo[100694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:24 devstack sudo[100694]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c8a30cb9-544a-44dc-8afb-b8825cc860fb tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f.5c628326-3f99-4f0c-94a1-e20c8abcf49c 1G" returned: 0 in 1.047s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c8a30cb9-544a-44dc-8afb-b8825cc860fb tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f.5c628326-3f99-4f0c-94a1-e20c8abcf49c {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:24 devstack sudo[100717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f.5c628326-3f99-4f0c-94a1-e20c8abcf49c Jun 24 05:03:24 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:25 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c8a30cb9-544a-44dc-8afb-b8825cc860fb tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f.5c628326-3f99-4f0c-94a1-e20c8abcf49c" returned: 0 in 0.841s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:25 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-c8a30cb9-544a-44dc-8afb-b8825cc860fb tempest-GroupSnapshotsTest-1374070386 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f.5c628326-3f99-4f0c-94a1-e20c8abcf49c is being set with open permissions: ugo+rw: NotImplementedError Jun 24 05:03:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c8a30cb9-544a-44dc-8afb-b8825cc860fb tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f.5c628326-3f99-4f0c-94a1-e20c8abcf49c {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:25 devstack sudo[100768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f.5c628326-3f99-4f0c-94a1-e20c8abcf49c Jun 24 05:03:25 devstack sudo[100768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:26 devstack sudo[100768]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c8a30cb9-544a-44dc-8afb-b8825cc860fb tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f.5c628326-3f99-4f0c-94a1-e20c8abcf49c" returned: 0 in 0.719s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c8a30cb9-544a-44dc-8afb-b8825cc860fb tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:26 devstack sudo[100787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f.info Jun 24 05:03:26 devstack sudo[100787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:26 devstack sudo[100787]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c8a30cb9-544a-44dc-8afb-b8825cc860fb tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f.info" returned: 0 in 0.695s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:26 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-c8a30cb9-544a-44dc-8afb-b8825cc860fb tempest-GroupSnapshotsTest-1374070386 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f.info is being set with open permissions: ugo+rw: NotImplementedError Jun 24 05:03:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c8a30cb9-544a-44dc-8afb-b8825cc860fb tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:26 devstack sudo[100791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f.info Jun 24 05:03:26 devstack sudo[100791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:27 devstack sudo[100791]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c8a30cb9-544a-44dc-8afb-b8825cc860fb tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f.info" returned: 0 in 0.719s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-c8a30cb9-544a-44dc-8afb-b8825cc860fb tempest-GroupSnapshotsTest-1374070386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.036s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:03:27 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-c8a30cb9-544a-44dc-8afb-b8825cc860fb tempest-GroupSnapshotsTest-1374070386 None] group_snapshot 7ea56e24-976d-4b63-afe7-dc6a5caa72a3: created successfully Jun 24 05:03:27 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-fd18a24d-c809-486b-8269-21a64ce0b5af tempest-GroupSnapshotsTest-1374070386 None] group_snapshot 7ea56e24-976d-4b63-afe7-dc6a5caa72a3: deleting Jun 24 05:03:27 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fd18a24d-c809-486b-8269-21a64ce0b5af tempest-GroupSnapshotsTest-1374070386 None] group_snapshot 7ea56e24-976d-4b63-afe7-dc6a5caa72a3: deleting {{(pid=93830) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 24 05:03:27 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-fd18a24d-c809-486b-8269-21a64ce0b5af tempest-GroupSnapshotsTest-1374070386 None] Acquiring lock "cinder-quobyte-b4a49e1c-181b-4445-9b4d-d3b34f704c2f" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:03:28 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-fd18a24d-c809-486b-8269-21a64ce0b5af tempest-GroupSnapshotsTest-1374070386 None] Lock "cinder-quobyte-b4a49e1c-181b-4445-9b4d-d3b34f704c2f" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:03:28 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-fd18a24d-c809-486b-8269-21a64ce0b5af tempest-GroupSnapshotsTest-1374070386 None] Acquiring lock "cinder-quobyte-5c628326-3f99-4f0c-94a1-e20c8abcf49c" by "_delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:03:28 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-fd18a24d-c809-486b-8269-21a64ce0b5af tempest-GroupSnapshotsTest-1374070386 None] Lock "cinder-quobyte-5c628326-3f99-4f0c-94a1-e20c8abcf49c" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:03:28 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-fd18a24d-c809-486b-8269-21a64ce0b5af tempest-GroupSnapshotsTest-1374070386 None] Deleting offline snapshot 5c628326-3f99-4f0c-94a1-e20c8abcf49c of volume b4a49e1c-181b-4445-9b4d-d3b34f704c2f {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 05:03:28 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-fd18a24d-c809-486b-8269-21a64ce0b5af tempest-GroupSnapshotsTest-1374070386 None] snapshot_file for this snap is: volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f.5c628326-3f99-4f0c-94a1-e20c8abcf49c {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 05:03:28 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e97e1a7-ed04-4f7b-8a6f-304b1095a77e]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:03:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fd18a24d-c809-486b-8269-21a64ce0b5af tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f.5c628326-3f99-4f0c-94a1-e20c8abcf49c {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:28 devstack sudo[100821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f.5c628326-3f99-4f0c-94a1-e20c8abcf49c Jun 24 05:03:28 devstack sudo[100821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:28 devstack sudo[100821]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fd18a24d-c809-486b-8269-21a64ce0b5af tempest-GroupSnapshotsTest-1374070386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f.5c628326-3f99-4f0c-94a1-e20c8abcf49c" returned: 0 in 0.912s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:29 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-fd18a24d-c809-486b-8269-21a64ce0b5af tempest-GroupSnapshotsTest-1374070386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:03:29 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32730ee-d42c-47ca-ac96-b541611b60a0]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:03:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fd18a24d-c809-486b-8269-21a64ce0b5af tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:29 devstack sudo[100826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f Jun 24 05:03:29 devstack sudo[100826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:29 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-620e9381-e3dc-4cc6-b3f0-923796703c57 req-ffedae04-6366-4232-acf6-e8101fc8e37e tempest-AttachVolumeTestJSON-729142982 None] Terminate volume connection completed successfully. Jun 24 05:03:29 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-620e9381-e3dc-4cc6-b3f0-923796703c57 req-ffedae04-6366-4232-acf6-e8101fc8e37e tempest-AttachVolumeTestJSON-729142982 None] Deleting attachment 82ed4e52-3075-445d-b229-46a6ba144d84. {{(pid=93830) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 05:03:29 devstack sudo[100826]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fd18a24d-c809-486b-8269-21a64ce0b5af tempest-GroupSnapshotsTest-1374070386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f" returned: 0 in 0.786s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fd18a24d-c809-486b-8269-21a64ce0b5af tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f.5c628326-3f99-4f0c-94a1-e20c8abcf49c {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:29 devstack sudo[100840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f.5c628326-3f99-4f0c-94a1-e20c8abcf49c Jun 24 05:03:29 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:30 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fd18a24d-c809-486b-8269-21a64ce0b5af tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f.5c628326-3f99-4f0c-94a1-e20c8abcf49c" returned: 0 in 0.741s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fd18a24d-c809-486b-8269-21a64ce0b5af tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f.5c628326-3f99-4f0c-94a1-e20c8abcf49c {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:30 devstack sudo[100846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f.5c628326-3f99-4f0c-94a1-e20c8abcf49c Jun 24 05:03:30 devstack sudo[100846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:31 devstack sudo[100846]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fd18a24d-c809-486b-8269-21a64ce0b5af tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f.5c628326-3f99-4f0c-94a1-e20c8abcf49c" returned: 0 in 0.659s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:31 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-fd18a24d-c809-486b-8269-21a64ce0b5af tempest-GroupSnapshotsTest-1374070386 None] Lock "cinder-quobyte-5c628326-3f99-4f0c-94a1-e20c8abcf49c" released by "_delete_snapshot" :: held 3.228s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:03:31 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-fd18a24d-c809-486b-8269-21a64ce0b5af tempest-GroupSnapshotsTest-1374070386 None] Lock "cinder-quobyte-b4a49e1c-181b-4445-9b4d-d3b34f704c2f" released by "delete_snapshot" :: held 3.269s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:03:31 devstack cinder-volume[93830]: WARNING cinder.quota [None req-fd18a24d-c809-486b-8269-21a64ce0b5af tempest-GroupSnapshotsTest-1374070386 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-646583524 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-646583524, it is now deprecated. Please use the default quota class for default quota. Jun 24 05:03:31 devstack cinder-volume[93830]: WARNING cinder.quota [None req-fd18a24d-c809-486b-8269-21a64ce0b5af tempest-GroupSnapshotsTest-1374070386 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-646583524 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-646583524, it is now deprecated. Please use the default quota class for default quota. Jun 24 05:03:31 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-fd18a24d-c809-486b-8269-21a64ce0b5af tempest-GroupSnapshotsTest-1374070386 None] Created reservations ['c8b3bb6a-e7ac-4f4d-9aaf-4d1fbf21f62b', '13aec25d-8b46-4951-9de2-0a9f00fba43a', '6465d9c2-4e68-486b-be22-5b7635056178', 'b8bb051a-4e01-4560-8937-fb9e3c6d022b'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:03:31 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-fd18a24d-c809-486b-8269-21a64ce0b5af tempest-GroupSnapshotsTest-1374070386 None] group_snapshot 7ea56e24-976d-4b63-afe7-dc6a5caa72a3: deleted successfully Jun 24 05:03:32 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-7b3893db-5d81-4a99-be7f-f34d394aa05e req-76e00541-f2f0-45b4-bcf5-17dd82090bcc tempest-AttachVolumeTestJSON-729142982 None] Terminate volume connection completed successfully. Jun 24 05:03:32 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-7b3893db-5d81-4a99-be7f-f34d394aa05e req-76e00541-f2f0-45b4-bcf5-17dd82090bcc tempest-AttachVolumeTestJSON-729142982 None] Deleting attachment 52d0d74e-0d91-45d8-a4b8-ccf596a39d6b. {{(pid=93830) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 05:03:32 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-4b043c36-8b63-4dca-a0a1-2388b016ff64 tempest-GroupSnapshotsTest-1374070386 None] Acquiring lock "cinder-quobyte-b4a49e1c-181b-4445-9b4d-d3b34f704c2f" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:03:32 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-4b043c36-8b63-4dca-a0a1-2388b016ff64 tempest-GroupSnapshotsTest-1374070386 None] Lock "cinder-quobyte-b4a49e1c-181b-4445-9b4d-d3b34f704c2f" acquired by "delete_volume" :: waited 0.029s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:03:33 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2011f6-c7e4-473e-938d-2ca1affe7d64]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:03:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4b043c36-8b63-4dca-a0a1-2388b016ff64 tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:33 devstack sudo[100936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f Jun 24 05:03:33 devstack sudo[100936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:34 devstack sudo[100936]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4b043c36-8b63-4dca-a0a1-2388b016ff64 tempest-GroupSnapshotsTest-1374070386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f" returned: 0 in 0.950s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4b043c36-8b63-4dca-a0a1-2388b016ff64 tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:34 devstack sudo[100948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f Jun 24 05:03:34 devstack sudo[100948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:34 devstack sudo[100948]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4b043c36-8b63-4dca-a0a1-2388b016ff64 tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4a49e1c-181b-4445-9b4d-d3b34f704c2f" returned: 0 in 0.848s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:34 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-4b043c36-8b63-4dca-a0a1-2388b016ff64 tempest-GroupSnapshotsTest-1374070386 None] Lock "cinder-quobyte-b4a49e1c-181b-4445-9b4d-d3b34f704c2f" released by "delete_volume" :: held 1.904s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:03:34 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-4b043c36-8b63-4dca-a0a1-2388b016ff64 tempest-GroupSnapshotsTest-1374070386 None] Created reservations ['8457b624-5a9f-4ff8-91d7-3efefb21a3af'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:03:35 devstack cinder-volume[93830]: WARNING cinder.quota [None req-4b043c36-8b63-4dca-a0a1-2388b016ff64 tempest-GroupSnapshotsTest-1374070386 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-646583524 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-646583524, it is now deprecated. Please use the default quota class for default quota. Jun 24 05:03:35 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-4b043c36-8b63-4dca-a0a1-2388b016ff64 tempest-GroupSnapshotsTest-1374070386 None] Created reservations ['d50d51d1-0551-4750-9b30-86e4cef59a32', '5ea6fe8d-915d-466a-9e70-015fa0182ab5', 'afef07dc-c3b7-4faf-a75f-491b5a60b2a9', 'bb050dd4-277a-416d-85c1-d0411c3b50e3'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:03:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4b043c36-8b63-4dca-a0a1-2388b016ff64 tempest-GroupSnapshotsTest-1374070386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:03:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4b043c36-8b63-4dca-a0a1-2388b016ff64 tempest-GroupSnapshotsTest-1374070386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:03:35 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-4b043c36-8b63-4dca-a0a1-2388b016ff64 tempest-GroupSnapshotsTest-1374070386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:03:35 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-4b043c36-8b63-4dca-a0a1-2388b016ff64 tempest-GroupSnapshotsTest-1374070386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:03:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4b043c36-8b63-4dca-a0a1-2388b016ff64 tempest-GroupSnapshotsTest-1374070386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:03:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4b043c36-8b63-4dca-a0a1-2388b016ff64 tempest-GroupSnapshotsTest-1374070386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:35 devstack sudo[100952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:03:35 devstack sudo[100952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:36 devstack sudo[100952]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4b043c36-8b63-4dca-a0a1-2388b016ff64 tempest-GroupSnapshotsTest-1374070386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 1.408s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:36 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-4b043c36-8b63-4dca-a0a1-2388b016ff64 tempest-GroupSnapshotsTest-1374070386 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:03:36 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-4b043c36-8b63-4dca-a0a1-2388b016ff64 tempest-GroupSnapshotsTest-1374070386 None] Delete group completed successfully. Jun 24 05:03:36 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ab3d66f-e26a-45e8-b222-f07fbbf89888 tempest-VolumesActionsTest-907220492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:03:36 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2ab3d66f-e26a-45e8-b222-f07fbbf89888 tempest-VolumesActionsTest-907220492 None] Flow 'volume_create_manager' (f0dd687a-f238-4e31-b472-348b03dd4dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:03:36 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2ab3d66f-e26a-45e8-b222-f07fbbf89888 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1882d84-4377-433b-983f-686e960c771b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:03:37 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2ab3d66f-e26a-45e8-b222-f07fbbf89888 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1882d84-4377-433b-983f-686e960c771b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1548257140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=444d2b0e-e776-4ab9-b011-7ebb18593263,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbc22c9540fe4ac6bd7eb8cecc36ece1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:03:37Z,use_quota=True,user_id='f283f1650ffc455d93ae36e9340de4be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:03:37 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2ab3d66f-e26a-45e8-b222-f07fbbf89888 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82011287-1384-4cbd-be7a-1b324dffdfdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:03:37 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2ab3d66f-e26a-45e8-b222-f07fbbf89888 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82011287-1384-4cbd-be7a-1b324dffdfdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:03:37 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2ab3d66f-e26a-45e8-b222-f07fbbf89888 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eb7abfb-2439-472d-bcee-9cf9b313a6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:03:37 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2ab3d66f-e26a-45e8-b222-f07fbbf89888 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eb7abfb-2439-472d-bcee-9cf9b313a6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '444d2b0e-e776-4ab9-b011-7ebb18593263', 'volume_name': 'volume-444d2b0e-e776-4ab9-b011-7ebb18593263', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:03:37 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2ab3d66f-e26a-45e8-b222-f07fbbf89888 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbeb205e-067b-4d84-9533-445620ee8e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:03:37 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2ab3d66f-e26a-45e8-b222-f07fbbf89888 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbeb205e-067b-4d84-9533-445620ee8e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:03:37 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2ab3d66f-e26a-45e8-b222-f07fbbf89888 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d80be514-2595-42c0-a771-9f3e65f618ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:03:37 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-2ab3d66f-e26a-45e8-b222-f07fbbf89888 tempest-VolumesActionsTest-907220492 None] Volume 444d2b0e-e776-4ab9-b011-7ebb18593263: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-444d2b0e-e776-4ab9-b011-7ebb18593263', 'volume_size': 1} Jun 24 05:03:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-2ab3d66f-e26a-45e8-b222-f07fbbf89888 tempest-VolumesActionsTest-907220492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:03:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-2ab3d66f-e26a-45e8-b222-f07fbbf89888 tempest-VolumesActionsTest-907220492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:03:37 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-2ab3d66f-e26a-45e8-b222-f07fbbf89888 tempest-VolumesActionsTest-907220492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1548257140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=444d2b0e-e776-4ab9-b011-7ebb18593263,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbc22c9540fe4ac6bd7eb8cecc36ece1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:03:37Z,use_quota=True,user_id='f283f1650ffc455d93ae36e9340de4be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:03:37 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-2ab3d66f-e26a-45e8-b222-f07fbbf89888 tempest-VolumesActionsTest-907220492 None] Creating volume 444d2b0e-e776-4ab9-b011-7ebb18593263 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:03:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-2ab3d66f-e26a-45e8-b222-f07fbbf89888 tempest-VolumesActionsTest-907220492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:03:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-2ab3d66f-e26a-45e8-b222-f07fbbf89888 tempest-VolumesActionsTest-907220492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:03:37 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-2ab3d66f-e26a-45e8-b222-f07fbbf89888 tempest-VolumesActionsTest-907220492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:03:37 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-2ab3d66f-e26a-45e8-b222-f07fbbf89888 tempest-VolumesActionsTest-907220492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:03:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-2ab3d66f-e26a-45e8-b222-f07fbbf89888 tempest-VolumesActionsTest-907220492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:03:37 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-2ab3d66f-e26a-45e8-b222-f07fbbf89888 tempest-VolumesActionsTest-907220492 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:03:37 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-2ab3d66f-e26a-45e8-b222-f07fbbf89888 tempest-VolumesActionsTest-907220492 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:03:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2ab3d66f-e26a-45e8-b222-f07fbbf89888 tempest-VolumesActionsTest-907220492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-444d2b0e-e776-4ab9-b011-7ebb18593263 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:37 devstack sudo[101027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-444d2b0e-e776-4ab9-b011-7ebb18593263 1073741824 Jun 24 05:03:37 devstack sudo[101027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-fc9d5275-abfd-4cac-a673-42aafa177196 req-97f39671-ee90-4fac-86ee-ff2b3f7c807d tempest-ServerActionsTestOtherA-1758477181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:03:38 devstack sudo[101027]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2ab3d66f-e26a-45e8-b222-f07fbbf89888 tempest-VolumesActionsTest-907220492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-444d2b0e-e776-4ab9-b011-7ebb18593263 1073741824" returned: 0 in 1.883s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2ab3d66f-e26a-45e8-b222-f07fbbf89888 tempest-VolumesActionsTest-907220492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-444d2b0e-e776-4ab9-b011-7ebb18593263 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:39 devstack sudo[101057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-444d2b0e-e776-4ab9-b011-7ebb18593263 Jun 24 05:03:39 devstack sudo[101057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:40 devstack sudo[101057]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2ab3d66f-e26a-45e8-b222-f07fbbf89888 tempest-VolumesActionsTest-907220492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-444d2b0e-e776-4ab9-b011-7ebb18593263" returned: 0 in 1.201s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:40 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-2ab3d66f-e26a-45e8-b222-f07fbbf89888 tempest-VolumesActionsTest-907220492 None] <== create_volume: return (3159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:03:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-2ab3d66f-e26a-45e8-b222-f07fbbf89888 tempest-VolumesActionsTest-907220492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.161s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:03:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-fc9d5275-abfd-4cac-a673-42aafa177196 req-97f39671-ee90-4fac-86ee-ff2b3f7c807d tempest-ServerActionsTestOtherA-1758477181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.835s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:03:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2ab3d66f-e26a-45e8-b222-f07fbbf89888 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d80be514-2595-42c0-a771-9f3e65f618ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-444d2b0e-e776-4ab9-b011-7ebb18593263', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:03:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2ab3d66f-e26a-45e8-b222-f07fbbf89888 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f203e583-53b5-4b1c-b2c2-f469c7258144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:03:40 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea49c70a-700c-4953-aab2-7da020d0445a]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:03:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-fc9d5275-abfd-4cac-a673-42aafa177196 req-97f39671-ee90-4fac-86ee-ff2b3f7c807d tempest-ServerActionsTestOtherA-1758477181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ee9ad562-6754-4f5e-bb59-e29c736fa7f4 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:40 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-2ab3d66f-e26a-45e8-b222-f07fbbf89888 tempest-VolumesActionsTest-907220492 None] Volume volume-444d2b0e-e776-4ab9-b011-7ebb18593263 (444d2b0e-e776-4ab9-b011-7ebb18593263): created successfully Jun 24 05:03:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2ab3d66f-e26a-45e8-b222-f07fbbf89888 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f203e583-53b5-4b1c-b2c2-f469c7258144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:03:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2ab3d66f-e26a-45e8-b222-f07fbbf89888 tempest-VolumesActionsTest-907220492 None] Flow 'volume_create_manager' (f0dd687a-f238-4e31-b472-348b03dd4dbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:03:40 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-2ab3d66f-e26a-45e8-b222-f07fbbf89888 tempest-VolumesActionsTest-907220492 None] Created volume successfully. Jun 24 05:03:40 devstack sudo[101076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ee9ad562-6754-4f5e-bb59-e29c736fa7f4 Jun 24 05:03:40 devstack sudo[101076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:40 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-2769b1ad-95ba-4af9-8b17-b9195a7eb2b4 tempest-VolumesActionsTest-907220492 None] Acquiring lock "cinder-444d2b0e-e776-4ab9-b011-7ebb18593263" by "attach_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:03:40 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-2769b1ad-95ba-4af9-8b17-b9195a7eb2b4 tempest-VolumesActionsTest-907220492 None] Lock "cinder-444d2b0e-e776-4ab9-b011-7ebb18593263" acquired by "attach_volume" :: waited 0.030s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:03:41 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-2769b1ad-95ba-4af9-8b17-b9195a7eb2b4 tempest-VolumesActionsTest-907220492 None] Attaching volume 444d2b0e-e776-4ab9-b011-7ebb18593263 to instance 81024a22-b500-4e57-94a4-5b808cfa4bda at mountpoint /dev/vdb on host None. Jun 24 05:03:41 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-2769b1ad-95ba-4af9-8b17-b9195a7eb2b4 tempest-VolumesActionsTest-907220492 None] Attach volume completed successfully. Jun 24 05:03:41 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-2769b1ad-95ba-4af9-8b17-b9195a7eb2b4 tempest-VolumesActionsTest-907220492 None] Lock "cinder-444d2b0e-e776-4ab9-b011-7ebb18593263" released by "attach_volume" :: held 0.238s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:03:41 devstack sudo[101076]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-fc9d5275-abfd-4cac-a673-42aafa177196 req-97f39671-ee90-4fac-86ee-ff2b3f7c807d tempest-ServerActionsTestOtherA-1758477181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ee9ad562-6754-4f5e-bb59-e29c736fa7f4" returned: 0 in 1.081s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-fc9d5275-abfd-4cac-a673-42aafa177196 req-97f39671-ee90-4fac-86ee-ff2b3f7c807d tempest-ServerActionsTestOtherA-1758477181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.133s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:03:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-fc9d5275-abfd-4cac-a673-42aafa177196 req-97f39671-ee90-4fac-86ee-ff2b3f7c807d tempest-ServerActionsTestOtherA-1758477181 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05', 'name': 'volume-ee9ad562-6754-4f5e-bb59-e29c736fa7f4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5be7c4c4-0775-4797-b887-41760b6e12e3', 'enforce_multipath': True} {{(pid=93830) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 05:03:41 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-fc9d5275-abfd-4cac-a673-42aafa177196 req-97f39671-ee90-4fac-86ee-ff2b3f7c807d tempest-ServerActionsTestOtherA-1758477181 None] attachment_update completed successfully. Jun 24 05:03:42 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:SELECT=95,cinder:INSERT=23,cinder:UPDATE=100,cinder:DELETE=5 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:03:42 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-a3f79d5c-099f-4461-9e32-ace18132de5c tempest-VolumesActionsTest-153948387 None] Terminate volume connection completed successfully. Jun 24 05:03:42 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a3f79d5c-099f-4461-9e32-ace18132de5c tempest-VolumesActionsTest-153948387 None] Acquiring lock "cinder-444d2b0e-e776-4ab9-b011-7ebb18593263-detach_volume" by "detach_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:03:42 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a3f79d5c-099f-4461-9e32-ace18132de5c tempest-VolumesActionsTest-153948387 None] Lock "cinder-444d2b0e-e776-4ab9-b011-7ebb18593263-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:03:42 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-a3f79d5c-099f-4461-9e32-ace18132de5c tempest-VolumesActionsTest-153948387 None] Detaching volume 444d2b0e-e776-4ab9-b011-7ebb18593263 from instance 81024a22-b500-4e57-94a4-5b808cfa4bda. Jun 24 05:03:43 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-a3f79d5c-099f-4461-9e32-ace18132de5c tempest-VolumesActionsTest-153948387 None] Detach volume completed successfully. Jun 24 05:03:43 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a3f79d5c-099f-4461-9e32-ace18132de5c tempest-VolumesActionsTest-153948387 None] Lock "cinder-444d2b0e-e776-4ab9-b011-7ebb18593263-detach_volume" released by "detach_volume" :: held 0.089s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:03:43 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-38f0c101-363a-4a3e-bd30-19346cfcfa4c tempest-VolumesActionsTest-907220492 None] Acquiring lock "cinder-444d2b0e-e776-4ab9-b011-7ebb18593263-detach_volume" by "detach_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:03:43 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-38f0c101-363a-4a3e-bd30-19346cfcfa4c tempest-VolumesActionsTest-907220492 None] Lock "cinder-444d2b0e-e776-4ab9-b011-7ebb18593263-detach_volume" acquired by "detach_volume" :: waited 0.015s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:03:43 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-38f0c101-363a-4a3e-bd30-19346cfcfa4c tempest-VolumesActionsTest-907220492 None] Volume detach called, but volume not attached. Jun 24 05:03:43 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-38f0c101-363a-4a3e-bd30-19346cfcfa4c tempest-VolumesActionsTest-907220492 None] Lock "cinder-444d2b0e-e776-4ab9-b011-7ebb18593263-detach_volume" released by "detach_volume" :: held 0.026s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:03:44 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-5e52dbce-f229-4f53-b6ec-c53e028183b7 tempest-VolumesActionsTest-907220492 None] Acquiring lock "cinder-444d2b0e-e776-4ab9-b011-7ebb18593263-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:03:44 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-5e52dbce-f229-4f53-b6ec-c53e028183b7 tempest-VolumesActionsTest-907220492 None] Lock "cinder-444d2b0e-e776-4ab9-b011-7ebb18593263-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:03:44 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-5e52dbce-f229-4f53-b6ec-c53e028183b7 tempest-VolumesActionsTest-907220492 None] Acquiring lock "cinder-quobyte-444d2b0e-e776-4ab9-b011-7ebb18593263" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:03:44 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-5e52dbce-f229-4f53-b6ec-c53e028183b7 tempest-VolumesActionsTest-907220492 None] Lock "cinder-quobyte-444d2b0e-e776-4ab9-b011-7ebb18593263" acquired by "delete_volume" :: waited 0.023s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:03:44 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[685f27c1-fc5d-40a9-9bb2-18b92ffe6564]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:03:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5e52dbce-f229-4f53-b6ec-c53e028183b7 tempest-VolumesActionsTest-907220492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-444d2b0e-e776-4ab9-b011-7ebb18593263 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:44 devstack sudo[101470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-444d2b0e-e776-4ab9-b011-7ebb18593263 Jun 24 05:03:44 devstack sudo[101470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:46 devstack sudo[101470]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:46 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-245d47cc-24fe-4bf2-95bb-b94e1b879711 tempest-AttachVolumeTestJSON-729142982 None] Acquiring lock "cinder-b069076e-be02-42d5-a3e4-7f8c98b97371-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:03:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5e52dbce-f229-4f53-b6ec-c53e028183b7 tempest-VolumesActionsTest-907220492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-444d2b0e-e776-4ab9-b011-7ebb18593263" returned: 0 in 1.372s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5e52dbce-f229-4f53-b6ec-c53e028183b7 tempest-VolumesActionsTest-907220492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-444d2b0e-e776-4ab9-b011-7ebb18593263 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:46 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-245d47cc-24fe-4bf2-95bb-b94e1b879711 tempest-AttachVolumeTestJSON-729142982 None] Lock "cinder-b069076e-be02-42d5-a3e4-7f8c98b97371-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:03:46 devstack sudo[101477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-444d2b0e-e776-4ab9-b011-7ebb18593263 Jun 24 05:03:46 devstack sudo[101477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:46 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-245d47cc-24fe-4bf2-95bb-b94e1b879711 tempest-AttachVolumeTestJSON-729142982 None] Acquiring lock "cinder-quobyte-b069076e-be02-42d5-a3e4-7f8c98b97371" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:03:46 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-245d47cc-24fe-4bf2-95bb-b94e1b879711 tempest-AttachVolumeTestJSON-729142982 None] Lock "cinder-quobyte-b069076e-be02-42d5-a3e4-7f8c98b97371" acquired by "delete_volume" :: waited 0.039s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:03:46 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac512fd4-91a8-46c4-8a3c-cba482ec02c6]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:03:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-245d47cc-24fe-4bf2-95bb-b94e1b879711 tempest-AttachVolumeTestJSON-729142982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b069076e-be02-42d5-a3e4-7f8c98b97371 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:46 devstack sudo[101500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b069076e-be02-42d5-a3e4-7f8c98b97371 Jun 24 05:03:46 devstack sudo[101500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:46 devstack sudo[101477]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5e52dbce-f229-4f53-b6ec-c53e028183b7 tempest-VolumesActionsTest-907220492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-444d2b0e-e776-4ab9-b011-7ebb18593263" returned: 0 in 0.924s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:46 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-5e52dbce-f229-4f53-b6ec-c53e028183b7 tempest-VolumesActionsTest-907220492 None] Lock "cinder-quobyte-444d2b0e-e776-4ab9-b011-7ebb18593263" released by "delete_volume" :: held 2.365s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:03:47 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-5e52dbce-f229-4f53-b6ec-c53e028183b7 tempest-VolumesActionsTest-907220492 None] Created reservations ['703e7851-5d2f-4d72-a779-2ef59f9da9c7', 'f69f58ae-0570-4064-bcfb-582f77534c07', 'e2b682ff-715c-4924-b5d9-eb5f1c617560', '4cc9a90b-c7a9-436a-abcd-41f0cbe413f1'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:03:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5e52dbce-f229-4f53-b6ec-c53e028183b7 tempest-VolumesActionsTest-907220492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:03:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5e52dbce-f229-4f53-b6ec-c53e028183b7 tempest-VolumesActionsTest-907220492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:03:47 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-5e52dbce-f229-4f53-b6ec-c53e028183b7 tempest-VolumesActionsTest-907220492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:03:47 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-5e52dbce-f229-4f53-b6ec-c53e028183b7 tempest-VolumesActionsTest-907220492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:03:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5e52dbce-f229-4f53-b6ec-c53e028183b7 tempest-VolumesActionsTest-907220492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:03:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5e52dbce-f229-4f53-b6ec-c53e028183b7 tempest-VolumesActionsTest-907220492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:47 devstack sudo[101510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:03:47 devstack sudo[101510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:47 devstack sudo[101500]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-245d47cc-24fe-4bf2-95bb-b94e1b879711 tempest-AttachVolumeTestJSON-729142982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b069076e-be02-42d5-a3e4-7f8c98b97371" returned: 0 in 1.072s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-245d47cc-24fe-4bf2-95bb-b94e1b879711 tempest-AttachVolumeTestJSON-729142982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b069076e-be02-42d5-a3e4-7f8c98b97371 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:47 devstack sudo[101512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b069076e-be02-42d5-a3e4-7f8c98b97371 Jun 24 05:03:47 devstack sudo[101512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:48 devstack sudo[101510]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5e52dbce-f229-4f53-b6ec-c53e028183b7 tempest-VolumesActionsTest-907220492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 1.000s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:48 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-5e52dbce-f229-4f53-b6ec-c53e028183b7 tempest-VolumesActionsTest-907220492 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:03:48 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-5e52dbce-f229-4f53-b6ec-c53e028183b7 tempest-VolumesActionsTest-907220492 None] Deleted volume successfully. Jun 24 05:03:48 devstack sudo[101512]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-245d47cc-24fe-4bf2-95bb-b94e1b879711 tempest-AttachVolumeTestJSON-729142982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b069076e-be02-42d5-a3e4-7f8c98b97371" returned: 0 in 0.937s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:48 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-5e52dbce-f229-4f53-b6ec-c53e028183b7 tempest-VolumesActionsTest-907220492 None] Lock "cinder-444d2b0e-e776-4ab9-b011-7ebb18593263-delete_volume" released by "delete_volume" :: held 3.722s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:03:48 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-245d47cc-24fe-4bf2-95bb-b94e1b879711 tempest-AttachVolumeTestJSON-729142982 None] Lock "cinder-quobyte-b069076e-be02-42d5-a3e4-7f8c98b97371" released by "delete_volume" :: held 2.098s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:03:48 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-245d47cc-24fe-4bf2-95bb-b94e1b879711 tempest-AttachVolumeTestJSON-729142982 None] Created reservations ['fdfe8489-279a-411a-9160-1ec60cbbc0ee', '5ba78fed-cdde-4fa0-a2c3-525747e81d98', '0c4418e9-0b84-4223-97fd-d42e129b2ecd', '45a9bbba-5b9a-4de8-a8c3-043eab565f91'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:03:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-245d47cc-24fe-4bf2-95bb-b94e1b879711 tempest-AttachVolumeTestJSON-729142982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:03:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-245d47cc-24fe-4bf2-95bb-b94e1b879711 tempest-AttachVolumeTestJSON-729142982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:03:48 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-245d47cc-24fe-4bf2-95bb-b94e1b879711 tempest-AttachVolumeTestJSON-729142982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:03:48 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-245d47cc-24fe-4bf2-95bb-b94e1b879711 tempest-AttachVolumeTestJSON-729142982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:03:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-245d47cc-24fe-4bf2-95bb-b94e1b879711 tempest-AttachVolumeTestJSON-729142982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:03:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-245d47cc-24fe-4bf2-95bb-b94e1b879711 tempest-AttachVolumeTestJSON-729142982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:48 devstack sudo[101520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:03:48 devstack sudo[101520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:49 devstack sudo[101520]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-245d47cc-24fe-4bf2-95bb-b94e1b879711 tempest-AttachVolumeTestJSON-729142982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.731s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:49 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-245d47cc-24fe-4bf2-95bb-b94e1b879711 tempest-AttachVolumeTestJSON-729142982 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:03:49 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-245d47cc-24fe-4bf2-95bb-b94e1b879711 tempest-AttachVolumeTestJSON-729142982 None] Deleted volume successfully. Jun 24 05:03:49 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-245d47cc-24fe-4bf2-95bb-b94e1b879711 tempest-AttachVolumeTestJSON-729142982 None] Lock "cinder-b069076e-be02-42d5-a3e4-7f8c98b97371-delete_volume" released by "delete_volume" :: held 3.254s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:03:49 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3e669723-8ba7-4380-8212-5c286dff30e4 tempest-AttachVolumeTestJSON-729142982 None] Acquiring lock "cinder-98c32053-bcb0-42eb-9381-cd3ba2759e8a-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:03:49 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3e669723-8ba7-4380-8212-5c286dff30e4 tempest-AttachVolumeTestJSON-729142982 None] Lock "cinder-98c32053-bcb0-42eb-9381-cd3ba2759e8a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:03:49 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3e669723-8ba7-4380-8212-5c286dff30e4 tempest-AttachVolumeTestJSON-729142982 None] Acquiring lock "cinder-quobyte-98c32053-bcb0-42eb-9381-cd3ba2759e8a" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:03:49 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3e669723-8ba7-4380-8212-5c286dff30e4 tempest-AttachVolumeTestJSON-729142982 None] Lock "cinder-quobyte-98c32053-bcb0-42eb-9381-cd3ba2759e8a" acquired by "delete_volume" :: waited 0.047s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:03:49 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cce7d03-8062-4fa2-bb82-9e5c7cb7dc93]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:03:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3e669723-8ba7-4380-8212-5c286dff30e4 tempest-AttachVolumeTestJSON-729142982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-98c32053-bcb0-42eb-9381-cd3ba2759e8a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:49 devstack sudo[101559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-98c32053-bcb0-42eb-9381-cd3ba2759e8a Jun 24 05:03:49 devstack sudo[101559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:51 devstack sudo[101559]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3e669723-8ba7-4380-8212-5c286dff30e4 tempest-AttachVolumeTestJSON-729142982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-98c32053-bcb0-42eb-9381-cd3ba2759e8a" returned: 0 in 1.356s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3e669723-8ba7-4380-8212-5c286dff30e4 tempest-AttachVolumeTestJSON-729142982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-98c32053-bcb0-42eb-9381-cd3ba2759e8a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:51 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-d594dc57-229d-411f-a0ea-8b1b562665fb req-31d9e4d4-5be8-47bf-a68e-6cdad6f5f1da tempest-ServerActionsTestOtherA-1758477181 None] Terminate volume connection completed successfully. Jun 24 05:03:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-d594dc57-229d-411f-a0ea-8b1b562665fb req-31d9e4d4-5be8-47bf-a68e-6cdad6f5f1da tempest-ServerActionsTestOtherA-1758477181 None] Deleting attachment 5be7c4c4-0775-4797-b887-41760b6e12e3. {{(pid=93830) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 05:03:51 devstack sudo[101641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-98c32053-bcb0-42eb-9381-cd3ba2759e8a Jun 24 05:03:51 devstack sudo[101641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:51 devstack sudo[101641]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3e669723-8ba7-4380-8212-5c286dff30e4 tempest-AttachVolumeTestJSON-729142982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-98c32053-bcb0-42eb-9381-cd3ba2759e8a" returned: 0 in 0.913s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:51 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3e669723-8ba7-4380-8212-5c286dff30e4 tempest-AttachVolumeTestJSON-729142982 None] Lock "cinder-quobyte-98c32053-bcb0-42eb-9381-cd3ba2759e8a" released by "delete_volume" :: held 2.359s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:03:52 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-3e669723-8ba7-4380-8212-5c286dff30e4 tempest-AttachVolumeTestJSON-729142982 None] Created reservations ['c4f19f28-8aec-46ec-9a7c-4684168a1bbe', 'beaa7605-e69d-47e4-af35-a4f4aa83f37d', 'a62af104-3389-4513-b278-13318d894b88', 'ce16d2db-5975-4353-8aef-fe3bf70bacff'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:03:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3e669723-8ba7-4380-8212-5c286dff30e4 tempest-AttachVolumeTestJSON-729142982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:03:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3e669723-8ba7-4380-8212-5c286dff30e4 tempest-AttachVolumeTestJSON-729142982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:03:52 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-3e669723-8ba7-4380-8212-5c286dff30e4 tempest-AttachVolumeTestJSON-729142982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:03:52 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-3e669723-8ba7-4380-8212-5c286dff30e4 tempest-AttachVolumeTestJSON-729142982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:03:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3e669723-8ba7-4380-8212-5c286dff30e4 tempest-AttachVolumeTestJSON-729142982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:03:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3e669723-8ba7-4380-8212-5c286dff30e4 tempest-AttachVolumeTestJSON-729142982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:52 devstack sudo[101646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:03:52 devstack sudo[101646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:52 devstack sudo[101646]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3e669723-8ba7-4380-8212-5c286dff30e4 tempest-AttachVolumeTestJSON-729142982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.841s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:52 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-3e669723-8ba7-4380-8212-5c286dff30e4 tempest-AttachVolumeTestJSON-729142982 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:03:52 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-3e669723-8ba7-4380-8212-5c286dff30e4 tempest-AttachVolumeTestJSON-729142982 None] Deleted volume successfully. Jun 24 05:03:52 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3e669723-8ba7-4380-8212-5c286dff30e4 tempest-AttachVolumeTestJSON-729142982 None] Lock "cinder-98c32053-bcb0-42eb-9381-cd3ba2759e8a-delete_volume" released by "delete_volume" :: held 3.465s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:03:53 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-c319edba-d7dd-4749-953d-5a91e4e93b32 tempest-AttachVolumeTestJSON-729142982 None] Acquiring lock "cinder-7a553c74-0fb4-4746-a67a-e6f3315ecd14-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:03:53 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-c319edba-d7dd-4749-953d-5a91e4e93b32 tempest-AttachVolumeTestJSON-729142982 None] Lock "cinder-7a553c74-0fb4-4746-a67a-e6f3315ecd14-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:03:53 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-c319edba-d7dd-4749-953d-5a91e4e93b32 tempest-AttachVolumeTestJSON-729142982 None] Acquiring lock "cinder-quobyte-7a553c74-0fb4-4746-a67a-e6f3315ecd14" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:03:53 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-c319edba-d7dd-4749-953d-5a91e4e93b32 tempest-AttachVolumeTestJSON-729142982 None] Lock "cinder-quobyte-7a553c74-0fb4-4746-a67a-e6f3315ecd14" acquired by "delete_volume" :: waited 0.020s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:03:53 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[269ce9e4-e0e8-436a-a47b-8e0f92422b1a]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:03:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c319edba-d7dd-4749-953d-5a91e4e93b32 tempest-AttachVolumeTestJSON-729142982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7a553c74-0fb4-4746-a67a-e6f3315ecd14 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:53 devstack sudo[101650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7a553c74-0fb4-4746-a67a-e6f3315ecd14 Jun 24 05:03:53 devstack sudo[101650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-d594dc57-229d-411f-a0ea-8b1b562665fb req-d2d624af-0104-43e1-9f3f-1163bbcfed7b tempest-ServerActionsTestOtherA-1758477181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:03:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-d594dc57-229d-411f-a0ea-8b1b562665fb req-d2d624af-0104-43e1-9f3f-1163bbcfed7b tempest-ServerActionsTestOtherA-1758477181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:03:53 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9db347-38a1-4858-9360-c1c73b6ed5c9]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:03:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-d594dc57-229d-411f-a0ea-8b1b562665fb req-d2d624af-0104-43e1-9f3f-1163bbcfed7b tempest-ServerActionsTestOtherA-1758477181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ee9ad562-6754-4f5e-bb59-e29c736fa7f4 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:53 devstack sudo[101660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ee9ad562-6754-4f5e-bb59-e29c736fa7f4 Jun 24 05:03:53 devstack sudo[101660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:54 devstack sudo[101650]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c319edba-d7dd-4749-953d-5a91e4e93b32 tempest-AttachVolumeTestJSON-729142982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7a553c74-0fb4-4746-a67a-e6f3315ecd14" returned: 0 in 1.048s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c319edba-d7dd-4749-953d-5a91e4e93b32 tempest-AttachVolumeTestJSON-729142982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7a553c74-0fb4-4746-a67a-e6f3315ecd14 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:54 devstack sudo[101665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7a553c74-0fb4-4746-a67a-e6f3315ecd14 Jun 24 05:03:54 devstack sudo[101665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:54 devstack sudo[101660]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-d594dc57-229d-411f-a0ea-8b1b562665fb req-d2d624af-0104-43e1-9f3f-1163bbcfed7b tempest-ServerActionsTestOtherA-1758477181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ee9ad562-6754-4f5e-bb59-e29c736fa7f4" returned: 0 in 1.024s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-d594dc57-229d-411f-a0ea-8b1b562665fb req-d2d624af-0104-43e1-9f3f-1163bbcfed7b tempest-ServerActionsTestOtherA-1758477181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.043s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:03:54 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:UPDATE=89,cinder:SELECT=112,cinder:INSERT=21,cinder:DELETE=2 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:03:54 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-d594dc57-229d-411f-a0ea-8b1b562665fb req-d2d624af-0104-43e1-9f3f-1163bbcfed7b tempest-ServerActionsTestOtherA-1758477181 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05', 'name': 'volume-ee9ad562-6754-4f5e-bb59-e29c736fa7f4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9ce6ba4d-ed07-4215-bfd3-61f8a3c22b18', 'enforce_multipath': True} {{(pid=93830) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 05:03:54 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-d594dc57-229d-411f-a0ea-8b1b562665fb req-d2d624af-0104-43e1-9f3f-1163bbcfed7b tempest-ServerActionsTestOtherA-1758477181 None] attachment_update completed successfully. Jun 24 05:03:55 devstack sudo[101665]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c319edba-d7dd-4749-953d-5a91e4e93b32 tempest-AttachVolumeTestJSON-729142982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7a553c74-0fb4-4746-a67a-e6f3315ecd14" returned: 0 in 0.760s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:55 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-c319edba-d7dd-4749-953d-5a91e4e93b32 tempest-AttachVolumeTestJSON-729142982 None] Lock "cinder-quobyte-7a553c74-0fb4-4746-a67a-e6f3315ecd14" released by "delete_volume" :: held 1.853s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:03:55 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-c319edba-d7dd-4749-953d-5a91e4e93b32 tempest-AttachVolumeTestJSON-729142982 None] Created reservations ['4799996d-7b4a-42d1-b7ce-030bdd9642ad', '36de17d0-ed5d-4bbb-9b44-a1b15d498bf0', '6901f03b-387b-461f-9495-81c658de1bc5', '3e324865-56b7-45f8-bc5c-a92357f3e34c'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:03:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-c319edba-d7dd-4749-953d-5a91e4e93b32 tempest-AttachVolumeTestJSON-729142982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:03:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-c319edba-d7dd-4749-953d-5a91e4e93b32 tempest-AttachVolumeTestJSON-729142982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:03:55 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-c319edba-d7dd-4749-953d-5a91e4e93b32 tempest-AttachVolumeTestJSON-729142982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:03:55 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-c319edba-d7dd-4749-953d-5a91e4e93b32 tempest-AttachVolumeTestJSON-729142982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:03:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-c319edba-d7dd-4749-953d-5a91e4e93b32 tempest-AttachVolumeTestJSON-729142982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:03:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c319edba-d7dd-4749-953d-5a91e4e93b32 tempest-AttachVolumeTestJSON-729142982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:55 devstack sudo[101671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:03:55 devstack sudo[101671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:56 devstack sudo[101671]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c319edba-d7dd-4749-953d-5a91e4e93b32 tempest-AttachVolumeTestJSON-729142982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.903s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:56 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-c319edba-d7dd-4749-953d-5a91e4e93b32 tempest-AttachVolumeTestJSON-729142982 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:03:56 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-c319edba-d7dd-4749-953d-5a91e4e93b32 tempest-AttachVolumeTestJSON-729142982 None] Deleted volume successfully. Jun 24 05:03:56 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-c319edba-d7dd-4749-953d-5a91e4e93b32 tempest-AttachVolumeTestJSON-729142982 None] Lock "cinder-7a553c74-0fb4-4746-a67a-e6f3315ecd14-delete_volume" released by "delete_volume" :: held 2.994s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:03:56 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-547c7506-d704-41b5-8597-627e049b7e1f tempest-VolumesActionsTest-907220492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:03:56 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-547c7506-d704-41b5-8597-627e049b7e1f tempest-VolumesActionsTest-907220492 None] Flow 'volume_create_manager' (8e1b362c-dc8a-47a2-82b3-88957c238512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:03:56 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-547c7506-d704-41b5-8597-627e049b7e1f tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74d0d804-9af2-4c05-aae4-4cd499c1214c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:03:56 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-547c7506-d704-41b5-8597-627e049b7e1f tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74d0d804-9af2-4c05-aae4-4cd499c1214c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-711450755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2dc5bd4-967b-467a-9c3c-dc937f2cdaba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbc22c9540fe4ac6bd7eb8cecc36ece1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:03:56Z,use_quota=True,user_id='f283f1650ffc455d93ae36e9340de4be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:03:56 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-547c7506-d704-41b5-8597-627e049b7e1f tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebf6f159-ff7a-416d-b9bc-f5ac9684a2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:03:56 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-547c7506-d704-41b5-8597-627e049b7e1f tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebf6f159-ff7a-416d-b9bc-f5ac9684a2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:03:56 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-547c7506-d704-41b5-8597-627e049b7e1f tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7c92c55-d045-4065-847b-5750e2389244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:03:56 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-547c7506-d704-41b5-8597-627e049b7e1f tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7c92c55-d045-4065-847b-5750e2389244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2dc5bd4-967b-467a-9c3c-dc937f2cdaba', 'volume_name': 'volume-f2dc5bd4-967b-467a-9c3c-dc937f2cdaba', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:03:56 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-547c7506-d704-41b5-8597-627e049b7e1f tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ffd1a8b-9f0e-4f2f-af87-946839bb3cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:03:56 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-547c7506-d704-41b5-8597-627e049b7e1f tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ffd1a8b-9f0e-4f2f-af87-946839bb3cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:03:56 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-547c7506-d704-41b5-8597-627e049b7e1f tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9895b75-bb8e-471e-ad1f-22a50eb948b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:03:56 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-547c7506-d704-41b5-8597-627e049b7e1f tempest-VolumesActionsTest-907220492 None] Volume f2dc5bd4-967b-467a-9c3c-dc937f2cdaba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2dc5bd4-967b-467a-9c3c-dc937f2cdaba', 'volume_size': 1} Jun 24 05:03:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-547c7506-d704-41b5-8597-627e049b7e1f tempest-VolumesActionsTest-907220492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:03:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-547c7506-d704-41b5-8597-627e049b7e1f tempest-VolumesActionsTest-907220492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:03:56 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-547c7506-d704-41b5-8597-627e049b7e1f tempest-VolumesActionsTest-907220492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-711450755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2dc5bd4-967b-467a-9c3c-dc937f2cdaba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbc22c9540fe4ac6bd7eb8cecc36ece1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:03:56Z,use_quota=True,user_id='f283f1650ffc455d93ae36e9340de4be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:03:56 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-547c7506-d704-41b5-8597-627e049b7e1f tempest-VolumesActionsTest-907220492 None] Creating volume f2dc5bd4-967b-467a-9c3c-dc937f2cdaba {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:03:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-547c7506-d704-41b5-8597-627e049b7e1f tempest-VolumesActionsTest-907220492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:03:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-547c7506-d704-41b5-8597-627e049b7e1f tempest-VolumesActionsTest-907220492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:03:56 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-547c7506-d704-41b5-8597-627e049b7e1f tempest-VolumesActionsTest-907220492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:03:56 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-547c7506-d704-41b5-8597-627e049b7e1f tempest-VolumesActionsTest-907220492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:03:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-547c7506-d704-41b5-8597-627e049b7e1f tempest-VolumesActionsTest-907220492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:03:56 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-547c7506-d704-41b5-8597-627e049b7e1f tempest-VolumesActionsTest-907220492 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:03:56 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-547c7506-d704-41b5-8597-627e049b7e1f tempest-VolumesActionsTest-907220492 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:03:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-547c7506-d704-41b5-8597-627e049b7e1f tempest-VolumesActionsTest-907220492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f2dc5bd4-967b-467a-9c3c-dc937f2cdaba 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:56 devstack sudo[101674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f2dc5bd4-967b-467a-9c3c-dc937f2cdaba 1073741824 Jun 24 05:03:56 devstack sudo[101674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:57 devstack sudo[101674]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-547c7506-d704-41b5-8597-627e049b7e1f tempest-VolumesActionsTest-907220492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f2dc5bd4-967b-467a-9c3c-dc937f2cdaba 1073741824" returned: 0 in 1.146s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-547c7506-d704-41b5-8597-627e049b7e1f tempest-VolumesActionsTest-907220492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f2dc5bd4-967b-467a-9c3c-dc937f2cdaba {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:57 devstack sudo[101694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f2dc5bd4-967b-467a-9c3c-dc937f2cdaba Jun 24 05:03:57 devstack sudo[101694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:58 devstack sudo[101694]: pam_unix(sudo:session): session closed for user root Jun 24 05:03:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-547c7506-d704-41b5-8597-627e049b7e1f tempest-VolumesActionsTest-907220492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f2dc5bd4-967b-467a-9c3c-dc937f2cdaba" returned: 0 in 0.876s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:03:58 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-547c7506-d704-41b5-8597-627e049b7e1f tempest-VolumesActionsTest-907220492 None] <== create_volume: return (2096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:03:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-547c7506-d704-41b5-8597-627e049b7e1f tempest-VolumesActionsTest-907220492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.101s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:03:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-547c7506-d704-41b5-8597-627e049b7e1f tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9895b75-bb8e-471e-ad1f-22a50eb948b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2dc5bd4-967b-467a-9c3c-dc937f2cdaba', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:03:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-547c7506-d704-41b5-8597-627e049b7e1f tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e7a9c15-11f6-4c7e-8699-5ad28e8b9799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:03:58 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-547c7506-d704-41b5-8597-627e049b7e1f tempest-VolumesActionsTest-907220492 None] Volume volume-f2dc5bd4-967b-467a-9c3c-dc937f2cdaba (f2dc5bd4-967b-467a-9c3c-dc937f2cdaba): created successfully Jun 24 05:03:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-547c7506-d704-41b5-8597-627e049b7e1f tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e7a9c15-11f6-4c7e-8699-5ad28e8b9799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:03:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-547c7506-d704-41b5-8597-627e049b7e1f tempest-VolumesActionsTest-907220492 None] Flow 'volume_create_manager' (8e1b362c-dc8a-47a2-82b3-88957c238512) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:03:58 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-547c7506-d704-41b5-8597-627e049b7e1f tempest-VolumesActionsTest-907220492 None] Created volume successfully. Jun 24 05:03:59 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-0906ad5d-bc05-4aee-a8ec-19b458f848c8 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:03:59 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-0906ad5d-bc05-4aee-a8ec-19b458f848c8 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Flow 'volume_create_manager' (b917a570-57bc-4ff6-93bf-c87294be04be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:03:59 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-0906ad5d-bc05-4aee-a8ec-19b458f848c8 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e865670-43d8-4f6f-b253-113911ead826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:03:59 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-0906ad5d-bc05-4aee-a8ec-19b458f848c8 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e865670-43d8-4f6f-b253-113911ead826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-440348578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15030df1-9d63-4338-9f05-350f2add1b64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba57f42878da44a684af180be9d68ef9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:03:59Z,use_quota=True,user_id='ac4df3d262a54400833334a69ac63fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:03:59 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-0906ad5d-bc05-4aee-a8ec-19b458f848c8 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9968716-d60b-4981-978e-f603ee5fdbe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:03:59 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-0906ad5d-bc05-4aee-a8ec-19b458f848c8 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9968716-d60b-4981-978e-f603ee5fdbe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:03:59 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-0906ad5d-bc05-4aee-a8ec-19b458f848c8 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53be59fd-588e-48fe-bb4d-31cb6591d6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:03:59 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-0906ad5d-bc05-4aee-a8ec-19b458f848c8 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53be59fd-588e-48fe-bb4d-31cb6591d6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15030df1-9d63-4338-9f05-350f2add1b64', 'volume_name': 'volume-15030df1-9d63-4338-9f05-350f2add1b64', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:03:59 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-0906ad5d-bc05-4aee-a8ec-19b458f848c8 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cbd3e00-092c-432e-a320-b2f2a64f6305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:03:59 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-0906ad5d-bc05-4aee-a8ec-19b458f848c8 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cbd3e00-092c-432e-a320-b2f2a64f6305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:03:59 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-0906ad5d-bc05-4aee-a8ec-19b458f848c8 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c420f3f4-6a57-4501-8a3f-def4cf2f08dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:03:59 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-0906ad5d-bc05-4aee-a8ec-19b458f848c8 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Volume 15030df1-9d63-4338-9f05-350f2add1b64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15030df1-9d63-4338-9f05-350f2add1b64', 'volume_size': 1} Jun 24 05:03:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-0906ad5d-bc05-4aee-a8ec-19b458f848c8 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:03:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-0906ad5d-bc05-4aee-a8ec-19b458f848c8 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:03:59 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-0906ad5d-bc05-4aee-a8ec-19b458f848c8 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-440348578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15030df1-9d63-4338-9f05-350f2add1b64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba57f42878da44a684af180be9d68ef9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:03:59Z,use_quota=True,user_id='ac4df3d262a54400833334a69ac63fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:03:59 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-0906ad5d-bc05-4aee-a8ec-19b458f848c8 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Creating volume 15030df1-9d63-4338-9f05-350f2add1b64 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:03:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-0906ad5d-bc05-4aee-a8ec-19b458f848c8 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:03:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-0906ad5d-bc05-4aee-a8ec-19b458f848c8 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:03:59 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-0906ad5d-bc05-4aee-a8ec-19b458f848c8 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:03:59 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-0906ad5d-bc05-4aee-a8ec-19b458f848c8 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:03:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-0906ad5d-bc05-4aee-a8ec-19b458f848c8 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:03:59 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-0906ad5d-bc05-4aee-a8ec-19b458f848c8 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:03:59 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-0906ad5d-bc05-4aee-a8ec-19b458f848c8 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:03:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0906ad5d-bc05-4aee-a8ec-19b458f848c8 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15030df1-9d63-4338-9f05-350f2add1b64 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:59 devstack sudo[101771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15030df1-9d63-4338-9f05-350f2add1b64 1073741824 Jun 24 05:03:59 devstack sudo[101771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:03:59 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-0918b026-4d44-4b53-8277-8ef1dea5991e tempest-VolumesActionsTest-153948387 None] Acquiring lock "cinder-f2dc5bd4-967b-467a-9c3c-dc937f2cdaba-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:03:59 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-0918b026-4d44-4b53-8277-8ef1dea5991e tempest-VolumesActionsTest-153948387 None] Lock "cinder-f2dc5bd4-967b-467a-9c3c-dc937f2cdaba-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:03:59 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-0918b026-4d44-4b53-8277-8ef1dea5991e tempest-VolumesActionsTest-153948387 None] Acquiring lock "cinder-quobyte-f2dc5bd4-967b-467a-9c3c-dc937f2cdaba" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:03:59 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-0918b026-4d44-4b53-8277-8ef1dea5991e tempest-VolumesActionsTest-153948387 None] Lock "cinder-quobyte-f2dc5bd4-967b-467a-9c3c-dc937f2cdaba" acquired by "delete_volume" :: waited 0.015s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:03:59 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[9401b440-3ede-429c-a789-6395b3a49dda]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:03:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0918b026-4d44-4b53-8277-8ef1dea5991e tempest-VolumesActionsTest-153948387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f2dc5bd4-967b-467a-9c3c-dc937f2cdaba {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:03:59 devstack sudo[101774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f2dc5bd4-967b-467a-9c3c-dc937f2cdaba Jun 24 05:03:59 devstack sudo[101774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:00 devstack sudo[101771]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0906ad5d-bc05-4aee-a8ec-19b458f848c8 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15030df1-9d63-4338-9f05-350f2add1b64 1073741824" returned: 0 in 1.383s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0906ad5d-bc05-4aee-a8ec-19b458f848c8 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15030df1-9d63-4338-9f05-350f2add1b64 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:00 devstack sudo[102097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15030df1-9d63-4338-9f05-350f2add1b64 Jun 24 05:04:00 devstack sudo[102097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:00 devstack sudo[101774]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0918b026-4d44-4b53-8277-8ef1dea5991e tempest-VolumesActionsTest-153948387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f2dc5bd4-967b-467a-9c3c-dc937f2cdaba" returned: 0 in 1.120s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0918b026-4d44-4b53-8277-8ef1dea5991e tempest-VolumesActionsTest-153948387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f2dc5bd4-967b-467a-9c3c-dc937f2cdaba {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:01 devstack sudo[102103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f2dc5bd4-967b-467a-9c3c-dc937f2cdaba Jun 24 05:04:01 devstack sudo[102103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:01 devstack sudo[102097]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0906ad5d-bc05-4aee-a8ec-19b458f848c8 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15030df1-9d63-4338-9f05-350f2add1b64" returned: 0 in 1.008s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:01 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-0906ad5d-bc05-4aee-a8ec-19b458f848c8 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] <== create_volume: return (2489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:04:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-0906ad5d-bc05-4aee-a8ec-19b458f848c8 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.492s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:04:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-0906ad5d-bc05-4aee-a8ec-19b458f848c8 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c420f3f4-6a57-4501-8a3f-def4cf2f08dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15030df1-9d63-4338-9f05-350f2add1b64', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-0906ad5d-bc05-4aee-a8ec-19b458f848c8 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (977cca14-caf6-4dac-a566-42002c02739a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:01 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-0906ad5d-bc05-4aee-a8ec-19b458f848c8 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Volume volume-15030df1-9d63-4338-9f05-350f2add1b64 (15030df1-9d63-4338-9f05-350f2add1b64): created successfully Jun 24 05:04:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-0906ad5d-bc05-4aee-a8ec-19b458f848c8 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (977cca14-caf6-4dac-a566-42002c02739a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-0906ad5d-bc05-4aee-a8ec-19b458f848c8 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Flow 'volume_create_manager' (b917a570-57bc-4ff6-93bf-c87294be04be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:04:01 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-0906ad5d-bc05-4aee-a8ec-19b458f848c8 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Created volume successfully. Jun 24 05:04:02 devstack sudo[102103]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0918b026-4d44-4b53-8277-8ef1dea5991e tempest-VolumesActionsTest-153948387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f2dc5bd4-967b-467a-9c3c-dc937f2cdaba" returned: 0 in 1.047s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:02 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-0918b026-4d44-4b53-8277-8ef1dea5991e tempest-VolumesActionsTest-153948387 None] Lock "cinder-quobyte-f2dc5bd4-967b-467a-9c3c-dc937f2cdaba" released by "delete_volume" :: held 2.226s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:04:02 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-0918b026-4d44-4b53-8277-8ef1dea5991e tempest-VolumesActionsTest-153948387 None] Created reservations ['0803caae-b37d-4354-9d98-2e4eae7ad192', '940bd409-d64d-43c7-a8aa-c495389a8558', '2bb1e5d5-68f5-4da2-8bb4-5e4d46162e85', 'bbd61d9f-8794-4e73-8a28-5c5a6e73d567'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:04:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-0918b026-4d44-4b53-8277-8ef1dea5991e tempest-VolumesActionsTest-153948387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:04:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-0918b026-4d44-4b53-8277-8ef1dea5991e tempest-VolumesActionsTest-153948387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:04:02 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-0918b026-4d44-4b53-8277-8ef1dea5991e tempest-VolumesActionsTest-153948387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:04:02 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-0918b026-4d44-4b53-8277-8ef1dea5991e tempest-VolumesActionsTest-153948387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:04:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-0918b026-4d44-4b53-8277-8ef1dea5991e tempest-VolumesActionsTest-153948387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:04:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0918b026-4d44-4b53-8277-8ef1dea5991e tempest-VolumesActionsTest-153948387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:02 devstack sudo[102149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:04:02 devstack sudo[102149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:03 devstack sudo[102149]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0918b026-4d44-4b53-8277-8ef1dea5991e tempest-VolumesActionsTest-153948387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 1.308s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:03 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-0918b026-4d44-4b53-8277-8ef1dea5991e tempest-VolumesActionsTest-153948387 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:04:03 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-0918b026-4d44-4b53-8277-8ef1dea5991e tempest-VolumesActionsTest-153948387 None] Deleted volume successfully. Jun 24 05:04:03 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-0918b026-4d44-4b53-8277-8ef1dea5991e tempest-VolumesActionsTest-153948387 None] Lock "cinder-f2dc5bd4-967b-467a-9c3c-dc937f2cdaba-delete_volume" released by "delete_volume" :: held 4.026s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:04:04 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-93b5f0e1-36a8-48e4-8717-7ce51e5f9f31 tempest-VolumesActionsTest-907220492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:04:04 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-93b5f0e1-36a8-48e4-8717-7ce51e5f9f31 tempest-VolumesActionsTest-907220492 None] Flow 'volume_create_manager' (9dbea976-8ef6-44a6-af86-3bf906be3476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:04:04 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-93b5f0e1-36a8-48e4-8717-7ce51e5f9f31 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6413ff18-0db7-4f99-aa9c-51d9ffbca2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:04 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-93b5f0e1-36a8-48e4-8717-7ce51e5f9f31 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6413ff18-0db7-4f99-aa9c-51d9ffbca2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-764359813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6387ffeb-4cff-40ad-a2f6-8cee5f99dc6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbc22c9540fe4ac6bd7eb8cecc36ece1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:04:04Z,use_quota=True,user_id='f283f1650ffc455d93ae36e9340de4be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:04 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-93b5f0e1-36a8-48e4-8717-7ce51e5f9f31 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28756c44-45c2-4cab-acfc-a868d392e044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:04 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-93b5f0e1-36a8-48e4-8717-7ce51e5f9f31 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28756c44-45c2-4cab-acfc-a868d392e044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:04 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-93b5f0e1-36a8-48e4-8717-7ce51e5f9f31 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ee32d1e-dfd7-4e11-9eb5-0b84ac749023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:04 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-93b5f0e1-36a8-48e4-8717-7ce51e5f9f31 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ee32d1e-dfd7-4e11-9eb5-0b84ac749023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6387ffeb-4cff-40ad-a2f6-8cee5f99dc6c', 'volume_name': 'volume-6387ffeb-4cff-40ad-a2f6-8cee5f99dc6c', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:04 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-93b5f0e1-36a8-48e4-8717-7ce51e5f9f31 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81dd5558-a601-4114-9857-2902eeef5ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:04 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-93b5f0e1-36a8-48e4-8717-7ce51e5f9f31 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81dd5558-a601-4114-9857-2902eeef5ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:04 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-93b5f0e1-36a8-48e4-8717-7ce51e5f9f31 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82b03943-2edd-4491-afaf-def469aa43e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:04 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-93b5f0e1-36a8-48e4-8717-7ce51e5f9f31 tempest-VolumesActionsTest-907220492 None] Volume 6387ffeb-4cff-40ad-a2f6-8cee5f99dc6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6387ffeb-4cff-40ad-a2f6-8cee5f99dc6c', 'volume_size': 1} Jun 24 05:04:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-93b5f0e1-36a8-48e4-8717-7ce51e5f9f31 tempest-VolumesActionsTest-907220492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:04:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-93b5f0e1-36a8-48e4-8717-7ce51e5f9f31 tempest-VolumesActionsTest-907220492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:04:04 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-93b5f0e1-36a8-48e4-8717-7ce51e5f9f31 tempest-VolumesActionsTest-907220492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-764359813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6387ffeb-4cff-40ad-a2f6-8cee5f99dc6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbc22c9540fe4ac6bd7eb8cecc36ece1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:04:04Z,use_quota=True,user_id='f283f1650ffc455d93ae36e9340de4be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:04:04 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-93b5f0e1-36a8-48e4-8717-7ce51e5f9f31 tempest-VolumesActionsTest-907220492 None] Creating volume 6387ffeb-4cff-40ad-a2f6-8cee5f99dc6c {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:04:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-93b5f0e1-36a8-48e4-8717-7ce51e5f9f31 tempest-VolumesActionsTest-907220492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:04:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-93b5f0e1-36a8-48e4-8717-7ce51e5f9f31 tempest-VolumesActionsTest-907220492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:04:04 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-93b5f0e1-36a8-48e4-8717-7ce51e5f9f31 tempest-VolumesActionsTest-907220492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:04:04 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-93b5f0e1-36a8-48e4-8717-7ce51e5f9f31 tempest-VolumesActionsTest-907220492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:04:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-93b5f0e1-36a8-48e4-8717-7ce51e5f9f31 tempest-VolumesActionsTest-907220492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:04:04 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-93b5f0e1-36a8-48e4-8717-7ce51e5f9f31 tempest-VolumesActionsTest-907220492 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:04:04 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-93b5f0e1-36a8-48e4-8717-7ce51e5f9f31 tempest-VolumesActionsTest-907220492 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:04:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-93b5f0e1-36a8-48e4-8717-7ce51e5f9f31 tempest-VolumesActionsTest-907220492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6387ffeb-4cff-40ad-a2f6-8cee5f99dc6c 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:04 devstack sudo[102171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6387ffeb-4cff-40ad-a2f6-8cee5f99dc6c 1073741824 Jun 24 05:04:04 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:04 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e1981491-5f73-4341-8d72-e5a21bba6a66 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Acquiring lock "cinder-15030df1-9d63-4338-9f05-350f2add1b64-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:04:04 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e1981491-5f73-4341-8d72-e5a21bba6a66 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Lock "cinder-15030df1-9d63-4338-9f05-350f2add1b64-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:04:04 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e1981491-5f73-4341-8d72-e5a21bba6a66 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Acquiring lock "cinder-quobyte-15030df1-9d63-4338-9f05-350f2add1b64" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:04:05 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e1981491-5f73-4341-8d72-e5a21bba6a66 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Lock "cinder-quobyte-15030df1-9d63-4338-9f05-350f2add1b64" acquired by "delete_volume" :: waited 0.027s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:04:05 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[51466521-9b33-4a49-8eee-90c53888890a]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:04:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e1981491-5f73-4341-8d72-e5a21bba6a66 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15030df1-9d63-4338-9f05-350f2add1b64 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:05 devstack sudo[102173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15030df1-9d63-4338-9f05-350f2add1b64 Jun 24 05:04:05 devstack sudo[102173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:05 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-93b5f0e1-36a8-48e4-8717-7ce51e5f9f31 tempest-VolumesActionsTest-907220492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6387ffeb-4cff-40ad-a2f6-8cee5f99dc6c 1073741824" returned: 0 in 1.374s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-93b5f0e1-36a8-48e4-8717-7ce51e5f9f31 tempest-VolumesActionsTest-907220492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6387ffeb-4cff-40ad-a2f6-8cee5f99dc6c {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:05 devstack sudo[102179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6387ffeb-4cff-40ad-a2f6-8cee5f99dc6c Jun 24 05:04:05 devstack sudo[102179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:06 devstack sudo[102173]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e1981491-5f73-4341-8d72-e5a21bba6a66 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15030df1-9d63-4338-9f05-350f2add1b64" returned: 0 in 1.577s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e1981491-5f73-4341-8d72-e5a21bba6a66 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15030df1-9d63-4338-9f05-350f2add1b64 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:06 devstack sudo[102184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15030df1-9d63-4338-9f05-350f2add1b64 Jun 24 05:04:06 devstack sudo[102184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:07 devstack sudo[102179]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-93b5f0e1-36a8-48e4-8717-7ce51e5f9f31 tempest-VolumesActionsTest-907220492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6387ffeb-4cff-40ad-a2f6-8cee5f99dc6c" returned: 0 in 1.357s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:07 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-93b5f0e1-36a8-48e4-8717-7ce51e5f9f31 tempest-VolumesActionsTest-907220492 None] <== create_volume: return (2815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:04:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-93b5f0e1-36a8-48e4-8717-7ce51e5f9f31 tempest-VolumesActionsTest-907220492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.820s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:04:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-93b5f0e1-36a8-48e4-8717-7ce51e5f9f31 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82b03943-2edd-4491-afaf-def469aa43e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6387ffeb-4cff-40ad-a2f6-8cee5f99dc6c', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-93b5f0e1-36a8-48e4-8717-7ce51e5f9f31 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2675f390-0b32-488f-8c46-adc3a2667a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:07 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-93b5f0e1-36a8-48e4-8717-7ce51e5f9f31 tempest-VolumesActionsTest-907220492 None] Volume volume-6387ffeb-4cff-40ad-a2f6-8cee5f99dc6c (6387ffeb-4cff-40ad-a2f6-8cee5f99dc6c): created successfully Jun 24 05:04:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-93b5f0e1-36a8-48e4-8717-7ce51e5f9f31 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2675f390-0b32-488f-8c46-adc3a2667a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-93b5f0e1-36a8-48e4-8717-7ce51e5f9f31 tempest-VolumesActionsTest-907220492 None] Flow 'volume_create_manager' (9dbea976-8ef6-44a6-af86-3bf906be3476) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:04:07 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-93b5f0e1-36a8-48e4-8717-7ce51e5f9f31 tempest-VolumesActionsTest-907220492 None] Created volume successfully. Jun 24 05:04:07 devstack sudo[102184]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e1981491-5f73-4341-8d72-e5a21bba6a66 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15030df1-9d63-4338-9f05-350f2add1b64" returned: 0 in 0.881s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:07 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e1981491-5f73-4341-8d72-e5a21bba6a66 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Lock "cinder-quobyte-15030df1-9d63-4338-9f05-350f2add1b64" released by "delete_volume" :: held 2.549s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:04:07 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-e1981491-5f73-4341-8d72-e5a21bba6a66 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Created reservations ['944d4a56-675c-44d9-8962-2b856ceae090', '8f0fac74-4375-409a-a074-055eb693976f', 'cf4e10d1-ae31-4c3f-a350-a3e0ef42ca4b', 'c8469772-e873-44a6-9526-e93ced97f836'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:04:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e1981491-5f73-4341-8d72-e5a21bba6a66 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:04:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e1981491-5f73-4341-8d72-e5a21bba6a66 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:04:07 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e1981491-5f73-4341-8d72-e5a21bba6a66 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:04:07 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e1981491-5f73-4341-8d72-e5a21bba6a66 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:04:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e1981491-5f73-4341-8d72-e5a21bba6a66 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:04:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e1981491-5f73-4341-8d72-e5a21bba6a66 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:07 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e0d0deb3-94a7-493a-8b99-365de2dc200d tempest-VolumesActionsTest-153948387 None] Acquiring lock "cinder-6387ffeb-4cff-40ad-a2f6-8cee5f99dc6c-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:04:07 devstack sudo[102188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:04:07 devstack sudo[102188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:07 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e0d0deb3-94a7-493a-8b99-365de2dc200d tempest-VolumesActionsTest-153948387 None] Lock "cinder-6387ffeb-4cff-40ad-a2f6-8cee5f99dc6c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:04:07 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e0d0deb3-94a7-493a-8b99-365de2dc200d tempest-VolumesActionsTest-153948387 None] Acquiring lock "cinder-quobyte-6387ffeb-4cff-40ad-a2f6-8cee5f99dc6c" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:04:07 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e0d0deb3-94a7-493a-8b99-365de2dc200d tempest-VolumesActionsTest-153948387 None] Lock "cinder-quobyte-6387ffeb-4cff-40ad-a2f6-8cee5f99dc6c" acquired by "delete_volume" :: waited 0.025s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:04:07 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[793c73c5-5c04-4f44-967b-29b7c4e6bd2f]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:04:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e0d0deb3-94a7-493a-8b99-365de2dc200d tempest-VolumesActionsTest-153948387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6387ffeb-4cff-40ad-a2f6-8cee5f99dc6c {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:08 devstack sudo[102190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6387ffeb-4cff-40ad-a2f6-8cee5f99dc6c Jun 24 05:04:08 devstack sudo[102190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:08 devstack sudo[102188]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e1981491-5f73-4341-8d72-e5a21bba6a66 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.769s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:08 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-e1981491-5f73-4341-8d72-e5a21bba6a66 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:04:08 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-e1981491-5f73-4341-8d72-e5a21bba6a66 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Deleted volume successfully. Jun 24 05:04:08 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e1981491-5f73-4341-8d72-e5a21bba6a66 tempest-VolumeQuotasNegativeTestJSON-1358269492 None] Lock "cinder-15030df1-9d63-4338-9f05-350f2add1b64-delete_volume" released by "delete_volume" :: held 3.599s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:04:08 devstack sudo[102190]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e0d0deb3-94a7-493a-8b99-365de2dc200d tempest-VolumesActionsTest-153948387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6387ffeb-4cff-40ad-a2f6-8cee5f99dc6c" returned: 0 in 0.996s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e0d0deb3-94a7-493a-8b99-365de2dc200d tempest-VolumesActionsTest-153948387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6387ffeb-4cff-40ad-a2f6-8cee5f99dc6c {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:08 devstack sudo[102196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6387ffeb-4cff-40ad-a2f6-8cee5f99dc6c Jun 24 05:04:08 devstack sudo[102196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:09 devstack sudo[102196]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e0d0deb3-94a7-493a-8b99-365de2dc200d tempest-VolumesActionsTest-153948387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6387ffeb-4cff-40ad-a2f6-8cee5f99dc6c" returned: 0 in 0.802s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:09 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e0d0deb3-94a7-493a-8b99-365de2dc200d tempest-VolumesActionsTest-153948387 None] Lock "cinder-quobyte-6387ffeb-4cff-40ad-a2f6-8cee5f99dc6c" released by "delete_volume" :: held 1.846s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:04:09 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 05:04:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:04:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:04:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:04:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:04:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:04:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:09 devstack sudo[102199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:04:09 devstack sudo[102199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:09 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-e0d0deb3-94a7-493a-8b99-365de2dc200d tempest-VolumesActionsTest-153948387 None] Created reservations ['2d542091-5bba-435b-ae21-1b5fd873db89', '67b95740-91e3-46e9-8178-1c1feeaeb380', '843dd338-0365-4d95-9325-78f1022c4fd5', '0d3db7af-da5d-44d5-b188-09780331a7f2'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:04:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e0d0deb3-94a7-493a-8b99-365de2dc200d tempest-VolumesActionsTest-153948387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:04:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e0d0deb3-94a7-493a-8b99-365de2dc200d tempest-VolumesActionsTest-153948387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:04:10 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e0d0deb3-94a7-493a-8b99-365de2dc200d tempest-VolumesActionsTest-153948387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:04:10 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e0d0deb3-94a7-493a-8b99-365de2dc200d tempest-VolumesActionsTest-153948387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:04:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e0d0deb3-94a7-493a-8b99-365de2dc200d tempest-VolumesActionsTest-153948387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:04:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e0d0deb3-94a7-493a-8b99-365de2dc200d tempest-VolumesActionsTest-153948387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:10 devstack sudo[102202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:04:10 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:11 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e0d0deb3-94a7-493a-8b99-365de2dc200d tempest-VolumesActionsTest-153948387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 1.028s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:11 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-e0d0deb3-94a7-493a-8b99-365de2dc200d tempest-VolumesActionsTest-153948387 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:04:11 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-e0d0deb3-94a7-493a-8b99-365de2dc200d tempest-VolumesActionsTest-153948387 None] Deleted volume successfully. Jun 24 05:04:11 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e0d0deb3-94a7-493a-8b99-365de2dc200d tempest-VolumesActionsTest-153948387 None] Lock "cinder-6387ffeb-4cff-40ad-a2f6-8cee5f99dc6c-delete_volume" released by "delete_volume" :: held 3.338s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:04:11 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-d685b92d-cc4e-4a46-b101-9b3334ce0149 tempest-VolumesActionsTest-907220492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:04:11 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d685b92d-cc4e-4a46-b101-9b3334ce0149 tempest-VolumesActionsTest-907220492 None] Flow 'volume_create_manager' (0cbdc310-b012-4a19-a335-520c3002eda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:04:11 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d685b92d-cc4e-4a46-b101-9b3334ce0149 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e937b469-a4dc-4d55-a2c7-0dd6ecf3ac19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:11 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d685b92d-cc4e-4a46-b101-9b3334ce0149 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e937b469-a4dc-4d55-a2c7-0dd6ecf3ac19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:04:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1748807291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a149dc42-0c9d-4d46-a51d-950a96d1b4e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbc22c9540fe4ac6bd7eb8cecc36ece1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:04:11Z,use_quota=True,user_id='f283f1650ffc455d93ae36e9340de4be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:11 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d685b92d-cc4e-4a46-b101-9b3334ce0149 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c39c395-dc4b-4f67-9ff7-d40df8bb5d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:11 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d685b92d-cc4e-4a46-b101-9b3334ce0149 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c39c395-dc4b-4f67-9ff7-d40df8bb5d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:11 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d685b92d-cc4e-4a46-b101-9b3334ce0149 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d896557b-3da2-4138-bd3a-cf62ebd1b08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:11 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d685b92d-cc4e-4a46-b101-9b3334ce0149 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d896557b-3da2-4138-bd3a-cf62ebd1b08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a149dc42-0c9d-4d46-a51d-950a96d1b4e1', 'volume_name': 'volume-a149dc42-0c9d-4d46-a51d-950a96d1b4e1', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:11 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d685b92d-cc4e-4a46-b101-9b3334ce0149 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06ea3619-a77c-4a2f-95c4-a6bae7ff7c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:11 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d685b92d-cc4e-4a46-b101-9b3334ce0149 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06ea3619-a77c-4a2f-95c4-a6bae7ff7c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:11 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d685b92d-cc4e-4a46-b101-9b3334ce0149 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (269a9041-2df7-4cf1-81b7-1e1e21d6f604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:11 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-d685b92d-cc4e-4a46-b101-9b3334ce0149 tempest-VolumesActionsTest-907220492 None] Volume a149dc42-0c9d-4d46-a51d-950a96d1b4e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a149dc42-0c9d-4d46-a51d-950a96d1b4e1', 'volume_size': 1} Jun 24 05:04:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-d685b92d-cc4e-4a46-b101-9b3334ce0149 tempest-VolumesActionsTest-907220492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:04:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-d685b92d-cc4e-4a46-b101-9b3334ce0149 tempest-VolumesActionsTest-907220492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:04:11 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-d685b92d-cc4e-4a46-b101-9b3334ce0149 tempest-VolumesActionsTest-907220492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:04:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1748807291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a149dc42-0c9d-4d46-a51d-950a96d1b4e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbc22c9540fe4ac6bd7eb8cecc36ece1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:04:11Z,use_quota=True,user_id='f283f1650ffc455d93ae36e9340de4be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:04:11 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-d685b92d-cc4e-4a46-b101-9b3334ce0149 tempest-VolumesActionsTest-907220492 None] Creating volume a149dc42-0c9d-4d46-a51d-950a96d1b4e1 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:04:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-d685b92d-cc4e-4a46-b101-9b3334ce0149 tempest-VolumesActionsTest-907220492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:04:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-d685b92d-cc4e-4a46-b101-9b3334ce0149 tempest-VolumesActionsTest-907220492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:04:11 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-d685b92d-cc4e-4a46-b101-9b3334ce0149 tempest-VolumesActionsTest-907220492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:04:11 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-d685b92d-cc4e-4a46-b101-9b3334ce0149 tempest-VolumesActionsTest-907220492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:04:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-d685b92d-cc4e-4a46-b101-9b3334ce0149 tempest-VolumesActionsTest-907220492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:04:11 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-d685b92d-cc4e-4a46-b101-9b3334ce0149 tempest-VolumesActionsTest-907220492 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:04:11 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-d685b92d-cc4e-4a46-b101-9b3334ce0149 tempest-VolumesActionsTest-907220492 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:04:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d685b92d-cc4e-4a46-b101-9b3334ce0149 tempest-VolumesActionsTest-907220492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a149dc42-0c9d-4d46-a51d-950a96d1b4e1 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:11 devstack sudo[102206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a149dc42-0c9d-4d46-a51d-950a96d1b4e1 1073741824 Jun 24 05:04:11 devstack sudo[102206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:11 devstack sudo[102199]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 1.816s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:11 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:04:11 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager._thread_info {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 05:04:11 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread count: 8 {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 05:04:11 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread info: [<_MainThread(MainThread, started 130211312517248)>, , , , , , , ] {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 05:04:12 devstack sudo[102206]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d685b92d-cc4e-4a46-b101-9b3334ce0149 tempest-VolumesActionsTest-907220492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a149dc42-0c9d-4d46-a51d-950a96d1b4e1 1073741824" returned: 0 in 1.576s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d685b92d-cc4e-4a46-b101-9b3334ce0149 tempest-VolumesActionsTest-907220492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a149dc42-0c9d-4d46-a51d-950a96d1b4e1 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:13 devstack sudo[102211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a149dc42-0c9d-4d46-a51d-950a96d1b4e1 Jun 24 05:04:13 devstack sudo[102211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:13 devstack sudo[102211]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d685b92d-cc4e-4a46-b101-9b3334ce0149 tempest-VolumesActionsTest-907220492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a149dc42-0c9d-4d46-a51d-950a96d1b4e1" returned: 0 in 0.994s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:13 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-d685b92d-cc4e-4a46-b101-9b3334ce0149 tempest-VolumesActionsTest-907220492 None] <== create_volume: return (2636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:04:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-d685b92d-cc4e-4a46-b101-9b3334ce0149 tempest-VolumesActionsTest-907220492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.638s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:04:14 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d685b92d-cc4e-4a46-b101-9b3334ce0149 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (269a9041-2df7-4cf1-81b7-1e1e21d6f604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a149dc42-0c9d-4d46-a51d-950a96d1b4e1', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:14 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d685b92d-cc4e-4a46-b101-9b3334ce0149 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eadfb867-2003-4751-b88d-3bab59c69008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:14 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-d685b92d-cc4e-4a46-b101-9b3334ce0149 tempest-VolumesActionsTest-907220492 None] Volume volume-a149dc42-0c9d-4d46-a51d-950a96d1b4e1 (a149dc42-0c9d-4d46-a51d-950a96d1b4e1): created successfully Jun 24 05:04:14 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d685b92d-cc4e-4a46-b101-9b3334ce0149 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eadfb867-2003-4751-b88d-3bab59c69008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:14 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d685b92d-cc4e-4a46-b101-9b3334ce0149 tempest-VolumesActionsTest-907220492 None] Flow 'volume_create_manager' (0cbdc310-b012-4a19-a335-520c3002eda9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:04:14 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-d685b92d-cc4e-4a46-b101-9b3334ce0149 tempest-VolumesActionsTest-907220492 None] Created volume successfully. Jun 24 05:04:15 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-ea5e8388-d988-40e7-b0fc-801ba460d954 tempest-VolumesActionsTest-153948387 None] Acquiring lock "cinder-a149dc42-0c9d-4d46-a51d-950a96d1b4e1-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:04:15 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-ea5e8388-d988-40e7-b0fc-801ba460d954 tempest-VolumesActionsTest-153948387 None] Lock "cinder-a149dc42-0c9d-4d46-a51d-950a96d1b4e1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:04:15 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-ea5e8388-d988-40e7-b0fc-801ba460d954 tempest-VolumesActionsTest-153948387 None] Acquiring lock "cinder-quobyte-a149dc42-0c9d-4d46-a51d-950a96d1b4e1" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:04:15 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-ea5e8388-d988-40e7-b0fc-801ba460d954 tempest-VolumesActionsTest-153948387 None] Lock "cinder-quobyte-a149dc42-0c9d-4d46-a51d-950a96d1b4e1" acquired by "delete_volume" :: waited 0.032s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:04:15 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[9164ecfe-2039-45af-bcc7-b25a608dfab3]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:04:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ea5e8388-d988-40e7-b0fc-801ba460d954 tempest-VolumesActionsTest-153948387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a149dc42-0c9d-4d46-a51d-950a96d1b4e1 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:15 devstack sudo[102216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a149dc42-0c9d-4d46-a51d-950a96d1b4e1 Jun 24 05:04:15 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:16 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ea5e8388-d988-40e7-b0fc-801ba460d954 tempest-VolumesActionsTest-153948387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a149dc42-0c9d-4d46-a51d-950a96d1b4e1" returned: 0 in 1.155s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ea5e8388-d988-40e7-b0fc-801ba460d954 tempest-VolumesActionsTest-153948387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a149dc42-0c9d-4d46-a51d-950a96d1b4e1 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:16 devstack sudo[102241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a149dc42-0c9d-4d46-a51d-950a96d1b4e1 Jun 24 05:04:16 devstack sudo[102241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:17 devstack sudo[102241]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ea5e8388-d988-40e7-b0fc-801ba460d954 tempest-VolumesActionsTest-153948387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a149dc42-0c9d-4d46-a51d-950a96d1b4e1" returned: 0 in 0.925s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:17 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-ea5e8388-d988-40e7-b0fc-801ba460d954 tempest-VolumesActionsTest-153948387 None] Lock "cinder-quobyte-a149dc42-0c9d-4d46-a51d-950a96d1b4e1" released by "delete_volume" :: held 2.153s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:04:17 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-ea5e8388-d988-40e7-b0fc-801ba460d954 tempest-VolumesActionsTest-153948387 None] Created reservations ['cd0f996d-30d1-4cf6-8f10-c262b406b706', 'ac7bf75e-1ca6-4623-99fe-574438518f96', 'd5e05f66-4348-43ee-950a-542a6ecbc2d4', 'cb0b2122-c9ed-400c-beac-563e658bb879'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:04:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-ea5e8388-d988-40e7-b0fc-801ba460d954 tempest-VolumesActionsTest-153948387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:04:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-ea5e8388-d988-40e7-b0fc-801ba460d954 tempest-VolumesActionsTest-153948387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:04:17 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-ea5e8388-d988-40e7-b0fc-801ba460d954 tempest-VolumesActionsTest-153948387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:04:17 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-ea5e8388-d988-40e7-b0fc-801ba460d954 tempest-VolumesActionsTest-153948387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:04:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-ea5e8388-d988-40e7-b0fc-801ba460d954 tempest-VolumesActionsTest-153948387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:04:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ea5e8388-d988-40e7-b0fc-801ba460d954 tempest-VolumesActionsTest-153948387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:17 devstack sudo[102244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:04:17 devstack sudo[102244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:18 devstack sudo[102244]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ea5e8388-d988-40e7-b0fc-801ba460d954 tempest-VolumesActionsTest-153948387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.850s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:18 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-ea5e8388-d988-40e7-b0fc-801ba460d954 tempest-VolumesActionsTest-153948387 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:04:18 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-ea5e8388-d988-40e7-b0fc-801ba460d954 tempest-VolumesActionsTest-153948387 None] Deleted volume successfully. Jun 24 05:04:18 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-ea5e8388-d988-40e7-b0fc-801ba460d954 tempest-VolumesActionsTest-153948387 None] Lock "cinder-a149dc42-0c9d-4d46-a51d-950a96d1b4e1-delete_volume" released by "delete_volume" :: held 3.353s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:04:19 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcc8e37b-5361-4f57-a7eb-4e026bdaf382 tempest-VolumesActionsTest-907220492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:04:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-bcc8e37b-5361-4f57-a7eb-4e026bdaf382 tempest-VolumesActionsTest-907220492 None] Flow 'volume_create_manager' (768326de-307f-4d91-ba86-1cf3934965df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:04:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-bcc8e37b-5361-4f57-a7eb-4e026bdaf382 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56f1cff5-652d-4af5-ab98-8b8c31fca734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-bcc8e37b-5361-4f57-a7eb-4e026bdaf382 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56f1cff5-652d-4af5-ab98-8b8c31fca734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1747832647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b1b6343-0bb7-4f4d-837f-4d9ba2870881,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbc22c9540fe4ac6bd7eb8cecc36ece1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:04:19Z,use_quota=True,user_id='f283f1650ffc455d93ae36e9340de4be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-bcc8e37b-5361-4f57-a7eb-4e026bdaf382 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9abe3b8-6bf3-424e-9a1f-bd1e89400de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-bcc8e37b-5361-4f57-a7eb-4e026bdaf382 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9abe3b8-6bf3-424e-9a1f-bd1e89400de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-bcc8e37b-5361-4f57-a7eb-4e026bdaf382 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42f9173a-4201-4a8b-a439-00e5a572b9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-bcc8e37b-5361-4f57-a7eb-4e026bdaf382 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42f9173a-4201-4a8b-a439-00e5a572b9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b1b6343-0bb7-4f4d-837f-4d9ba2870881', 'volume_name': 'volume-9b1b6343-0bb7-4f4d-837f-4d9ba2870881', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-bcc8e37b-5361-4f57-a7eb-4e026bdaf382 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27845e21-69f3-4379-8550-44cf9bc56531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-bcc8e37b-5361-4f57-a7eb-4e026bdaf382 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27845e21-69f3-4379-8550-44cf9bc56531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-bcc8e37b-5361-4f57-a7eb-4e026bdaf382 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (164c89d7-037b-4336-948b-4262230ea5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:19 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-bcc8e37b-5361-4f57-a7eb-4e026bdaf382 tempest-VolumesActionsTest-907220492 None] Volume 9b1b6343-0bb7-4f4d-837f-4d9ba2870881: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b1b6343-0bb7-4f4d-837f-4d9ba2870881', 'volume_size': 1} Jun 24 05:04:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-bcc8e37b-5361-4f57-a7eb-4e026bdaf382 tempest-VolumesActionsTest-907220492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:04:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-bcc8e37b-5361-4f57-a7eb-4e026bdaf382 tempest-VolumesActionsTest-907220492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:04:19 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-bcc8e37b-5361-4f57-a7eb-4e026bdaf382 tempest-VolumesActionsTest-907220492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1747832647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b1b6343-0bb7-4f4d-837f-4d9ba2870881,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbc22c9540fe4ac6bd7eb8cecc36ece1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:04:19Z,use_quota=True,user_id='f283f1650ffc455d93ae36e9340de4be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:04:19 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-bcc8e37b-5361-4f57-a7eb-4e026bdaf382 tempest-VolumesActionsTest-907220492 None] Creating volume 9b1b6343-0bb7-4f4d-837f-4d9ba2870881 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:04:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-bcc8e37b-5361-4f57-a7eb-4e026bdaf382 tempest-VolumesActionsTest-907220492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:04:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-bcc8e37b-5361-4f57-a7eb-4e026bdaf382 tempest-VolumesActionsTest-907220492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:04:19 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-bcc8e37b-5361-4f57-a7eb-4e026bdaf382 tempest-VolumesActionsTest-907220492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:04:19 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-bcc8e37b-5361-4f57-a7eb-4e026bdaf382 tempest-VolumesActionsTest-907220492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:04:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-bcc8e37b-5361-4f57-a7eb-4e026bdaf382 tempest-VolumesActionsTest-907220492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:04:19 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-bcc8e37b-5361-4f57-a7eb-4e026bdaf382 tempest-VolumesActionsTest-907220492 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:04:19 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-bcc8e37b-5361-4f57-a7eb-4e026bdaf382 tempest-VolumesActionsTest-907220492 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:04:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-bcc8e37b-5361-4f57-a7eb-4e026bdaf382 tempest-VolumesActionsTest-907220492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9b1b6343-0bb7-4f4d-837f-4d9ba2870881 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:19 devstack sudo[102271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9b1b6343-0bb7-4f4d-837f-4d9ba2870881 1073741824 Jun 24 05:04:19 devstack sudo[102271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:20 devstack sudo[102271]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-bcc8e37b-5361-4f57-a7eb-4e026bdaf382 tempest-VolumesActionsTest-907220492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9b1b6343-0bb7-4f4d-837f-4d9ba2870881 1073741824" returned: 0 in 1.022s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-bcc8e37b-5361-4f57-a7eb-4e026bdaf382 tempest-VolumesActionsTest-907220492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9b1b6343-0bb7-4f4d-837f-4d9ba2870881 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:20 devstack sudo[102278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9b1b6343-0bb7-4f4d-837f-4d9ba2870881 Jun 24 05:04:20 devstack sudo[102278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:21 devstack sudo[102278]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-bcc8e37b-5361-4f57-a7eb-4e026bdaf382 tempest-VolumesActionsTest-907220492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9b1b6343-0bb7-4f4d-837f-4d9ba2870881" returned: 0 in 0.712s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:21 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-bcc8e37b-5361-4f57-a7eb-4e026bdaf382 tempest-VolumesActionsTest-907220492 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:04:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-bcc8e37b-5361-4f57-a7eb-4e026bdaf382 tempest-VolumesActionsTest-907220492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.798s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:04:21 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-bcc8e37b-5361-4f57-a7eb-4e026bdaf382 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (164c89d7-037b-4336-948b-4262230ea5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b1b6343-0bb7-4f4d-837f-4d9ba2870881', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:21 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-bcc8e37b-5361-4f57-a7eb-4e026bdaf382 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50da0575-fd3e-4cda-a312-dc9d84f3cdb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:21 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-bcc8e37b-5361-4f57-a7eb-4e026bdaf382 tempest-VolumesActionsTest-907220492 None] Volume volume-9b1b6343-0bb7-4f4d-837f-4d9ba2870881 (9b1b6343-0bb7-4f4d-837f-4d9ba2870881): created successfully Jun 24 05:04:21 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-bcc8e37b-5361-4f57-a7eb-4e026bdaf382 tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50da0575-fd3e-4cda-a312-dc9d84f3cdb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:21 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-bcc8e37b-5361-4f57-a7eb-4e026bdaf382 tempest-VolumesActionsTest-907220492 None] Flow 'volume_create_manager' (768326de-307f-4d91-ba86-1cf3934965df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:04:21 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-bcc8e37b-5361-4f57-a7eb-4e026bdaf382 tempest-VolumesActionsTest-907220492 None] Created volume successfully. Jun 24 05:04:21 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e262e847-06af-4cc5-a111-0b010817713a tempest-VolumesActionsTest-153948387 None] Acquiring lock "cinder-9b1b6343-0bb7-4f4d-837f-4d9ba2870881-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:04:21 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e262e847-06af-4cc5-a111-0b010817713a tempest-VolumesActionsTest-153948387 None] Lock "cinder-9b1b6343-0bb7-4f4d-837f-4d9ba2870881-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:04:21 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e262e847-06af-4cc5-a111-0b010817713a tempest-VolumesActionsTest-153948387 None] Acquiring lock "cinder-quobyte-9b1b6343-0bb7-4f4d-837f-4d9ba2870881" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:04:21 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e262e847-06af-4cc5-a111-0b010817713a tempest-VolumesActionsTest-153948387 None] Lock "cinder-quobyte-9b1b6343-0bb7-4f4d-837f-4d9ba2870881" acquired by "delete_volume" :: waited 0.018s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:04:21 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0fc64c-7c97-4c9c-aefd-e875d8478a64]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:04:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e262e847-06af-4cc5-a111-0b010817713a tempest-VolumesActionsTest-153948387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9b1b6343-0bb7-4f4d-837f-4d9ba2870881 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:21 devstack sudo[102281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9b1b6343-0bb7-4f4d-837f-4d9ba2870881 Jun 24 05:04:21 devstack sudo[102281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:22 devstack sudo[102281]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e262e847-06af-4cc5-a111-0b010817713a tempest-VolumesActionsTest-153948387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9b1b6343-0bb7-4f4d-837f-4d9ba2870881" returned: 0 in 0.823s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e262e847-06af-4cc5-a111-0b010817713a tempest-VolumesActionsTest-153948387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9b1b6343-0bb7-4f4d-837f-4d9ba2870881 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:22 devstack sudo[102287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9b1b6343-0bb7-4f4d-837f-4d9ba2870881 Jun 24 05:04:22 devstack sudo[102287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:23 devstack sudo[102287]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e262e847-06af-4cc5-a111-0b010817713a tempest-VolumesActionsTest-153948387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9b1b6343-0bb7-4f4d-837f-4d9ba2870881" returned: 0 in 0.769s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:23 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e262e847-06af-4cc5-a111-0b010817713a tempest-VolumesActionsTest-153948387 None] Lock "cinder-quobyte-9b1b6343-0bb7-4f4d-837f-4d9ba2870881" released by "delete_volume" :: held 1.643s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:04:23 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-e262e847-06af-4cc5-a111-0b010817713a tempest-VolumesActionsTest-153948387 None] Created reservations ['e81e2fa3-fe35-43a6-8afe-6bfbc80f10c4', '8901087e-60f3-497e-a60d-9309af3608be', '2e404da3-a6c6-4ac5-8bb1-6f18b3fbc2f1', 'b6216837-36b0-43bf-8144-97d4cf698973'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:04:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e262e847-06af-4cc5-a111-0b010817713a tempest-VolumesActionsTest-153948387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:04:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e262e847-06af-4cc5-a111-0b010817713a tempest-VolumesActionsTest-153948387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:04:23 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e262e847-06af-4cc5-a111-0b010817713a tempest-VolumesActionsTest-153948387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:04:23 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e262e847-06af-4cc5-a111-0b010817713a tempest-VolumesActionsTest-153948387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:04:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e262e847-06af-4cc5-a111-0b010817713a tempest-VolumesActionsTest-153948387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:04:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e262e847-06af-4cc5-a111-0b010817713a tempest-VolumesActionsTest-153948387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:23 devstack sudo[102295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:04:23 devstack sudo[102295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:24 devstack sudo[102295]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e262e847-06af-4cc5-a111-0b010817713a tempest-VolumesActionsTest-153948387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.754s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:24 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-e262e847-06af-4cc5-a111-0b010817713a tempest-VolumesActionsTest-153948387 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:04:24 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-e262e847-06af-4cc5-a111-0b010817713a tempest-VolumesActionsTest-153948387 None] Deleted volume successfully. Jun 24 05:04:24 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e262e847-06af-4cc5-a111-0b010817713a tempest-VolumesActionsTest-153948387 None] Lock "cinder-9b1b6343-0bb7-4f4d-837f-4d9ba2870881-delete_volume" released by "delete_volume" :: held 2.640s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:04:24 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a6312db-750b-4a8d-ae6d-2bb3cb056dae tempest-VolumesActionsTest-907220492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:04:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9a6312db-750b-4a8d-ae6d-2bb3cb056dae tempest-VolumesActionsTest-907220492 None] Flow 'volume_create_manager' (e0739eac-da22-451b-9109-92a693ccd7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:04:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9a6312db-750b-4a8d-ae6d-2bb3cb056dae tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (228322d2-fbc1-45bb-acef-52338e085ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9a6312db-750b-4a8d-ae6d-2bb3cb056dae tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (228322d2-fbc1-45bb-acef-52338e085ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:04:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-565885185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd28bd41-827c-4897-9e97-aff1be2be354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbc22c9540fe4ac6bd7eb8cecc36ece1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:04:25Z,use_quota=True,user_id='f283f1650ffc455d93ae36e9340de4be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9a6312db-750b-4a8d-ae6d-2bb3cb056dae tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (841d3a3e-1515-4378-98d1-7a36a88f1acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9a6312db-750b-4a8d-ae6d-2bb3cb056dae tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (841d3a3e-1515-4378-98d1-7a36a88f1acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9a6312db-750b-4a8d-ae6d-2bb3cb056dae tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e0e2635-8c70-46e2-a2ab-e14513ed6e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9a6312db-750b-4a8d-ae6d-2bb3cb056dae tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e0e2635-8c70-46e2-a2ab-e14513ed6e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd28bd41-827c-4897-9e97-aff1be2be354', 'volume_name': 'volume-cd28bd41-827c-4897-9e97-aff1be2be354', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9a6312db-750b-4a8d-ae6d-2bb3cb056dae tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01536d27-7d94-458c-928f-60f1fcc9277a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9a6312db-750b-4a8d-ae6d-2bb3cb056dae tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01536d27-7d94-458c-928f-60f1fcc9277a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9a6312db-750b-4a8d-ae6d-2bb3cb056dae tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eeb4897-4639-478c-b388-eb7ca2eb65dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:24 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-9a6312db-750b-4a8d-ae6d-2bb3cb056dae tempest-VolumesActionsTest-907220492 None] Volume cd28bd41-827c-4897-9e97-aff1be2be354: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd28bd41-827c-4897-9e97-aff1be2be354', 'volume_size': 1} Jun 24 05:04:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9a6312db-750b-4a8d-ae6d-2bb3cb056dae tempest-VolumesActionsTest-907220492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:04:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9a6312db-750b-4a8d-ae6d-2bb3cb056dae tempest-VolumesActionsTest-907220492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:04:24 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-9a6312db-750b-4a8d-ae6d-2bb3cb056dae tempest-VolumesActionsTest-907220492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:04:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-565885185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd28bd41-827c-4897-9e97-aff1be2be354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbc22c9540fe4ac6bd7eb8cecc36ece1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:04:25Z,use_quota=True,user_id='f283f1650ffc455d93ae36e9340de4be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:04:24 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-9a6312db-750b-4a8d-ae6d-2bb3cb056dae tempest-VolumesActionsTest-907220492 None] Creating volume cd28bd41-827c-4897-9e97-aff1be2be354 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:04:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9a6312db-750b-4a8d-ae6d-2bb3cb056dae tempest-VolumesActionsTest-907220492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:04:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9a6312db-750b-4a8d-ae6d-2bb3cb056dae tempest-VolumesActionsTest-907220492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:04:24 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-9a6312db-750b-4a8d-ae6d-2bb3cb056dae tempest-VolumesActionsTest-907220492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:04:24 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-9a6312db-750b-4a8d-ae6d-2bb3cb056dae tempest-VolumesActionsTest-907220492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:04:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9a6312db-750b-4a8d-ae6d-2bb3cb056dae tempest-VolumesActionsTest-907220492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:04:24 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-9a6312db-750b-4a8d-ae6d-2bb3cb056dae tempest-VolumesActionsTest-907220492 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:04:24 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-9a6312db-750b-4a8d-ae6d-2bb3cb056dae tempest-VolumesActionsTest-907220492 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:04:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9a6312db-750b-4a8d-ae6d-2bb3cb056dae tempest-VolumesActionsTest-907220492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cd28bd41-827c-4897-9e97-aff1be2be354 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:24 devstack sudo[102299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cd28bd41-827c-4897-9e97-aff1be2be354 1073741824 Jun 24 05:04:24 devstack sudo[102299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:25 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0f49611-1862-4578-887c-c6964b53bba9 tempest-VolumeTypesAccessTest-674899575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:04:25 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d0f49611-1862-4578-887c-c6964b53bba9 tempest-VolumeTypesAccessTest-674899575 None] Flow 'volume_create_manager' (e4dcd2ad-4c2b-415f-9b0a-29c30e8f7896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:04:25 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d0f49611-1862-4578-887c-c6964b53bba9 tempest-VolumeTypesAccessTest-674899575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d02882e-93dd-406b-9d07-4b669ef2b2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:25 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d0f49611-1862-4578-887c-c6964b53bba9 tempest-VolumeTypesAccessTest-674899575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d02882e-93dd-406b-9d07-4b669ef2b2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1092098347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13d678de-9882-4b6c-8fd2-7eb7f438a76a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e3f7e89a0a4491eb7e995cfdf4453e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:04:25Z,use_quota=True,user_id='6236d8b127b6490699c464ef41233583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef8d74fd-bb7e-4df3-8e34-21f1f1d85bd6),volume_type_id=ef8d74fd-bb7e-4df3-8e34-21f1f1d85bd6)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:25 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d0f49611-1862-4578-887c-c6964b53bba9 tempest-VolumeTypesAccessTest-674899575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d06c8fe7-1b71-443c-bfba-55b2c5b7fad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:25 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d0f49611-1862-4578-887c-c6964b53bba9 tempest-VolumeTypesAccessTest-674899575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d06c8fe7-1b71-443c-bfba-55b2c5b7fad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:25 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d0f49611-1862-4578-887c-c6964b53bba9 tempest-VolumeTypesAccessTest-674899575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31927c03-66e0-421e-919f-2e35caaa060d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:25 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d0f49611-1862-4578-887c-c6964b53bba9 tempest-VolumeTypesAccessTest-674899575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31927c03-66e0-421e-919f-2e35caaa060d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13d678de-9882-4b6c-8fd2-7eb7f438a76a', 'volume_name': 'volume-13d678de-9882-4b6c-8fd2-7eb7f438a76a', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:25 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d0f49611-1862-4578-887c-c6964b53bba9 tempest-VolumeTypesAccessTest-674899575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c103d660-2f4d-4622-84af-76862ef3a20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:25 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d0f49611-1862-4578-887c-c6964b53bba9 tempest-VolumeTypesAccessTest-674899575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c103d660-2f4d-4622-84af-76862ef3a20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:25 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d0f49611-1862-4578-887c-c6964b53bba9 tempest-VolumeTypesAccessTest-674899575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51f522da-c844-450e-a418-e7152e36b171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:25 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-d0f49611-1862-4578-887c-c6964b53bba9 tempest-VolumeTypesAccessTest-674899575 None] Volume 13d678de-9882-4b6c-8fd2-7eb7f438a76a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13d678de-9882-4b6c-8fd2-7eb7f438a76a', 'volume_size': 1} Jun 24 05:04:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-d0f49611-1862-4578-887c-c6964b53bba9 tempest-VolumeTypesAccessTest-674899575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:04:25 devstack sudo[102299]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9a6312db-750b-4a8d-ae6d-2bb3cb056dae tempest-VolumesActionsTest-907220492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cd28bd41-827c-4897-9e97-aff1be2be354 1073741824" returned: 0 in 1.236s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9a6312db-750b-4a8d-ae6d-2bb3cb056dae tempest-VolumesActionsTest-907220492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cd28bd41-827c-4897-9e97-aff1be2be354 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:25 devstack sudo[102352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cd28bd41-827c-4897-9e97-aff1be2be354 Jun 24 05:04:25 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:26 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9a6312db-750b-4a8d-ae6d-2bb3cb056dae tempest-VolumesActionsTest-907220492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cd28bd41-827c-4897-9e97-aff1be2be354" returned: 0 in 0.712s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:26 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-9a6312db-750b-4a8d-ae6d-2bb3cb056dae tempest-VolumesActionsTest-907220492 None] <== create_volume: return (1998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:04:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9a6312db-750b-4a8d-ae6d-2bb3cb056dae tempest-VolumesActionsTest-907220492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:04:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-d0f49611-1862-4578-887c-c6964b53bba9 tempest-VolumeTypesAccessTest-674899575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.925s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:04:26 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-d0f49611-1862-4578-887c-c6964b53bba9 tempest-VolumeTypesAccessTest-674899575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1092098347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13d678de-9882-4b6c-8fd2-7eb7f438a76a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e3f7e89a0a4491eb7e995cfdf4453e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:04:25Z,use_quota=True,user_id='6236d8b127b6490699c464ef41233583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef8d74fd-bb7e-4df3-8e34-21f1f1d85bd6),volume_type_id=ef8d74fd-bb7e-4df3-8e34-21f1f1d85bd6)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:04:26 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-d0f49611-1862-4578-887c-c6964b53bba9 tempest-VolumeTypesAccessTest-674899575 None] Creating volume 13d678de-9882-4b6c-8fd2-7eb7f438a76a {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:04:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-d0f49611-1862-4578-887c-c6964b53bba9 tempest-VolumeTypesAccessTest-674899575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:04:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-d0f49611-1862-4578-887c-c6964b53bba9 tempest-VolumeTypesAccessTest-674899575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:04:26 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-d0f49611-1862-4578-887c-c6964b53bba9 tempest-VolumeTypesAccessTest-674899575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:04:26 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-d0f49611-1862-4578-887c-c6964b53bba9 tempest-VolumeTypesAccessTest-674899575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:04:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-d0f49611-1862-4578-887c-c6964b53bba9 tempest-VolumeTypesAccessTest-674899575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:04:26 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-d0f49611-1862-4578-887c-c6964b53bba9 tempest-VolumeTypesAccessTest-674899575 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:04:26 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-d0f49611-1862-4578-887c-c6964b53bba9 tempest-VolumeTypesAccessTest-674899575 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:04:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d0f49611-1862-4578-887c-c6964b53bba9 tempest-VolumeTypesAccessTest-674899575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-13d678de-9882-4b6c-8fd2-7eb7f438a76a 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:26 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9a6312db-750b-4a8d-ae6d-2bb3cb056dae tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eeb4897-4639-478c-b388-eb7ca2eb65dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd28bd41-827c-4897-9e97-aff1be2be354', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:26 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9a6312db-750b-4a8d-ae6d-2bb3cb056dae tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eabf213a-9858-4ddb-bb56-68da30b6df19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:26 devstack sudo[102363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-13d678de-9882-4b6c-8fd2-7eb7f438a76a 1073741824 Jun 24 05:04:26 devstack sudo[102363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:26 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-9a6312db-750b-4a8d-ae6d-2bb3cb056dae tempest-VolumesActionsTest-907220492 None] Volume volume-cd28bd41-827c-4897-9e97-aff1be2be354 (cd28bd41-827c-4897-9e97-aff1be2be354): created successfully Jun 24 05:04:26 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9a6312db-750b-4a8d-ae6d-2bb3cb056dae tempest-VolumesActionsTest-907220492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eabf213a-9858-4ddb-bb56-68da30b6df19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:26 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9a6312db-750b-4a8d-ae6d-2bb3cb056dae tempest-VolumesActionsTest-907220492 None] Flow 'volume_create_manager' (e0739eac-da22-451b-9109-92a693ccd7b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:04:26 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-9a6312db-750b-4a8d-ae6d-2bb3cb056dae tempest-VolumesActionsTest-907220492 None] Created volume successfully. Jun 24 05:04:27 devstack sudo[102363]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d0f49611-1862-4578-887c-c6964b53bba9 tempest-VolumeTypesAccessTest-674899575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-13d678de-9882-4b6c-8fd2-7eb7f438a76a 1073741824" returned: 0 in 1.121s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d0f49611-1862-4578-887c-c6964b53bba9 tempest-VolumeTypesAccessTest-674899575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-13d678de-9882-4b6c-8fd2-7eb7f438a76a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:27 devstack sudo[102370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-13d678de-9882-4b6c-8fd2-7eb7f438a76a Jun 24 05:04:27 devstack sudo[102370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:28 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e2676ee2-faee-4b75-b5c2-151f9e7a600e tempest-VolumesActionsTest-907220492 None] Acquiring lock "cinder-cd28bd41-827c-4897-9e97-aff1be2be354-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:04:28 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e2676ee2-faee-4b75-b5c2-151f9e7a600e tempest-VolumesActionsTest-907220492 None] Lock "cinder-cd28bd41-827c-4897-9e97-aff1be2be354-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:04:28 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e2676ee2-faee-4b75-b5c2-151f9e7a600e tempest-VolumesActionsTest-907220492 None] Acquiring lock "cinder-quobyte-cd28bd41-827c-4897-9e97-aff1be2be354" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:04:28 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e2676ee2-faee-4b75-b5c2-151f9e7a600e tempest-VolumesActionsTest-907220492 None] Lock "cinder-quobyte-cd28bd41-827c-4897-9e97-aff1be2be354" acquired by "delete_volume" :: waited 0.061s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:04:28 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca53c77-0b08-44c4-b501-ee0010600442]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:04:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e2676ee2-faee-4b75-b5c2-151f9e7a600e tempest-VolumesActionsTest-907220492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cd28bd41-827c-4897-9e97-aff1be2be354 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:28 devstack sudo[102372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cd28bd41-827c-4897-9e97-aff1be2be354 Jun 24 05:04:28 devstack sudo[102372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:28 devstack sudo[102370]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d0f49611-1862-4578-887c-c6964b53bba9 tempest-VolumeTypesAccessTest-674899575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-13d678de-9882-4b6c-8fd2-7eb7f438a76a" returned: 0 in 0.949s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:28 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-d0f49611-1862-4578-887c-c6964b53bba9 tempest-VolumeTypesAccessTest-674899575 None] <== create_volume: return (2131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:04:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-d0f49611-1862-4578-887c-c6964b53bba9 tempest-VolumeTypesAccessTest-674899575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.135s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:04:28 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d0f49611-1862-4578-887c-c6964b53bba9 tempest-VolumeTypesAccessTest-674899575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51f522da-c844-450e-a418-e7152e36b171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13d678de-9882-4b6c-8fd2-7eb7f438a76a', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:28 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d0f49611-1862-4578-887c-c6964b53bba9 tempest-VolumeTypesAccessTest-674899575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5296567d-9433-4f07-9578-f0c5f2e1807f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:28 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-d0f49611-1862-4578-887c-c6964b53bba9 tempest-VolumeTypesAccessTest-674899575 None] Volume volume-13d678de-9882-4b6c-8fd2-7eb7f438a76a (13d678de-9882-4b6c-8fd2-7eb7f438a76a): created successfully Jun 24 05:04:28 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d0f49611-1862-4578-887c-c6964b53bba9 tempest-VolumeTypesAccessTest-674899575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5296567d-9433-4f07-9578-f0c5f2e1807f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:28 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d0f49611-1862-4578-887c-c6964b53bba9 tempest-VolumeTypesAccessTest-674899575 None] Flow 'volume_create_manager' (e4dcd2ad-4c2b-415f-9b0a-29c30e8f7896) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:04:28 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-d0f49611-1862-4578-887c-c6964b53bba9 tempest-VolumeTypesAccessTest-674899575 None] Created volume successfully. Jun 24 05:04:29 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-2f464f1c-dd5e-4fa8-9ca9-d61687c5f698 req-9e38f1df-7d78-4a84-bde8-10e7e68e10d5 tempest-ServerActionsTestOtherA-1758477181 None] Terminate volume connection completed successfully. Jun 24 05:04:29 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-2f464f1c-dd5e-4fa8-9ca9-d61687c5f698 req-9e38f1df-7d78-4a84-bde8-10e7e68e10d5 tempest-ServerActionsTestOtherA-1758477181 None] Deleting attachment 9ce6ba4d-ed07-4215-bfd3-61f8a3c22b18. {{(pid=93830) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 05:04:29 devstack sudo[102372]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e2676ee2-faee-4b75-b5c2-151f9e7a600e tempest-VolumesActionsTest-907220492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cd28bd41-827c-4897-9e97-aff1be2be354" returned: 0 in 0.851s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e2676ee2-faee-4b75-b5c2-151f9e7a600e tempest-VolumesActionsTest-907220492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cd28bd41-827c-4897-9e97-aff1be2be354 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:29 devstack sudo[102387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cd28bd41-827c-4897-9e97-aff1be2be354 Jun 24 05:04:29 devstack sudo[102387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:29 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-7cced1cd-534e-4898-889d-a8f4aa758f50 tempest-VolumeTypesAccessTest-674899575 None] Acquiring lock "cinder-13d678de-9882-4b6c-8fd2-7eb7f438a76a-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:04:29 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-7cced1cd-534e-4898-889d-a8f4aa758f50 tempest-VolumeTypesAccessTest-674899575 None] Lock "cinder-13d678de-9882-4b6c-8fd2-7eb7f438a76a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:04:29 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-7cced1cd-534e-4898-889d-a8f4aa758f50 tempest-VolumeTypesAccessTest-674899575 None] Acquiring lock "cinder-quobyte-13d678de-9882-4b6c-8fd2-7eb7f438a76a" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:04:30 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-7cced1cd-534e-4898-889d-a8f4aa758f50 tempest-VolumeTypesAccessTest-674899575 None] Lock "cinder-quobyte-13d678de-9882-4b6c-8fd2-7eb7f438a76a" acquired by "delete_volume" :: waited 0.024s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:04:30 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[274a0022-42e8-4b82-9907-82ccba6bf64c]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:04:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7cced1cd-534e-4898-889d-a8f4aa758f50 tempest-VolumeTypesAccessTest-674899575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-13d678de-9882-4b6c-8fd2-7eb7f438a76a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:30 devstack sudo[102398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-13d678de-9882-4b6c-8fd2-7eb7f438a76a Jun 24 05:04:30 devstack sudo[102398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:30 devstack sudo[102387]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e2676ee2-faee-4b75-b5c2-151f9e7a600e tempest-VolumesActionsTest-907220492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cd28bd41-827c-4897-9e97-aff1be2be354" returned: 0 in 0.863s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:30 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e2676ee2-faee-4b75-b5c2-151f9e7a600e tempest-VolumesActionsTest-907220492 None] Lock "cinder-quobyte-cd28bd41-827c-4897-9e97-aff1be2be354" released by "delete_volume" :: held 1.778s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:04:30 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-e2676ee2-faee-4b75-b5c2-151f9e7a600e tempest-VolumesActionsTest-907220492 None] Created reservations ['82aa3bc0-b640-4c56-995c-a1b6c82456ac', '412995aa-aaa3-4231-aed8-3a5792585e91', '1f4aa27a-44ef-42f3-87b4-6640562ca5be', '709dbff2-f941-40ad-bcc0-e6630ab4bb56'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:04:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e2676ee2-faee-4b75-b5c2-151f9e7a600e tempest-VolumesActionsTest-907220492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:04:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e2676ee2-faee-4b75-b5c2-151f9e7a600e tempest-VolumesActionsTest-907220492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:04:30 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e2676ee2-faee-4b75-b5c2-151f9e7a600e tempest-VolumesActionsTest-907220492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:04:30 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e2676ee2-faee-4b75-b5c2-151f9e7a600e tempest-VolumesActionsTest-907220492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:04:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e2676ee2-faee-4b75-b5c2-151f9e7a600e tempest-VolumesActionsTest-907220492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:04:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e2676ee2-faee-4b75-b5c2-151f9e7a600e tempest-VolumesActionsTest-907220492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:30 devstack sudo[102406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:04:30 devstack sudo[102406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:30 devstack sudo[102398]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7cced1cd-534e-4898-889d-a8f4aa758f50 tempest-VolumeTypesAccessTest-674899575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-13d678de-9882-4b6c-8fd2-7eb7f438a76a" returned: 0 in 0.924s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7cced1cd-534e-4898-889d-a8f4aa758f50 tempest-VolumeTypesAccessTest-674899575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-13d678de-9882-4b6c-8fd2-7eb7f438a76a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:31 devstack sudo[102412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-13d678de-9882-4b6c-8fd2-7eb7f438a76a Jun 24 05:04:31 devstack sudo[102412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:31 devstack sudo[102406]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e2676ee2-faee-4b75-b5c2-151f9e7a600e tempest-VolumesActionsTest-907220492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.861s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:31 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-e2676ee2-faee-4b75-b5c2-151f9e7a600e tempest-VolumesActionsTest-907220492 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:04:31 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-e2676ee2-faee-4b75-b5c2-151f9e7a600e tempest-VolumesActionsTest-907220492 None] Deleted volume successfully. Jun 24 05:04:31 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e2676ee2-faee-4b75-b5c2-151f9e7a600e tempest-VolumesActionsTest-907220492 None] Lock "cinder-cd28bd41-827c-4897-9e97-aff1be2be354-delete_volume" released by "delete_volume" :: held 2.989s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:04:31 devstack sudo[102412]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7cced1cd-534e-4898-889d-a8f4aa758f50 tempest-VolumeTypesAccessTest-674899575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-13d678de-9882-4b6c-8fd2-7eb7f438a76a" returned: 0 in 0.804s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:31 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-7cced1cd-534e-4898-889d-a8f4aa758f50 tempest-VolumeTypesAccessTest-674899575 None] Lock "cinder-quobyte-13d678de-9882-4b6c-8fd2-7eb7f438a76a" released by "delete_volume" :: held 1.789s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:04:31 devstack cinder-volume[93830]: WARNING cinder.quota [None req-7cced1cd-534e-4898-889d-a8f4aa758f50 tempest-VolumeTypesAccessTest-674899575 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2090947215 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2090947215, it is now deprecated. Please use the default quota class for default quota. Jun 24 05:04:31 devstack cinder-volume[93830]: WARNING cinder.quota [None req-7cced1cd-534e-4898-889d-a8f4aa758f50 tempest-VolumeTypesAccessTest-674899575 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2090947215 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2090947215, it is now deprecated. Please use the default quota class for default quota. Jun 24 05:04:31 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-7cced1cd-534e-4898-889d-a8f4aa758f50 tempest-VolumeTypesAccessTest-674899575 None] Created reservations ['fad3334c-2913-4af1-8e2a-57637bf57702', '5304d9c0-7c6b-4002-84bf-1261035c7b04', '1b683f3d-415e-4516-b4b3-25c845eafec8', 'bd745993-9251-4cc8-b2af-e5af016369e5'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:04:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7cced1cd-534e-4898-889d-a8f4aa758f50 tempest-VolumeTypesAccessTest-674899575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:04:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7cced1cd-534e-4898-889d-a8f4aa758f50 tempest-VolumeTypesAccessTest-674899575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:04:31 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7cced1cd-534e-4898-889d-a8f4aa758f50 tempest-VolumeTypesAccessTest-674899575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:04:31 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7cced1cd-534e-4898-889d-a8f4aa758f50 tempest-VolumeTypesAccessTest-674899575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:04:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7cced1cd-534e-4898-889d-a8f4aa758f50 tempest-VolumeTypesAccessTest-674899575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:04:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7cced1cd-534e-4898-889d-a8f4aa758f50 tempest-VolumeTypesAccessTest-674899575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:31 devstack sudo[102416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:04:31 devstack sudo[102416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:32 devstack sudo[102416]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7cced1cd-534e-4898-889d-a8f4aa758f50 tempest-VolumeTypesAccessTest-674899575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 1.053s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:32 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-7cced1cd-534e-4898-889d-a8f4aa758f50 tempest-VolumeTypesAccessTest-674899575 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:04:32 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-7cced1cd-534e-4898-889d-a8f4aa758f50 tempest-VolumeTypesAccessTest-674899575 None] Deleted volume successfully. Jun 24 05:04:33 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-7cced1cd-534e-4898-889d-a8f4aa758f50 tempest-VolumeTypesAccessTest-674899575 None] Lock "cinder-13d678de-9882-4b6c-8fd2-7eb7f438a76a-delete_volume" released by "delete_volume" :: held 3.098s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:04:40 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-943aec19-2bbe-4bf2-be8b-3c02f2f1d0e0 tempest-ServerActionsTestOtherA-1758477181 None] Acquiring lock "cinder-ee9ad562-6754-4f5e-bb59-e29c736fa7f4-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:04:40 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-943aec19-2bbe-4bf2-be8b-3c02f2f1d0e0 tempest-ServerActionsTestOtherA-1758477181 None] Lock "cinder-ee9ad562-6754-4f5e-bb59-e29c736fa7f4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:04:40 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-943aec19-2bbe-4bf2-be8b-3c02f2f1d0e0 tempest-ServerActionsTestOtherA-1758477181 None] Acquiring lock "cinder-quobyte-ee9ad562-6754-4f5e-bb59-e29c736fa7f4" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:04:40 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-943aec19-2bbe-4bf2-be8b-3c02f2f1d0e0 tempest-ServerActionsTestOtherA-1758477181 None] Lock "cinder-quobyte-ee9ad562-6754-4f5e-bb59-e29c736fa7f4" acquired by "delete_volume" :: waited 0.050s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:04:40 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8663da9-ca36-4130-8907-5c094f3c722b]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:04:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-943aec19-2bbe-4bf2-be8b-3c02f2f1d0e0 tempest-ServerActionsTestOtherA-1758477181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ee9ad562-6754-4f5e-bb59-e29c736fa7f4 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:41 devstack sudo[102551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ee9ad562-6754-4f5e-bb59-e29c736fa7f4 Jun 24 05:04:41 devstack sudo[102551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:42 devstack sudo[102551]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-943aec19-2bbe-4bf2-be8b-3c02f2f1d0e0 tempest-ServerActionsTestOtherA-1758477181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ee9ad562-6754-4f5e-bb59-e29c736fa7f4" returned: 0 in 1.177s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-943aec19-2bbe-4bf2-be8b-3c02f2f1d0e0 tempest-ServerActionsTestOtherA-1758477181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ee9ad562-6754-4f5e-bb59-e29c736fa7f4 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:42 devstack sudo[102557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ee9ad562-6754-4f5e-bb59-e29c736fa7f4 Jun 24 05:04:42 devstack sudo[102557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:43 devstack sudo[102557]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-943aec19-2bbe-4bf2-be8b-3c02f2f1d0e0 tempest-ServerActionsTestOtherA-1758477181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ee9ad562-6754-4f5e-bb59-e29c736fa7f4" returned: 0 in 1.071s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:43 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-943aec19-2bbe-4bf2-be8b-3c02f2f1d0e0 tempest-ServerActionsTestOtherA-1758477181 None] Lock "cinder-quobyte-ee9ad562-6754-4f5e-bb59-e29c736fa7f4" released by "delete_volume" :: held 2.337s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:04:43 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:SELECT=87,cinder:UPDATE=105,cinder:INSERT=28,cinder:DELETE=7 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:04:43 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-943aec19-2bbe-4bf2-be8b-3c02f2f1d0e0 tempest-ServerActionsTestOtherA-1758477181 None] Created reservations ['d7888d31-cac9-4b24-93ab-d529e31c686f', '9db8573a-5550-43b3-be12-17d4c6f758b7', '1b30f3fe-e9a2-43ae-a45d-44fb1ca0e07c', '0db0191d-6f96-4af4-b6f8-e03921edf433'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:04:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-943aec19-2bbe-4bf2-be8b-3c02f2f1d0e0 tempest-ServerActionsTestOtherA-1758477181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:04:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-943aec19-2bbe-4bf2-be8b-3c02f2f1d0e0 tempest-ServerActionsTestOtherA-1758477181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:04:43 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-943aec19-2bbe-4bf2-be8b-3c02f2f1d0e0 tempest-ServerActionsTestOtherA-1758477181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:04:43 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-943aec19-2bbe-4bf2-be8b-3c02f2f1d0e0 tempest-ServerActionsTestOtherA-1758477181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:04:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-943aec19-2bbe-4bf2-be8b-3c02f2f1d0e0 tempest-ServerActionsTestOtherA-1758477181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:04:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-943aec19-2bbe-4bf2-be8b-3c02f2f1d0e0 tempest-ServerActionsTestOtherA-1758477181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:43 devstack sudo[102562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:04:43 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:44 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-943aec19-2bbe-4bf2-be8b-3c02f2f1d0e0 tempest-ServerActionsTestOtherA-1758477181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 1.076s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:44 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-943aec19-2bbe-4bf2-be8b-3c02f2f1d0e0 tempest-ServerActionsTestOtherA-1758477181 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:04:44 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-943aec19-2bbe-4bf2-be8b-3c02f2f1d0e0 tempest-ServerActionsTestOtherA-1758477181 None] Deleted volume successfully. Jun 24 05:04:44 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-943aec19-2bbe-4bf2-be8b-3c02f2f1d0e0 tempest-ServerActionsTestOtherA-1758477181 None] Lock "cinder-ee9ad562-6754-4f5e-bb59-e29c736fa7f4-delete_volume" released by "delete_volume" :: held 3.794s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:04:44 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-a15c6642-81cd-415a-bda4-660b4d0814cf tempest-AbsoluteLimitsTests-294523962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:04:44 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a15c6642-81cd-415a-bda4-660b4d0814cf tempest-AbsoluteLimitsTests-294523962 None] Flow 'volume_create_manager' (1659aa96-00f9-4c81-82cc-87bf74f1b9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:04:44 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a15c6642-81cd-415a-bda4-660b4d0814cf tempest-AbsoluteLimitsTests-294523962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eee81a9c-b913-46d6-b8a5-6f2bb0a558f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:44 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a15c6642-81cd-415a-bda4-660b4d0814cf tempest-AbsoluteLimitsTests-294523962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eee81a9c-b913-46d6-b8a5-6f2bb0a558f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2045766177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40fae254-64ca-4057-8411-34327285bd57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcfed6c54a58465785ca381892dc6d75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:04:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:04:45Z,use_quota=True,user_id='bb08a84833f545d9a36a8d0f1e23a21b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:44 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a15c6642-81cd-415a-bda4-660b4d0814cf tempest-AbsoluteLimitsTests-294523962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fbb19cb-5d27-453d-b43c-669b918884ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:44 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a15c6642-81cd-415a-bda4-660b4d0814cf tempest-AbsoluteLimitsTests-294523962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fbb19cb-5d27-453d-b43c-669b918884ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:44 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a15c6642-81cd-415a-bda4-660b4d0814cf tempest-AbsoluteLimitsTests-294523962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bcd22e1-7d58-4e62-9a10-689b6ac34cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:44 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a15c6642-81cd-415a-bda4-660b4d0814cf tempest-AbsoluteLimitsTests-294523962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bcd22e1-7d58-4e62-9a10-689b6ac34cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40fae254-64ca-4057-8411-34327285bd57', 'volume_name': 'volume-40fae254-64ca-4057-8411-34327285bd57', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:44 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a15c6642-81cd-415a-bda4-660b4d0814cf tempest-AbsoluteLimitsTests-294523962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88df6d51-70fa-4106-a186-1689abf4d00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:44 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a15c6642-81cd-415a-bda4-660b4d0814cf tempest-AbsoluteLimitsTests-294523962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88df6d51-70fa-4106-a186-1689abf4d00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:44 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a15c6642-81cd-415a-bda4-660b4d0814cf tempest-AbsoluteLimitsTests-294523962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (257fa7a1-787a-4c81-8f74-a6f105716224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:44 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-a15c6642-81cd-415a-bda4-660b4d0814cf tempest-AbsoluteLimitsTests-294523962 None] Volume 40fae254-64ca-4057-8411-34327285bd57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40fae254-64ca-4057-8411-34327285bd57', 'volume_size': 1} Jun 24 05:04:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a15c6642-81cd-415a-bda4-660b4d0814cf tempest-AbsoluteLimitsTests-294523962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:04:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a15c6642-81cd-415a-bda4-660b4d0814cf tempest-AbsoluteLimitsTests-294523962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:04:44 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a15c6642-81cd-415a-bda4-660b4d0814cf tempest-AbsoluteLimitsTests-294523962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2045766177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40fae254-64ca-4057-8411-34327285bd57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcfed6c54a58465785ca381892dc6d75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:04:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:04:45Z,use_quota=True,user_id='bb08a84833f545d9a36a8d0f1e23a21b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:04:44 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-a15c6642-81cd-415a-bda4-660b4d0814cf tempest-AbsoluteLimitsTests-294523962 None] Creating volume 40fae254-64ca-4057-8411-34327285bd57 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:04:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a15c6642-81cd-415a-bda4-660b4d0814cf tempest-AbsoluteLimitsTests-294523962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:04:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a15c6642-81cd-415a-bda4-660b4d0814cf tempest-AbsoluteLimitsTests-294523962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:04:44 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a15c6642-81cd-415a-bda4-660b4d0814cf tempest-AbsoluteLimitsTests-294523962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:04:44 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a15c6642-81cd-415a-bda4-660b4d0814cf tempest-AbsoluteLimitsTests-294523962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:04:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a15c6642-81cd-415a-bda4-660b4d0814cf tempest-AbsoluteLimitsTests-294523962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:04:44 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a15c6642-81cd-415a-bda4-660b4d0814cf tempest-AbsoluteLimitsTests-294523962 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:04:44 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-a15c6642-81cd-415a-bda4-660b4d0814cf tempest-AbsoluteLimitsTests-294523962 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:04:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a15c6642-81cd-415a-bda4-660b4d0814cf tempest-AbsoluteLimitsTests-294523962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-40fae254-64ca-4057-8411-34327285bd57 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:44 devstack sudo[102567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-40fae254-64ca-4057-8411-34327285bd57 1073741824 Jun 24 05:04:44 devstack sudo[102567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:46 devstack sudo[102567]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a15c6642-81cd-415a-bda4-660b4d0814cf tempest-AbsoluteLimitsTests-294523962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-40fae254-64ca-4057-8411-34327285bd57 1073741824" returned: 0 in 1.394s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a15c6642-81cd-415a-bda4-660b4d0814cf tempest-AbsoluteLimitsTests-294523962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-40fae254-64ca-4057-8411-34327285bd57 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:46 devstack sudo[102615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-40fae254-64ca-4057-8411-34327285bd57 Jun 24 05:04:46 devstack sudo[102615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:47 devstack sudo[102615]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a15c6642-81cd-415a-bda4-660b4d0814cf tempest-AbsoluteLimitsTests-294523962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-40fae254-64ca-4057-8411-34327285bd57" returned: 0 in 0.945s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:47 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a15c6642-81cd-415a-bda4-660b4d0814cf tempest-AbsoluteLimitsTests-294523962 None] <== create_volume: return (2396ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:04:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a15c6642-81cd-415a-bda4-660b4d0814cf tempest-AbsoluteLimitsTests-294523962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.400s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:04:47 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a15c6642-81cd-415a-bda4-660b4d0814cf tempest-AbsoluteLimitsTests-294523962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (257fa7a1-787a-4c81-8f74-a6f105716224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40fae254-64ca-4057-8411-34327285bd57', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:47 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a15c6642-81cd-415a-bda4-660b4d0814cf tempest-AbsoluteLimitsTests-294523962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9098a043-d0c3-4319-baa3-820aedbb6545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:47 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-a15c6642-81cd-415a-bda4-660b4d0814cf tempest-AbsoluteLimitsTests-294523962 None] Volume volume-40fae254-64ca-4057-8411-34327285bd57 (40fae254-64ca-4057-8411-34327285bd57): created successfully Jun 24 05:04:47 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a15c6642-81cd-415a-bda4-660b4d0814cf tempest-AbsoluteLimitsTests-294523962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9098a043-d0c3-4319-baa3-820aedbb6545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:47 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a15c6642-81cd-415a-bda4-660b4d0814cf tempest-AbsoluteLimitsTests-294523962 None] Flow 'volume_create_manager' (1659aa96-00f9-4c81-82cc-87bf74f1b9f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:04:47 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-a15c6642-81cd-415a-bda4-660b4d0814cf tempest-AbsoluteLimitsTests-294523962 None] Created volume successfully. Jun 24 05:04:48 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-8a907256-9687-417c-af43-2f9cc9229f3a tempest-AbsoluteLimitsTests-294523962 None] Acquiring lock "cinder-40fae254-64ca-4057-8411-34327285bd57-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:04:48 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-8a907256-9687-417c-af43-2f9cc9229f3a tempest-AbsoluteLimitsTests-294523962 None] Lock "cinder-40fae254-64ca-4057-8411-34327285bd57-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:04:48 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-8a907256-9687-417c-af43-2f9cc9229f3a tempest-AbsoluteLimitsTests-294523962 None] Acquiring lock "cinder-quobyte-40fae254-64ca-4057-8411-34327285bd57" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:04:48 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-8a907256-9687-417c-af43-2f9cc9229f3a tempest-AbsoluteLimitsTests-294523962 None] Lock "cinder-quobyte-40fae254-64ca-4057-8411-34327285bd57" acquired by "delete_volume" :: waited 0.032s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:04:48 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9dfc39c-235b-463a-b411-8300cfbe917e]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:04:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8a907256-9687-417c-af43-2f9cc9229f3a tempest-AbsoluteLimitsTests-294523962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-40fae254-64ca-4057-8411-34327285bd57 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:48 devstack sudo[102622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-40fae254-64ca-4057-8411-34327285bd57 Jun 24 05:04:48 devstack sudo[102622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:49 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b3e589a-83d4-42b0-869c-9d8ea65f8a45 tempest-VolumesListAdminTestJSON-2130399491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:04:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7b3e589a-83d4-42b0-869c-9d8ea65f8a45 tempest-VolumesListAdminTestJSON-2130399491 None] Flow 'volume_create_manager' (489c03fa-fbcf-4cf2-aa62-e38ce1ab6e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:04:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7b3e589a-83d4-42b0-869c-9d8ea65f8a45 tempest-VolumesListAdminTestJSON-2130399491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03944fda-6c85-4e32-8509-f8723c1c5225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7b3e589a-83d4-42b0-869c-9d8ea65f8a45 tempest-VolumesListAdminTestJSON-2130399491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03944fda-6c85-4e32-8509-f8723c1c5225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-286357349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=877d5ad8-2905-4bca-8a4b-deaed4a959b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9745c09093b4474e96b48024fecfefa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:04:49Z,use_quota=True,user_id='1af8624917b144a689a3a82dbd3ce43d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:49 devstack sudo[102622]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7b3e589a-83d4-42b0-869c-9d8ea65f8a45 tempest-VolumesListAdminTestJSON-2130399491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (001739f4-9264-4616-826a-0c490ef85895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7b3e589a-83d4-42b0-869c-9d8ea65f8a45 tempest-VolumesListAdminTestJSON-2130399491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (001739f4-9264-4616-826a-0c490ef85895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7b3e589a-83d4-42b0-869c-9d8ea65f8a45 tempest-VolumesListAdminTestJSON-2130399491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1b8dc9f-eccd-4795-8a63-276f78d8caa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7b3e589a-83d4-42b0-869c-9d8ea65f8a45 tempest-VolumesListAdminTestJSON-2130399491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1b8dc9f-eccd-4795-8a63-276f78d8caa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '877d5ad8-2905-4bca-8a4b-deaed4a959b8', 'volume_name': 'volume-877d5ad8-2905-4bca-8a4b-deaed4a959b8', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7b3e589a-83d4-42b0-869c-9d8ea65f8a45 tempest-VolumesListAdminTestJSON-2130399491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50ebce00-2ccc-40ad-befc-0b82db0b743b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7b3e589a-83d4-42b0-869c-9d8ea65f8a45 tempest-VolumesListAdminTestJSON-2130399491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50ebce00-2ccc-40ad-befc-0b82db0b743b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7b3e589a-83d4-42b0-869c-9d8ea65f8a45 tempest-VolumesListAdminTestJSON-2130399491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed520556-4ca9-4bc1-a542-b4998c18bed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:49 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-7b3e589a-83d4-42b0-869c-9d8ea65f8a45 tempest-VolumesListAdminTestJSON-2130399491 None] Volume 877d5ad8-2905-4bca-8a4b-deaed4a959b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-877d5ad8-2905-4bca-8a4b-deaed4a959b8', 'volume_size': 1} Jun 24 05:04:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7b3e589a-83d4-42b0-869c-9d8ea65f8a45 tempest-VolumesListAdminTestJSON-2130399491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:04:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7b3e589a-83d4-42b0-869c-9d8ea65f8a45 tempest-VolumesListAdminTestJSON-2130399491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:04:49 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7b3e589a-83d4-42b0-869c-9d8ea65f8a45 tempest-VolumesListAdminTestJSON-2130399491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-286357349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=877d5ad8-2905-4bca-8a4b-deaed4a959b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9745c09093b4474e96b48024fecfefa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:04:49Z,use_quota=True,user_id='1af8624917b144a689a3a82dbd3ce43d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:04:49 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-7b3e589a-83d4-42b0-869c-9d8ea65f8a45 tempest-VolumesListAdminTestJSON-2130399491 None] Creating volume 877d5ad8-2905-4bca-8a4b-deaed4a959b8 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:04:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7b3e589a-83d4-42b0-869c-9d8ea65f8a45 tempest-VolumesListAdminTestJSON-2130399491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:04:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7b3e589a-83d4-42b0-869c-9d8ea65f8a45 tempest-VolumesListAdminTestJSON-2130399491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:04:49 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7b3e589a-83d4-42b0-869c-9d8ea65f8a45 tempest-VolumesListAdminTestJSON-2130399491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:04:49 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7b3e589a-83d4-42b0-869c-9d8ea65f8a45 tempest-VolumesListAdminTestJSON-2130399491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:04:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7b3e589a-83d4-42b0-869c-9d8ea65f8a45 tempest-VolumesListAdminTestJSON-2130399491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:04:49 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7b3e589a-83d4-42b0-869c-9d8ea65f8a45 tempest-VolumesListAdminTestJSON-2130399491 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:04:49 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-7b3e589a-83d4-42b0-869c-9d8ea65f8a45 tempest-VolumesListAdminTestJSON-2130399491 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:04:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7b3e589a-83d4-42b0-869c-9d8ea65f8a45 tempest-VolumesListAdminTestJSON-2130399491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-877d5ad8-2905-4bca-8a4b-deaed4a959b8 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8a907256-9687-417c-af43-2f9cc9229f3a tempest-AbsoluteLimitsTests-294523962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-40fae254-64ca-4057-8411-34327285bd57" returned: 0 in 1.184s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8a907256-9687-417c-af43-2f9cc9229f3a tempest-AbsoluteLimitsTests-294523962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-40fae254-64ca-4057-8411-34327285bd57 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:49 devstack sudo[102628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-877d5ad8-2905-4bca-8a4b-deaed4a959b8 1073741824 Jun 24 05:04:49 devstack sudo[102628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:49 devstack sudo[102629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-40fae254-64ca-4057-8411-34327285bd57 Jun 24 05:04:49 devstack sudo[102629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:50 devstack sudo[102629]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8a907256-9687-417c-af43-2f9cc9229f3a tempest-AbsoluteLimitsTests-294523962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-40fae254-64ca-4057-8411-34327285bd57" returned: 0 in 0.744s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:50 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-8a907256-9687-417c-af43-2f9cc9229f3a tempest-AbsoluteLimitsTests-294523962 None] Lock "cinder-quobyte-40fae254-64ca-4057-8411-34327285bd57" released by "delete_volume" :: held 2.008s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:04:50 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-8a907256-9687-417c-af43-2f9cc9229f3a tempest-AbsoluteLimitsTests-294523962 None] Created reservations ['cf0580c7-c5ba-4f93-9c2c-b9077932142b', 'ff90c603-0033-4b58-9ee4-838a20005e25', 'd270b59f-e1c5-4c6c-b540-02eedf6e3c4f', '76c20911-5970-4efc-a1ae-f8a39daeffc7'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:04:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-8a907256-9687-417c-af43-2f9cc9229f3a tempest-AbsoluteLimitsTests-294523962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:04:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-8a907256-9687-417c-af43-2f9cc9229f3a tempest-AbsoluteLimitsTests-294523962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:04:50 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-8a907256-9687-417c-af43-2f9cc9229f3a tempest-AbsoluteLimitsTests-294523962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:04:50 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-8a907256-9687-417c-af43-2f9cc9229f3a tempest-AbsoluteLimitsTests-294523962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:04:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-8a907256-9687-417c-af43-2f9cc9229f3a tempest-AbsoluteLimitsTests-294523962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:04:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8a907256-9687-417c-af43-2f9cc9229f3a tempest-AbsoluteLimitsTests-294523962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:50 devstack sudo[102655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:04:50 devstack sudo[102655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:50 devstack sudo[102628]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7b3e589a-83d4-42b0-869c-9d8ea65f8a45 tempest-VolumesListAdminTestJSON-2130399491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-877d5ad8-2905-4bca-8a4b-deaed4a959b8 1073741824" returned: 0 in 1.000s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7b3e589a-83d4-42b0-869c-9d8ea65f8a45 tempest-VolumesListAdminTestJSON-2130399491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-877d5ad8-2905-4bca-8a4b-deaed4a959b8 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:50 devstack sudo[102657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-877d5ad8-2905-4bca-8a4b-deaed4a959b8 Jun 24 05:04:50 devstack sudo[102657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:51 devstack sudo[102655]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8a907256-9687-417c-af43-2f9cc9229f3a tempest-AbsoluteLimitsTests-294523962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.636s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:51 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-8a907256-9687-417c-af43-2f9cc9229f3a tempest-AbsoluteLimitsTests-294523962 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:04:51 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-8a907256-9687-417c-af43-2f9cc9229f3a tempest-AbsoluteLimitsTests-294523962 None] Deleted volume successfully. Jun 24 05:04:51 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-8a907256-9687-417c-af43-2f9cc9229f3a tempest-AbsoluteLimitsTests-294523962 None] Lock "cinder-40fae254-64ca-4057-8411-34327285bd57-delete_volume" released by "delete_volume" :: held 3.003s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:04:51 devstack sudo[102657]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7b3e589a-83d4-42b0-869c-9d8ea65f8a45 tempest-VolumesListAdminTestJSON-2130399491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-877d5ad8-2905-4bca-8a4b-deaed4a959b8" returned: 0 in 0.659s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:51 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7b3e589a-83d4-42b0-869c-9d8ea65f8a45 tempest-VolumesListAdminTestJSON-2130399491 None] <== create_volume: return (1705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:04:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7b3e589a-83d4-42b0-869c-9d8ea65f8a45 tempest-VolumesListAdminTestJSON-2130399491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:04:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7b3e589a-83d4-42b0-869c-9d8ea65f8a45 tempest-VolumesListAdminTestJSON-2130399491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed520556-4ca9-4bc1-a542-b4998c18bed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-877d5ad8-2905-4bca-8a4b-deaed4a959b8', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7b3e589a-83d4-42b0-869c-9d8ea65f8a45 tempest-VolumesListAdminTestJSON-2130399491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7b4471a-2784-4748-8c61-2b72e491ec27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:51 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-7b3e589a-83d4-42b0-869c-9d8ea65f8a45 tempest-VolumesListAdminTestJSON-2130399491 None] Volume volume-877d5ad8-2905-4bca-8a4b-deaed4a959b8 (877d5ad8-2905-4bca-8a4b-deaed4a959b8): created successfully Jun 24 05:04:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7b3e589a-83d4-42b0-869c-9d8ea65f8a45 tempest-VolumesListAdminTestJSON-2130399491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7b4471a-2784-4748-8c61-2b72e491ec27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7b3e589a-83d4-42b0-869c-9d8ea65f8a45 tempest-VolumesListAdminTestJSON-2130399491 None] Flow 'volume_create_manager' (489c03fa-fbcf-4cf2-aa62-e38ce1ab6e08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:04:51 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-7b3e589a-83d4-42b0-869c-9d8ea65f8a45 tempest-VolumesListAdminTestJSON-2130399491 None] Created volume successfully. Jun 24 05:04:51 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-8532cc53-3f5f-472d-b50a-85a99644f2aa tempest-VolumesListAdminTestJSON-2130399491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:04:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8532cc53-3f5f-472d-b50a-85a99644f2aa tempest-VolumesListAdminTestJSON-2130399491 None] Flow 'volume_create_manager' (a679aa06-4507-4077-b725-88c3b1de0275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:04:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8532cc53-3f5f-472d-b50a-85a99644f2aa tempest-VolumesListAdminTestJSON-2130399491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (163f8906-44c9-442a-b5e6-798cd4d39466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8532cc53-3f5f-472d-b50a-85a99644f2aa tempest-VolumesListAdminTestJSON-2130399491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (163f8906-44c9-442a-b5e6-798cd4d39466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:04:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1656759390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f9cc2bc-e8d8-435b-bc38-c711946eb154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9745c09093b4474e96b48024fecfefa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:04:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:04:52Z,use_quota=True,user_id='1af8624917b144a689a3a82dbd3ce43d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8532cc53-3f5f-472d-b50a-85a99644f2aa tempest-VolumesListAdminTestJSON-2130399491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c67e090f-f1a6-458c-aab3-57ce23ecae85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8532cc53-3f5f-472d-b50a-85a99644f2aa tempest-VolumesListAdminTestJSON-2130399491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c67e090f-f1a6-458c-aab3-57ce23ecae85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8532cc53-3f5f-472d-b50a-85a99644f2aa tempest-VolumesListAdminTestJSON-2130399491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dcfdd53-ee29-4f46-8b06-6dc999d2e252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8532cc53-3f5f-472d-b50a-85a99644f2aa tempest-VolumesListAdminTestJSON-2130399491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dcfdd53-ee29-4f46-8b06-6dc999d2e252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f9cc2bc-e8d8-435b-bc38-c711946eb154', 'volume_name': 'volume-7f9cc2bc-e8d8-435b-bc38-c711946eb154', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8532cc53-3f5f-472d-b50a-85a99644f2aa tempest-VolumesListAdminTestJSON-2130399491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d24fdc33-6996-4e86-88b5-8c80caf04e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8532cc53-3f5f-472d-b50a-85a99644f2aa tempest-VolumesListAdminTestJSON-2130399491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d24fdc33-6996-4e86-88b5-8c80caf04e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8532cc53-3f5f-472d-b50a-85a99644f2aa tempest-VolumesListAdminTestJSON-2130399491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (844366c5-2c0b-4cbd-8c36-653156aba225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:51 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-8532cc53-3f5f-472d-b50a-85a99644f2aa tempest-VolumesListAdminTestJSON-2130399491 None] Volume 7f9cc2bc-e8d8-435b-bc38-c711946eb154: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f9cc2bc-e8d8-435b-bc38-c711946eb154', 'volume_size': 1} Jun 24 05:04:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-8532cc53-3f5f-472d-b50a-85a99644f2aa tempest-VolumesListAdminTestJSON-2130399491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:04:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-8532cc53-3f5f-472d-b50a-85a99644f2aa tempest-VolumesListAdminTestJSON-2130399491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:04:51 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-8532cc53-3f5f-472d-b50a-85a99644f2aa tempest-VolumesListAdminTestJSON-2130399491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:04:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1656759390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f9cc2bc-e8d8-435b-bc38-c711946eb154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9745c09093b4474e96b48024fecfefa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:04:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:04:52Z,use_quota=True,user_id='1af8624917b144a689a3a82dbd3ce43d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:04:51 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-8532cc53-3f5f-472d-b50a-85a99644f2aa tempest-VolumesListAdminTestJSON-2130399491 None] Creating volume 7f9cc2bc-e8d8-435b-bc38-c711946eb154 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:04:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-8532cc53-3f5f-472d-b50a-85a99644f2aa tempest-VolumesListAdminTestJSON-2130399491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:04:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-8532cc53-3f5f-472d-b50a-85a99644f2aa tempest-VolumesListAdminTestJSON-2130399491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:04:51 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-8532cc53-3f5f-472d-b50a-85a99644f2aa tempest-VolumesListAdminTestJSON-2130399491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:04:52 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-8532cc53-3f5f-472d-b50a-85a99644f2aa tempest-VolumesListAdminTestJSON-2130399491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:04:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-8532cc53-3f5f-472d-b50a-85a99644f2aa tempest-VolumesListAdminTestJSON-2130399491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:04:52 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-8532cc53-3f5f-472d-b50a-85a99644f2aa tempest-VolumesListAdminTestJSON-2130399491 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:04:52 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-8532cc53-3f5f-472d-b50a-85a99644f2aa tempest-VolumesListAdminTestJSON-2130399491 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:04:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8532cc53-3f5f-472d-b50a-85a99644f2aa tempest-VolumesListAdminTestJSON-2130399491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7f9cc2bc-e8d8-435b-bc38-c711946eb154 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:52 devstack sudo[102661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7f9cc2bc-e8d8-435b-bc38-c711946eb154 1073741824 Jun 24 05:04:52 devstack sudo[102661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:52 devstack sudo[102661]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8532cc53-3f5f-472d-b50a-85a99644f2aa tempest-VolumesListAdminTestJSON-2130399491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7f9cc2bc-e8d8-435b-bc38-c711946eb154 1073741824" returned: 0 in 0.893s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8532cc53-3f5f-472d-b50a-85a99644f2aa tempest-VolumesListAdminTestJSON-2130399491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7f9cc2bc-e8d8-435b-bc38-c711946eb154 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:52 devstack sudo[102667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7f9cc2bc-e8d8-435b-bc38-c711946eb154 Jun 24 05:04:52 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:53 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8532cc53-3f5f-472d-b50a-85a99644f2aa tempest-VolumesListAdminTestJSON-2130399491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7f9cc2bc-e8d8-435b-bc38-c711946eb154" returned: 0 in 0.803s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:53 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-8532cc53-3f5f-472d-b50a-85a99644f2aa tempest-VolumesListAdminTestJSON-2130399491 None] <== create_volume: return (1752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:04:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-8532cc53-3f5f-472d-b50a-85a99644f2aa tempest-VolumesListAdminTestJSON-2130399491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.754s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:04:53 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8532cc53-3f5f-472d-b50a-85a99644f2aa tempest-VolumesListAdminTestJSON-2130399491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (844366c5-2c0b-4cbd-8c36-653156aba225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f9cc2bc-e8d8-435b-bc38-c711946eb154', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:53 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8532cc53-3f5f-472d-b50a-85a99644f2aa tempest-VolumesListAdminTestJSON-2130399491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58420b7d-5b8b-4d7d-a9f8-c5784bb7471a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:53 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-8532cc53-3f5f-472d-b50a-85a99644f2aa tempest-VolumesListAdminTestJSON-2130399491 None] Volume volume-7f9cc2bc-e8d8-435b-bc38-c711946eb154 (7f9cc2bc-e8d8-435b-bc38-c711946eb154): created successfully Jun 24 05:04:53 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8532cc53-3f5f-472d-b50a-85a99644f2aa tempest-VolumesListAdminTestJSON-2130399491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58420b7d-5b8b-4d7d-a9f8-c5784bb7471a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:53 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8532cc53-3f5f-472d-b50a-85a99644f2aa tempest-VolumesListAdminTestJSON-2130399491 None] Flow 'volume_create_manager' (a679aa06-4507-4077-b725-88c3b1de0275) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:04:53 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-8532cc53-3f5f-472d-b50a-85a99644f2aa tempest-VolumesListAdminTestJSON-2130399491 None] Created volume successfully. Jun 24 05:04:54 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd4b28da-a4b4-4818-adff-2c35a59f1104 tempest-VolumesListAdminTestJSON-2130399491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:04:54 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fd4b28da-a4b4-4818-adff-2c35a59f1104 tempest-VolumesListAdminTestJSON-2130399491 None] Flow 'volume_create_manager' (9a315b3a-4135-41b2-b2bc-1ca6907c3df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:04:54 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fd4b28da-a4b4-4818-adff-2c35a59f1104 tempest-VolumesListAdminTestJSON-2130399491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7432027-ab35-4c5b-8095-1cee944b15f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:54 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fd4b28da-a4b4-4818-adff-2c35a59f1104 tempest-VolumesListAdminTestJSON-2130399491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7432027-ab35-4c5b-8095-1cee944b15f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2120190557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41a515d0-1859-435e-b2f5-959e4d1d2aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9745c09093b4474e96b48024fecfefa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:04:55Z,use_quota=True,user_id='1af8624917b144a689a3a82dbd3ce43d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:54 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fd4b28da-a4b4-4818-adff-2c35a59f1104 tempest-VolumesListAdminTestJSON-2130399491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dcd80e4-d848-45cc-85d2-185c1a6debd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:54 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fd4b28da-a4b4-4818-adff-2c35a59f1104 tempest-VolumesListAdminTestJSON-2130399491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dcd80e4-d848-45cc-85d2-185c1a6debd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:54 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fd4b28da-a4b4-4818-adff-2c35a59f1104 tempest-VolumesListAdminTestJSON-2130399491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (643707d2-910f-43f5-9e5b-f8622f4fea6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:54 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fd4b28da-a4b4-4818-adff-2c35a59f1104 tempest-VolumesListAdminTestJSON-2130399491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (643707d2-910f-43f5-9e5b-f8622f4fea6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41a515d0-1859-435e-b2f5-959e4d1d2aaf', 'volume_name': 'volume-41a515d0-1859-435e-b2f5-959e4d1d2aaf', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:54 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fd4b28da-a4b4-4818-adff-2c35a59f1104 tempest-VolumesListAdminTestJSON-2130399491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37b2c744-d279-4ed1-a7a4-44c1e6cb05b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:54 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fd4b28da-a4b4-4818-adff-2c35a59f1104 tempest-VolumesListAdminTestJSON-2130399491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37b2c744-d279-4ed1-a7a4-44c1e6cb05b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:54 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fd4b28da-a4b4-4818-adff-2c35a59f1104 tempest-VolumesListAdminTestJSON-2130399491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2071b9a-3783-472b-9552-a63f7701ffad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:54 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-fd4b28da-a4b4-4818-adff-2c35a59f1104 tempest-VolumesListAdminTestJSON-2130399491 None] Volume 41a515d0-1859-435e-b2f5-959e4d1d2aaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41a515d0-1859-435e-b2f5-959e4d1d2aaf', 'volume_size': 1} Jun 24 05:04:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fd4b28da-a4b4-4818-adff-2c35a59f1104 tempest-VolumesListAdminTestJSON-2130399491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:04:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fd4b28da-a4b4-4818-adff-2c35a59f1104 tempest-VolumesListAdminTestJSON-2130399491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:04:54 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-fd4b28da-a4b4-4818-adff-2c35a59f1104 tempest-VolumesListAdminTestJSON-2130399491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2120190557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41a515d0-1859-435e-b2f5-959e4d1d2aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9745c09093b4474e96b48024fecfefa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:04:55Z,use_quota=True,user_id='1af8624917b144a689a3a82dbd3ce43d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:04:54 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-fd4b28da-a4b4-4818-adff-2c35a59f1104 tempest-VolumesListAdminTestJSON-2130399491 None] Creating volume 41a515d0-1859-435e-b2f5-959e4d1d2aaf {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:04:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fd4b28da-a4b4-4818-adff-2c35a59f1104 tempest-VolumesListAdminTestJSON-2130399491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:04:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fd4b28da-a4b4-4818-adff-2c35a59f1104 tempest-VolumesListAdminTestJSON-2130399491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:04:54 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-fd4b28da-a4b4-4818-adff-2c35a59f1104 tempest-VolumesListAdminTestJSON-2130399491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:04:54 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-fd4b28da-a4b4-4818-adff-2c35a59f1104 tempest-VolumesListAdminTestJSON-2130399491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:04:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fd4b28da-a4b4-4818-adff-2c35a59f1104 tempest-VolumesListAdminTestJSON-2130399491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:04:54 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-fd4b28da-a4b4-4818-adff-2c35a59f1104 tempest-VolumesListAdminTestJSON-2130399491 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:04:54 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-fd4b28da-a4b4-4818-adff-2c35a59f1104 tempest-VolumesListAdminTestJSON-2130399491 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:04:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fd4b28da-a4b4-4818-adff-2c35a59f1104 tempest-VolumesListAdminTestJSON-2130399491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-41a515d0-1859-435e-b2f5-959e4d1d2aaf 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:54 devstack sudo[102670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-41a515d0-1859-435e-b2f5-959e4d1d2aaf 1073741824 Jun 24 05:04:54 devstack sudo[102670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:55 devstack sudo[102670]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fd4b28da-a4b4-4818-adff-2c35a59f1104 tempest-VolumesListAdminTestJSON-2130399491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-41a515d0-1859-435e-b2f5-959e4d1d2aaf 1073741824" returned: 0 in 1.033s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:55 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:SELECT=75,cinder:INSERT=22,cinder:UPDATE=117,cinder:DELETE=14 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:04:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fd4b28da-a4b4-4818-adff-2c35a59f1104 tempest-VolumesListAdminTestJSON-2130399491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-41a515d0-1859-435e-b2f5-959e4d1d2aaf {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:55 devstack sudo[102677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-41a515d0-1859-435e-b2f5-959e4d1d2aaf Jun 24 05:04:55 devstack sudo[102677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:56 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-900bd613-2af8-4ece-ad1d-8092246c44a4 tempest-VolumesGetTest-404075134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:04:56 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-900bd613-2af8-4ece-ad1d-8092246c44a4 tempest-VolumesGetTest-404075134 None] Flow 'volume_create_manager' (e4488d76-cb02-4dc6-85f3-53f536af96d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:04:56 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-900bd613-2af8-4ece-ad1d-8092246c44a4 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b28129d-341f-4fc6-b685-e3e6e99d4ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:56 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-900bd613-2af8-4ece-ad1d-8092246c44a4 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b28129d-341f-4fc6-b685-e3e6e99d4ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1803964617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18b2cac5-18fb-4994-a027-e8e49f05c5d0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8533bbf2c191435d8768a59ae13e2d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:04:56Z,use_quota=True,user_id='0963985d5fac4d9ba5a5d45cfd0c1ace',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:56 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-900bd613-2af8-4ece-ad1d-8092246c44a4 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e033e356-1eff-4d3a-b3d6-718407f682ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:56 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-900bd613-2af8-4ece-ad1d-8092246c44a4 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e033e356-1eff-4d3a-b3d6-718407f682ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:56 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-900bd613-2af8-4ece-ad1d-8092246c44a4 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cedde9a6-25c5-4226-9c33-d9eb4efef7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:56 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-900bd613-2af8-4ece-ad1d-8092246c44a4 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cedde9a6-25c5-4226-9c33-d9eb4efef7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18b2cac5-18fb-4994-a027-e8e49f05c5d0', 'volume_name': 'volume-18b2cac5-18fb-4994-a027-e8e49f05c5d0', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:56 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-900bd613-2af8-4ece-ad1d-8092246c44a4 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (908f8b8b-5b6a-483b-a0f0-7754739a3f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:56 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-900bd613-2af8-4ece-ad1d-8092246c44a4 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (908f8b8b-5b6a-483b-a0f0-7754739a3f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:56 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-900bd613-2af8-4ece-ad1d-8092246c44a4 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (215b6e08-c877-4c15-babc-d0c86b0b80bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:56 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-900bd613-2af8-4ece-ad1d-8092246c44a4 tempest-VolumesGetTest-404075134 None] Volume 18b2cac5-18fb-4994-a027-e8e49f05c5d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18b2cac5-18fb-4994-a027-e8e49f05c5d0', 'volume_size': 1} Jun 24 05:04:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-900bd613-2af8-4ece-ad1d-8092246c44a4 tempest-VolumesGetTest-404075134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:04:56 devstack sudo[102677]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fd4b28da-a4b4-4818-adff-2c35a59f1104 tempest-VolumesListAdminTestJSON-2130399491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-41a515d0-1859-435e-b2f5-959e4d1d2aaf" returned: 0 in 0.765s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:56 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-fd4b28da-a4b4-4818-adff-2c35a59f1104 tempest-VolumesListAdminTestJSON-2130399491 None] <== create_volume: return (1867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:04:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fd4b28da-a4b4-4818-adff-2c35a59f1104 tempest-VolumesListAdminTestJSON-2130399491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.872s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:04:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-900bd613-2af8-4ece-ad1d-8092246c44a4 tempest-VolumesGetTest-404075134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.477s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:04:56 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-900bd613-2af8-4ece-ad1d-8092246c44a4 tempest-VolumesGetTest-404075134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1803964617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18b2cac5-18fb-4994-a027-e8e49f05c5d0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8533bbf2c191435d8768a59ae13e2d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:04:56Z,use_quota=True,user_id='0963985d5fac4d9ba5a5d45cfd0c1ace',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:04:56 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-900bd613-2af8-4ece-ad1d-8092246c44a4 tempest-VolumesGetTest-404075134 None] Creating volume 18b2cac5-18fb-4994-a027-e8e49f05c5d0 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:04:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-900bd613-2af8-4ece-ad1d-8092246c44a4 tempest-VolumesGetTest-404075134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:04:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-900bd613-2af8-4ece-ad1d-8092246c44a4 tempest-VolumesGetTest-404075134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:04:56 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-900bd613-2af8-4ece-ad1d-8092246c44a4 tempest-VolumesGetTest-404075134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:04:56 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-900bd613-2af8-4ece-ad1d-8092246c44a4 tempest-VolumesGetTest-404075134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:04:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-900bd613-2af8-4ece-ad1d-8092246c44a4 tempest-VolumesGetTest-404075134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:04:56 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-900bd613-2af8-4ece-ad1d-8092246c44a4 tempest-VolumesGetTest-404075134 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:04:56 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-900bd613-2af8-4ece-ad1d-8092246c44a4 tempest-VolumesGetTest-404075134 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:04:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-900bd613-2af8-4ece-ad1d-8092246c44a4 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-18b2cac5-18fb-4994-a027-e8e49f05c5d0 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:56 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fd4b28da-a4b4-4818-adff-2c35a59f1104 tempest-VolumesListAdminTestJSON-2130399491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2071b9a-3783-472b-9552-a63f7701ffad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41a515d0-1859-435e-b2f5-959e4d1d2aaf', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:56 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fd4b28da-a4b4-4818-adff-2c35a59f1104 tempest-VolumesListAdminTestJSON-2130399491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d678191-c577-4397-89a0-9f3955f72d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:56 devstack sudo[102680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-18b2cac5-18fb-4994-a027-e8e49f05c5d0 1073741824 Jun 24 05:04:56 devstack sudo[102680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:56 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-fd4b28da-a4b4-4818-adff-2c35a59f1104 tempest-VolumesListAdminTestJSON-2130399491 None] Volume volume-41a515d0-1859-435e-b2f5-959e4d1d2aaf (41a515d0-1859-435e-b2f5-959e4d1d2aaf): created successfully Jun 24 05:04:56 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fd4b28da-a4b4-4818-adff-2c35a59f1104 tempest-VolumesListAdminTestJSON-2130399491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d678191-c577-4397-89a0-9f3955f72d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:56 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fd4b28da-a4b4-4818-adff-2c35a59f1104 tempest-VolumesListAdminTestJSON-2130399491 None] Flow 'volume_create_manager' (9a315b3a-4135-41b2-b2bc-1ca6907c3df8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:04:56 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-fd4b28da-a4b4-4818-adff-2c35a59f1104 tempest-VolumesListAdminTestJSON-2130399491 None] Created volume successfully. Jun 24 05:04:57 devstack sudo[102680]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-900bd613-2af8-4ece-ad1d-8092246c44a4 tempest-VolumesGetTest-404075134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-18b2cac5-18fb-4994-a027-e8e49f05c5d0 1073741824" returned: 0 in 1.100s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-900bd613-2af8-4ece-ad1d-8092246c44a4 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-18b2cac5-18fb-4994-a027-e8e49f05c5d0 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:57 devstack sudo[102686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-18b2cac5-18fb-4994-a027-e8e49f05c5d0 Jun 24 05:04:57 devstack sudo[102686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:58 devstack sudo[102686]: pam_unix(sudo:session): session closed for user root Jun 24 05:04:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-900bd613-2af8-4ece-ad1d-8092246c44a4 tempest-VolumesGetTest-404075134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-18b2cac5-18fb-4994-a027-e8e49f05c5d0" returned: 0 in 0.815s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:04:58 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-900bd613-2af8-4ece-ad1d-8092246c44a4 tempest-VolumesGetTest-404075134 None] <== create_volume: return (1984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:04:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-900bd613-2af8-4ece-ad1d-8092246c44a4 tempest-VolumesGetTest-404075134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.988s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:04:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-900bd613-2af8-4ece-ad1d-8092246c44a4 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (215b6e08-c877-4c15-babc-d0c86b0b80bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18b2cac5-18fb-4994-a027-e8e49f05c5d0', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-900bd613-2af8-4ece-ad1d-8092246c44a4 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a842bc6-1b7c-4e09-9b47-ac324a9c65dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:58 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-900bd613-2af8-4ece-ad1d-8092246c44a4 tempest-VolumesGetTest-404075134 None] Volume volume-18b2cac5-18fb-4994-a027-e8e49f05c5d0 (18b2cac5-18fb-4994-a027-e8e49f05c5d0): created successfully Jun 24 05:04:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-900bd613-2af8-4ece-ad1d-8092246c44a4 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a842bc6-1b7c-4e09-9b47-ac324a9c65dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-900bd613-2af8-4ece-ad1d-8092246c44a4 tempest-VolumesGetTest-404075134 None] Flow 'volume_create_manager' (e4488d76-cb02-4dc6-85f3-53f536af96d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:04:58 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-900bd613-2af8-4ece-ad1d-8092246c44a4 tempest-VolumesGetTest-404075134 None] Created volume successfully. Jun 24 05:04:58 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3c8cb58-14ab-4ecd-ad3d-f912cc1c5d14 tempest-VolumesListAdminTestJSON-1386067523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:04:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e3c8cb58-14ab-4ecd-ad3d-f912cc1c5d14 tempest-VolumesListAdminTestJSON-1386067523 None] Flow 'volume_create_manager' (cb03a0fe-bbf5-4663-8fc8-2d91141afe82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:04:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e3c8cb58-14ab-4ecd-ad3d-f912cc1c5d14 tempest-VolumesListAdminTestJSON-1386067523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8530e621-a4f6-4c8b-a7c8-6ab72c77bac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e3c8cb58-14ab-4ecd-ad3d-f912cc1c5d14 tempest-VolumesListAdminTestJSON-1386067523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8530e621-a4f6-4c8b-a7c8-6ab72c77bac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cd0e043-b381-407e-8d13-b4bd8512b43e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f33fa8a63b44fba871df270af2f67e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:04:59Z,use_quota=True,user_id='e9505e47df39424983c5c3f6c568eb7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e3c8cb58-14ab-4ecd-ad3d-f912cc1c5d14 tempest-VolumesListAdminTestJSON-1386067523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae3c67f5-7248-4b0b-a521-3f3c0aba341b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e3c8cb58-14ab-4ecd-ad3d-f912cc1c5d14 tempest-VolumesListAdminTestJSON-1386067523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae3c67f5-7248-4b0b-a521-3f3c0aba341b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e3c8cb58-14ab-4ecd-ad3d-f912cc1c5d14 tempest-VolumesListAdminTestJSON-1386067523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (968aab79-35cc-484b-8ec4-ae3d8d67b392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e3c8cb58-14ab-4ecd-ad3d-f912cc1c5d14 tempest-VolumesListAdminTestJSON-1386067523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (968aab79-35cc-484b-8ec4-ae3d8d67b392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cd0e043-b381-407e-8d13-b4bd8512b43e', 'volume_name': 'volume-7cd0e043-b381-407e-8d13-b4bd8512b43e', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e3c8cb58-14ab-4ecd-ad3d-f912cc1c5d14 tempest-VolumesListAdminTestJSON-1386067523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3683346-5634-473c-bd71-9ae66ce307c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:59 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e3c8cb58-14ab-4ecd-ad3d-f912cc1c5d14 tempest-VolumesListAdminTestJSON-1386067523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3683346-5634-473c-bd71-9ae66ce307c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:04:59 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e3c8cb58-14ab-4ecd-ad3d-f912cc1c5d14 tempest-VolumesListAdminTestJSON-1386067523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b879d2f-0be2-42b2-8a70-a65252bc7ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:04:59 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-e3c8cb58-14ab-4ecd-ad3d-f912cc1c5d14 tempest-VolumesListAdminTestJSON-1386067523 None] Volume 7cd0e043-b381-407e-8d13-b4bd8512b43e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cd0e043-b381-407e-8d13-b4bd8512b43e', 'volume_size': 1} Jun 24 05:04:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e3c8cb58-14ab-4ecd-ad3d-f912cc1c5d14 tempest-VolumesListAdminTestJSON-1386067523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:04:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e3c8cb58-14ab-4ecd-ad3d-f912cc1c5d14 tempest-VolumesListAdminTestJSON-1386067523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:04:59 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e3c8cb58-14ab-4ecd-ad3d-f912cc1c5d14 tempest-VolumesListAdminTestJSON-1386067523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cd0e043-b381-407e-8d13-b4bd8512b43e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f33fa8a63b44fba871df270af2f67e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:04:59Z,use_quota=True,user_id='e9505e47df39424983c5c3f6c568eb7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:04:59 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-e3c8cb58-14ab-4ecd-ad3d-f912cc1c5d14 tempest-VolumesListAdminTestJSON-1386067523 None] Creating volume 7cd0e043-b381-407e-8d13-b4bd8512b43e {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:04:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e3c8cb58-14ab-4ecd-ad3d-f912cc1c5d14 tempest-VolumesListAdminTestJSON-1386067523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:04:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e3c8cb58-14ab-4ecd-ad3d-f912cc1c5d14 tempest-VolumesListAdminTestJSON-1386067523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:04:59 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e3c8cb58-14ab-4ecd-ad3d-f912cc1c5d14 tempest-VolumesListAdminTestJSON-1386067523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:04:59 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e3c8cb58-14ab-4ecd-ad3d-f912cc1c5d14 tempest-VolumesListAdminTestJSON-1386067523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:04:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e3c8cb58-14ab-4ecd-ad3d-f912cc1c5d14 tempest-VolumesListAdminTestJSON-1386067523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:04:59 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e3c8cb58-14ab-4ecd-ad3d-f912cc1c5d14 tempest-VolumesListAdminTestJSON-1386067523 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:04:59 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-e3c8cb58-14ab-4ecd-ad3d-f912cc1c5d14 tempest-VolumesListAdminTestJSON-1386067523 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:04:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e3c8cb58-14ab-4ecd-ad3d-f912cc1c5d14 tempest-VolumesListAdminTestJSON-1386067523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7cd0e043-b381-407e-8d13-b4bd8512b43e 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:04:59 devstack sudo[102690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7cd0e043-b381-407e-8d13-b4bd8512b43e 1073741824 Jun 24 05:04:59 devstack sudo[102690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:04:59 devstack sudo[102690]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e3c8cb58-14ab-4ecd-ad3d-f912cc1c5d14 tempest-VolumesListAdminTestJSON-1386067523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7cd0e043-b381-407e-8d13-b4bd8512b43e 1073741824" returned: 0 in 0.979s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e3c8cb58-14ab-4ecd-ad3d-f912cc1c5d14 tempest-VolumesListAdminTestJSON-1386067523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7cd0e043-b381-407e-8d13-b4bd8512b43e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:00 devstack sudo[102697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7cd0e043-b381-407e-8d13-b4bd8512b43e Jun 24 05:05:00 devstack sudo[102697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:00 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-bec5bd15-a85c-4240-9d1a-c556471fe06e tempest-VolumesGetTest-404075134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:05:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-bec5bd15-a85c-4240-9d1a-c556471fe06e tempest-VolumesGetTest-404075134 None] Flow 'volume_create_manager' (64527851-6e66-434e-a3e2-e46f5fe3db6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:05:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-bec5bd15-a85c-4240-9d1a-c556471fe06e tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (320b4927-2399-4ec7-85fa-e85829ecf6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-bec5bd15-a85c-4240-9d1a-c556471fe06e tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (320b4927-2399-4ec7-85fa-e85829ecf6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:05:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-292912284',display_name='tempest-VolumesGetTest-Volume-736884095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bef87f67-1f1b-4461-bbf2-3a1c6f649325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8533bbf2c191435d8768a59ae13e2d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:05:00Z,use_quota=True,user_id='0963985d5fac4d9ba5a5d45cfd0c1ace',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-bec5bd15-a85c-4240-9d1a-c556471fe06e tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fea9f358-8c28-431b-bdb1-3ea8a417290e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-bec5bd15-a85c-4240-9d1a-c556471fe06e tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fea9f358-8c28-431b-bdb1-3ea8a417290e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-bec5bd15-a85c-4240-9d1a-c556471fe06e tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b10cc11-a58b-4422-963d-cbbc7daf5e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-bec5bd15-a85c-4240-9d1a-c556471fe06e tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b10cc11-a58b-4422-963d-cbbc7daf5e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bef87f67-1f1b-4461-bbf2-3a1c6f649325', 'volume_name': 'volume-bef87f67-1f1b-4461-bbf2-3a1c6f649325', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-bec5bd15-a85c-4240-9d1a-c556471fe06e tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c713171-d1b5-407a-b87d-d3b59a83bb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-bec5bd15-a85c-4240-9d1a-c556471fe06e tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c713171-d1b5-407a-b87d-d3b59a83bb95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-bec5bd15-a85c-4240-9d1a-c556471fe06e tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42050d79-4430-4226-806e-5f3f78914ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:00 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-bec5bd15-a85c-4240-9d1a-c556471fe06e tempest-VolumesGetTest-404075134 None] Volume bef87f67-1f1b-4461-bbf2-3a1c6f649325: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bef87f67-1f1b-4461-bbf2-3a1c6f649325', 'volume_size': 1} Jun 24 05:05:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-bec5bd15-a85c-4240-9d1a-c556471fe06e tempest-VolumesGetTest-404075134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:05:00 devstack sudo[102697]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e3c8cb58-14ab-4ecd-ad3d-f912cc1c5d14 tempest-VolumesListAdminTestJSON-1386067523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7cd0e043-b381-407e-8d13-b4bd8512b43e" returned: 0 in 0.688s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:00 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e3c8cb58-14ab-4ecd-ad3d-f912cc1c5d14 tempest-VolumesListAdminTestJSON-1386067523 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:05:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e3c8cb58-14ab-4ecd-ad3d-f912cc1c5d14 tempest-VolumesListAdminTestJSON-1386067523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:05:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-bec5bd15-a85c-4240-9d1a-c556471fe06e tempest-VolumesGetTest-404075134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.399s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:05:00 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-bec5bd15-a85c-4240-9d1a-c556471fe06e tempest-VolumesGetTest-404075134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:05:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-292912284',display_name='tempest-VolumesGetTest-Volume-736884095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bef87f67-1f1b-4461-bbf2-3a1c6f649325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8533bbf2c191435d8768a59ae13e2d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:05:00Z,use_quota=True,user_id='0963985d5fac4d9ba5a5d45cfd0c1ace',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:05:00 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-bec5bd15-a85c-4240-9d1a-c556471fe06e tempest-VolumesGetTest-404075134 None] Creating volume bef87f67-1f1b-4461-bbf2-3a1c6f649325 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:05:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-bec5bd15-a85c-4240-9d1a-c556471fe06e tempest-VolumesGetTest-404075134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:05:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-bec5bd15-a85c-4240-9d1a-c556471fe06e tempest-VolumesGetTest-404075134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:05:00 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-bec5bd15-a85c-4240-9d1a-c556471fe06e tempest-VolumesGetTest-404075134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:05:00 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-bec5bd15-a85c-4240-9d1a-c556471fe06e tempest-VolumesGetTest-404075134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:05:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-bec5bd15-a85c-4240-9d1a-c556471fe06e tempest-VolumesGetTest-404075134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:05:00 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-bec5bd15-a85c-4240-9d1a-c556471fe06e tempest-VolumesGetTest-404075134 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:05:00 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-bec5bd15-a85c-4240-9d1a-c556471fe06e tempest-VolumesGetTest-404075134 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:05:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-bec5bd15-a85c-4240-9d1a-c556471fe06e tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bef87f67-1f1b-4461-bbf2-3a1c6f649325 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:00 devstack sudo[102700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bef87f67-1f1b-4461-bbf2-3a1c6f649325 1073741824 Jun 24 05:05:00 devstack sudo[102700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e3c8cb58-14ab-4ecd-ad3d-f912cc1c5d14 tempest-VolumesListAdminTestJSON-1386067523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b879d2f-0be2-42b2-8a70-a65252bc7ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cd0e043-b381-407e-8d13-b4bd8512b43e', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e3c8cb58-14ab-4ecd-ad3d-f912cc1c5d14 tempest-VolumesListAdminTestJSON-1386067523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37577e80-15ee-45d6-9ea4-fe450371596f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:00 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-e3c8cb58-14ab-4ecd-ad3d-f912cc1c5d14 tempest-VolumesListAdminTestJSON-1386067523 None] Volume volume-7cd0e043-b381-407e-8d13-b4bd8512b43e (7cd0e043-b381-407e-8d13-b4bd8512b43e): created successfully Jun 24 05:05:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e3c8cb58-14ab-4ecd-ad3d-f912cc1c5d14 tempest-VolumesListAdminTestJSON-1386067523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37577e80-15ee-45d6-9ea4-fe450371596f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e3c8cb58-14ab-4ecd-ad3d-f912cc1c5d14 tempest-VolumesListAdminTestJSON-1386067523 None] Flow 'volume_create_manager' (cb03a0fe-bbf5-4663-8fc8-2d91141afe82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:05:00 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-e3c8cb58-14ab-4ecd-ad3d-f912cc1c5d14 tempest-VolumesListAdminTestJSON-1386067523 None] Created volume successfully. Jun 24 05:05:01 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-20c47327-81a0-409d-af94-ccbc47c2f609 tempest-VolumesListAdminTestJSON-1386067523 None] Acquiring lock "cinder-7cd0e043-b381-407e-8d13-b4bd8512b43e-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:05:01 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-20c47327-81a0-409d-af94-ccbc47c2f609 tempest-VolumesListAdminTestJSON-1386067523 None] Lock "cinder-7cd0e043-b381-407e-8d13-b4bd8512b43e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:05:01 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-20c47327-81a0-409d-af94-ccbc47c2f609 tempest-VolumesListAdminTestJSON-1386067523 None] Acquiring lock "cinder-quobyte-7cd0e043-b381-407e-8d13-b4bd8512b43e" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:05:01 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-20c47327-81a0-409d-af94-ccbc47c2f609 tempest-VolumesListAdminTestJSON-1386067523 None] Lock "cinder-quobyte-7cd0e043-b381-407e-8d13-b4bd8512b43e" acquired by "delete_volume" :: waited 0.024s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:05:01 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f971ecb-29cd-44ac-97e3-5eaed252cca6]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:05:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-20c47327-81a0-409d-af94-ccbc47c2f609 tempest-VolumesListAdminTestJSON-1386067523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7cd0e043-b381-407e-8d13-b4bd8512b43e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:01 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9a6a87f0-a282-43aa-9370-b917c98f49bc tempest-VolumesListAdminTestJSON-2130399491 None] Acquiring lock "cinder-41a515d0-1859-435e-b2f5-959e4d1d2aaf-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:05:01 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9a6a87f0-a282-43aa-9370-b917c98f49bc tempest-VolumesListAdminTestJSON-2130399491 None] Lock "cinder-41a515d0-1859-435e-b2f5-959e4d1d2aaf-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:05:01 devstack sudo[102702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7cd0e043-b381-407e-8d13-b4bd8512b43e Jun 24 05:05:01 devstack sudo[102702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:01 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9a6a87f0-a282-43aa-9370-b917c98f49bc tempest-VolumesListAdminTestJSON-2130399491 None] Acquiring lock "cinder-quobyte-41a515d0-1859-435e-b2f5-959e4d1d2aaf" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:05:01 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9a6a87f0-a282-43aa-9370-b917c98f49bc tempest-VolumesListAdminTestJSON-2130399491 None] Lock "cinder-quobyte-41a515d0-1859-435e-b2f5-959e4d1d2aaf" acquired by "delete_volume" :: waited 0.034s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:05:01 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[5786aad5-c807-4c35-900f-300f5881ec62]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:05:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9a6a87f0-a282-43aa-9370-b917c98f49bc tempest-VolumesListAdminTestJSON-2130399491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-41a515d0-1859-435e-b2f5-959e4d1d2aaf {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:01 devstack sudo[102711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-41a515d0-1859-435e-b2f5-959e4d1d2aaf Jun 24 05:05:01 devstack sudo[102711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:01 devstack sudo[102700]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-bec5bd15-a85c-4240-9d1a-c556471fe06e tempest-VolumesGetTest-404075134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bef87f67-1f1b-4461-bbf2-3a1c6f649325 1073741824" returned: 0 in 1.103s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-bec5bd15-a85c-4240-9d1a-c556471fe06e tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bef87f67-1f1b-4461-bbf2-3a1c6f649325 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:01 devstack sudo[102713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bef87f67-1f1b-4461-bbf2-3a1c6f649325 Jun 24 05:05:01 devstack sudo[102713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:02 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-1aba2df9-1cea-4c0c-b49f-c54aa9a7820b tempest-GroupSnapshotsV319Test-694389268 None] Group tempest-GroupSnapshotsV319Test-Group-1999296608: creating Jun 24 05:05:02 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-1aba2df9-1cea-4c0c-b49f-c54aa9a7820b tempest-GroupSnapshotsV319Test-694389268 None] Group tempest-GroupSnapshotsV319Test-Group-1999296608: created successfully Jun 24 05:05:02 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-1aba2df9-1cea-4c0c-b49f-c54aa9a7820b tempest-GroupSnapshotsV319Test-694389268 None] Create group completed successfully. Jun 24 05:05:02 devstack sudo[102702]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-20c47327-81a0-409d-af94-ccbc47c2f609 tempest-VolumesListAdminTestJSON-1386067523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7cd0e043-b381-407e-8d13-b4bd8512b43e" returned: 0 in 1.003s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-20c47327-81a0-409d-af94-ccbc47c2f609 tempest-VolumesListAdminTestJSON-1386067523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7cd0e043-b381-407e-8d13-b4bd8512b43e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:02 devstack sudo[102718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7cd0e043-b381-407e-8d13-b4bd8512b43e Jun 24 05:05:02 devstack sudo[102718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:02 devstack sudo[102711]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9a6a87f0-a282-43aa-9370-b917c98f49bc tempest-VolumesListAdminTestJSON-2130399491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-41a515d0-1859-435e-b2f5-959e4d1d2aaf" returned: 0 in 0.915s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9a6a87f0-a282-43aa-9370-b917c98f49bc tempest-VolumesListAdminTestJSON-2130399491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-41a515d0-1859-435e-b2f5-959e4d1d2aaf {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:02 devstack sudo[102724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-41a515d0-1859-435e-b2f5-959e4d1d2aaf Jun 24 05:05:02 devstack sudo[102724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:02 devstack sudo[102713]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-bec5bd15-a85c-4240-9d1a-c556471fe06e tempest-VolumesGetTest-404075134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bef87f67-1f1b-4461-bbf2-3a1c6f649325" returned: 0 in 0.744s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:02 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-bec5bd15-a85c-4240-9d1a-c556471fe06e tempest-VolumesGetTest-404075134 None] <== create_volume: return (1900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:05:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-bec5bd15-a85c-4240-9d1a-c556471fe06e tempest-VolumesGetTest-404075134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.903s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:05:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-bec5bd15-a85c-4240-9d1a-c556471fe06e tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42050d79-4430-4226-806e-5f3f78914ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bef87f67-1f1b-4461-bbf2-3a1c6f649325', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-bec5bd15-a85c-4240-9d1a-c556471fe06e tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9746c52-75cb-4f97-a011-f911d1108cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:02 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-bec5bd15-a85c-4240-9d1a-c556471fe06e tempest-VolumesGetTest-404075134 None] Volume volume-bef87f67-1f1b-4461-bbf2-3a1c6f649325 (bef87f67-1f1b-4461-bbf2-3a1c6f649325): created successfully Jun 24 05:05:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-bec5bd15-a85c-4240-9d1a-c556471fe06e tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9746c52-75cb-4f97-a011-f911d1108cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-bec5bd15-a85c-4240-9d1a-c556471fe06e tempest-VolumesGetTest-404075134 None] Flow 'volume_create_manager' (64527851-6e66-434e-a3e2-e46f5fe3db6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:05:02 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-bec5bd15-a85c-4240-9d1a-c556471fe06e tempest-VolumesGetTest-404075134 None] Created volume successfully. Jun 24 05:05:02 devstack sudo[102718]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-20c47327-81a0-409d-af94-ccbc47c2f609 tempest-VolumesListAdminTestJSON-1386067523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7cd0e043-b381-407e-8d13-b4bd8512b43e" returned: 0 in 0.694s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:02 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-20c47327-81a0-409d-af94-ccbc47c2f609 tempest-VolumesListAdminTestJSON-1386067523 None] Lock "cinder-quobyte-7cd0e043-b381-407e-8d13-b4bd8512b43e" released by "delete_volume" :: held 1.757s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:05:03 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-20c47327-81a0-409d-af94-ccbc47c2f609 tempest-VolumesListAdminTestJSON-1386067523 None] Created reservations ['1002fdf4-a982-433f-bc87-ac70460796b4', '42d2e12b-3492-4696-9738-11ffcf8fe4be', '61ccad3c-d4d6-4851-964f-c1b1c9b4d31b', '68ffbe71-006f-42b8-8b24-7e91005a96a5'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:05:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-20c47327-81a0-409d-af94-ccbc47c2f609 tempest-VolumesListAdminTestJSON-1386067523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:05:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-20c47327-81a0-409d-af94-ccbc47c2f609 tempest-VolumesListAdminTestJSON-1386067523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:05:03 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-20c47327-81a0-409d-af94-ccbc47c2f609 tempest-VolumesListAdminTestJSON-1386067523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:05:03 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-20c47327-81a0-409d-af94-ccbc47c2f609 tempest-VolumesListAdminTestJSON-1386067523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:05:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-20c47327-81a0-409d-af94-ccbc47c2f609 tempest-VolumesListAdminTestJSON-1386067523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:05:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-20c47327-81a0-409d-af94-ccbc47c2f609 tempest-VolumesListAdminTestJSON-1386067523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:03 devstack sudo[102729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:05:03 devstack sudo[102729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:03 devstack sudo[102724]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9a6a87f0-a282-43aa-9370-b917c98f49bc tempest-VolumesListAdminTestJSON-2130399491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-41a515d0-1859-435e-b2f5-959e4d1d2aaf" returned: 0 in 0.723s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:03 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9a6a87f0-a282-43aa-9370-b917c98f49bc tempest-VolumesListAdminTestJSON-2130399491 None] Lock "cinder-quobyte-41a515d0-1859-435e-b2f5-959e4d1d2aaf" released by "delete_volume" :: held 1.700s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:05:03 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-9a6a87f0-a282-43aa-9370-b917c98f49bc tempest-VolumesListAdminTestJSON-2130399491 None] Created reservations ['16147e6f-7d47-4277-8dc5-26958ff951aa', '34fdc9e2-9433-421d-b843-f19b0fe46e4d', '07d3fc03-8b1b-4e59-9e39-13d10f2cea04', '477064c9-ccad-41e6-a7fa-118be577e4d7'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:05:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9a6a87f0-a282-43aa-9370-b917c98f49bc tempest-VolumesListAdminTestJSON-2130399491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:05:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9a6a87f0-a282-43aa-9370-b917c98f49bc tempest-VolumesListAdminTestJSON-2130399491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:05:03 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-9a6a87f0-a282-43aa-9370-b917c98f49bc tempest-VolumesListAdminTestJSON-2130399491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:05:03 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-9a6a87f0-a282-43aa-9370-b917c98f49bc tempest-VolumesListAdminTestJSON-2130399491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:05:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9a6a87f0-a282-43aa-9370-b917c98f49bc tempest-VolumesListAdminTestJSON-2130399491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:05:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9a6a87f0-a282-43aa-9370-b917c98f49bc tempest-VolumesListAdminTestJSON-2130399491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:03 devstack sudo[102732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:05:03 devstack sudo[102732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:03 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9c4f7a1-4c79-4779-b2a3-e9b66f62ec33 tempest-AttachVolumeNegativeTest-111486486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:05:03 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a9c4f7a1-4c79-4779-b2a3-e9b66f62ec33 tempest-AttachVolumeNegativeTest-111486486 None] Flow 'volume_create_manager' (5780dd6a-7834-4014-a5d0-22e3e04e3039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:05:03 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a9c4f7a1-4c79-4779-b2a3-e9b66f62ec33 tempest-AttachVolumeNegativeTest-111486486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c44d673-9cf0-4019-bee8-5b0ec1cb79a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:03 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-2bab474c-2bb5-4807-b763-affffc47dae4 tempest-VolumesGetTest-404075134 None] Acquiring lock "cinder-bef87f67-1f1b-4461-bbf2-3a1c6f649325-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:05:03 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a9c4f7a1-4c79-4779-b2a3-e9b66f62ec33 tempest-AttachVolumeNegativeTest-111486486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c44d673-9cf0-4019-bee8-5b0ec1cb79a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-518433181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cdb0dac-f29e-4078-b34e-3795072f4fd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d469e3abf0c849f59a9e06ca7b031d96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:05:04Z,use_quota=True,user_id='cea5c21618c24cd2aded0d3bbef0fd8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:03 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a9c4f7a1-4c79-4779-b2a3-e9b66f62ec33 tempest-AttachVolumeNegativeTest-111486486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10aff529-a6d6-4bc6-99a1-a177b9c1c638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:03 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a9c4f7a1-4c79-4779-b2a3-e9b66f62ec33 tempest-AttachVolumeNegativeTest-111486486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10aff529-a6d6-4bc6-99a1-a177b9c1c638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:03 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a9c4f7a1-4c79-4779-b2a3-e9b66f62ec33 tempest-AttachVolumeNegativeTest-111486486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02d62073-3164-4106-938b-11c6bf0f70db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:03 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a9c4f7a1-4c79-4779-b2a3-e9b66f62ec33 tempest-AttachVolumeNegativeTest-111486486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02d62073-3164-4106-938b-11c6bf0f70db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cdb0dac-f29e-4078-b34e-3795072f4fd8', 'volume_name': 'volume-5cdb0dac-f29e-4078-b34e-3795072f4fd8', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:03 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a9c4f7a1-4c79-4779-b2a3-e9b66f62ec33 tempest-AttachVolumeNegativeTest-111486486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e011564d-3d72-404c-8771-c8e7b623460e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:03 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a9c4f7a1-4c79-4779-b2a3-e9b66f62ec33 tempest-AttachVolumeNegativeTest-111486486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e011564d-3d72-404c-8771-c8e7b623460e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:03 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a9c4f7a1-4c79-4779-b2a3-e9b66f62ec33 tempest-AttachVolumeNegativeTest-111486486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e767db04-0ce5-4195-b0af-6bbe26b6223e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:03 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-a9c4f7a1-4c79-4779-b2a3-e9b66f62ec33 tempest-AttachVolumeNegativeTest-111486486 None] Volume 5cdb0dac-f29e-4078-b34e-3795072f4fd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cdb0dac-f29e-4078-b34e-3795072f4fd8', 'volume_size': 1} Jun 24 05:05:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a9c4f7a1-4c79-4779-b2a3-e9b66f62ec33 tempest-AttachVolumeNegativeTest-111486486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:05:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a9c4f7a1-4c79-4779-b2a3-e9b66f62ec33 tempest-AttachVolumeNegativeTest-111486486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:05:03 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a9c4f7a1-4c79-4779-b2a3-e9b66f62ec33 tempest-AttachVolumeNegativeTest-111486486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-518433181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cdb0dac-f29e-4078-b34e-3795072f4fd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d469e3abf0c849f59a9e06ca7b031d96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:05:04Z,use_quota=True,user_id='cea5c21618c24cd2aded0d3bbef0fd8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:05:03 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-a9c4f7a1-4c79-4779-b2a3-e9b66f62ec33 tempest-AttachVolumeNegativeTest-111486486 None] Creating volume 5cdb0dac-f29e-4078-b34e-3795072f4fd8 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:05:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a9c4f7a1-4c79-4779-b2a3-e9b66f62ec33 tempest-AttachVolumeNegativeTest-111486486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:05:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a9c4f7a1-4c79-4779-b2a3-e9b66f62ec33 tempest-AttachVolumeNegativeTest-111486486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:05:03 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a9c4f7a1-4c79-4779-b2a3-e9b66f62ec33 tempest-AttachVolumeNegativeTest-111486486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:05:04 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a9c4f7a1-4c79-4779-b2a3-e9b66f62ec33 tempest-AttachVolumeNegativeTest-111486486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:05:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a9c4f7a1-4c79-4779-b2a3-e9b66f62ec33 tempest-AttachVolumeNegativeTest-111486486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:05:04 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a9c4f7a1-4c79-4779-b2a3-e9b66f62ec33 tempest-AttachVolumeNegativeTest-111486486 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:05:04 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-a9c4f7a1-4c79-4779-b2a3-e9b66f62ec33 tempest-AttachVolumeNegativeTest-111486486 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:05:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a9c4f7a1-4c79-4779-b2a3-e9b66f62ec33 tempest-AttachVolumeNegativeTest-111486486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-5cdb0dac-f29e-4078-b34e-3795072f4fd8 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:04 devstack sudo[102729]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:04 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-2bab474c-2bb5-4807-b763-affffc47dae4 tempest-VolumesGetTest-404075134 None] Lock "cinder-bef87f67-1f1b-4461-bbf2-3a1c6f649325-delete_volume" acquired by "delete_volume" :: waited 0.185s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:05:04 devstack sudo[102741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-5cdb0dac-f29e-4078-b34e-3795072f4fd8 1073741824 Jun 24 05:05:04 devstack sudo[102741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-20c47327-81a0-409d-af94-ccbc47c2f609 tempest-VolumesListAdminTestJSON-1386067523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.960s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:04 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-20c47327-81a0-409d-af94-ccbc47c2f609 tempest-VolumesListAdminTestJSON-1386067523 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:05:04 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-20c47327-81a0-409d-af94-ccbc47c2f609 tempest-VolumesListAdminTestJSON-1386067523 None] Deleted volume successfully. Jun 24 05:05:04 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-1c66f186-c780-48a2-a4a7-d417d46c5a24 tempest-VolumesListAdminTestJSON-2130399491 None] Acquiring lock "cinder-7f9cc2bc-e8d8-435b-bc38-c711946eb154-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:05:04 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-2bab474c-2bb5-4807-b763-affffc47dae4 tempest-VolumesGetTest-404075134 None] Acquiring lock "cinder-quobyte-bef87f67-1f1b-4461-bbf2-3a1c6f649325" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:05:04 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-20c47327-81a0-409d-af94-ccbc47c2f609 tempest-VolumesListAdminTestJSON-1386067523 None] Lock "cinder-7cd0e043-b381-407e-8d13-b4bd8512b43e-delete_volume" released by "delete_volume" :: held 3.040s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:05:04 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-2bab474c-2bb5-4807-b763-affffc47dae4 tempest-VolumesGetTest-404075134 None] Lock "cinder-quobyte-bef87f67-1f1b-4461-bbf2-3a1c6f649325" acquired by "delete_volume" :: waited 0.060s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:05:04 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-1c66f186-c780-48a2-a4a7-d417d46c5a24 tempest-VolumesListAdminTestJSON-2130399491 None] Lock "cinder-7f9cc2bc-e8d8-435b-bc38-c711946eb154-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:05:04 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb921554-762b-4a69-8652-1a308b45db2d tempest-GroupSnapshotsV319Test-694389268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:05:04 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cb921554-762b-4a69-8652-1a308b45db2d tempest-GroupSnapshotsV319Test-694389268 None] Flow 'volume_create_manager' (ebc5bdf1-b17c-415f-a2eb-83b47460de61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:05:04 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cb921554-762b-4a69-8652-1a308b45db2d tempest-GroupSnapshotsV319Test-694389268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15bd6492-f9dd-465a-a8e7-8209d2bab361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:04 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15a12fc-5a8f-4b91-9504-a15bc0a5ce86]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:05:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2bab474c-2bb5-4807-b763-affffc47dae4 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bef87f67-1f1b-4461-bbf2-3a1c6f649325 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:04 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cb921554-762b-4a69-8652-1a308b45db2d tempest-GroupSnapshotsV319Test-694389268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15bd6492-f9dd-465a-a8e7-8209d2bab361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-708467875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b235a447-d251-48ca-8f6a-070759d5e83b,host='devstack@QuobyteHD#QuobyteHD',id=15d3da9b-21dd-40c2-a031-7bddc3a79f7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b34ce0e000a46bdb10ea8fcb948394c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:05:04Z,use_quota=True,user_id='bbc6b0a449c041e4a986a406aeffd51f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f29a02fd-834a-47f4-8f5a-a02b75617107),volume_type_id=f29a02fd-834a-47f4-8f5a-a02b75617107)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:04 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cb921554-762b-4a69-8652-1a308b45db2d tempest-GroupSnapshotsV319Test-694389268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eae30bd9-21cd-4ce5-b443-f5e5fb4502d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:04 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cb921554-762b-4a69-8652-1a308b45db2d tempest-GroupSnapshotsV319Test-694389268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eae30bd9-21cd-4ce5-b443-f5e5fb4502d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:04 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cb921554-762b-4a69-8652-1a308b45db2d tempest-GroupSnapshotsV319Test-694389268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (612ad884-a7dc-4412-bfb6-d98d34d37d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:04 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cb921554-762b-4a69-8652-1a308b45db2d tempest-GroupSnapshotsV319Test-694389268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (612ad884-a7dc-4412-bfb6-d98d34d37d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15d3da9b-21dd-40c2-a031-7bddc3a79f7a', 'volume_name': 'volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:04 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cb921554-762b-4a69-8652-1a308b45db2d tempest-GroupSnapshotsV319Test-694389268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d90e0f8-1758-462c-9c62-616a08a01545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:04 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cb921554-762b-4a69-8652-1a308b45db2d tempest-GroupSnapshotsV319Test-694389268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d90e0f8-1758-462c-9c62-616a08a01545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:04 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cb921554-762b-4a69-8652-1a308b45db2d tempest-GroupSnapshotsV319Test-694389268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7618b9ae-12d0-4425-97fe-8d06cd762fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:04 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-cb921554-762b-4a69-8652-1a308b45db2d tempest-GroupSnapshotsV319Test-694389268 None] Volume 15d3da9b-21dd-40c2-a031-7bddc3a79f7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a', 'volume_size': 1} Jun 24 05:05:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-cb921554-762b-4a69-8652-1a308b45db2d tempest-GroupSnapshotsV319Test-694389268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:05:04 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-1c66f186-c780-48a2-a4a7-d417d46c5a24 tempest-VolumesListAdminTestJSON-2130399491 None] Acquiring lock "cinder-quobyte-7f9cc2bc-e8d8-435b-bc38-c711946eb154" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:05:04 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-1c66f186-c780-48a2-a4a7-d417d46c5a24 tempest-VolumesListAdminTestJSON-2130399491 None] Lock "cinder-quobyte-7f9cc2bc-e8d8-435b-bc38-c711946eb154" acquired by "delete_volume" :: waited 0.027s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:05:04 devstack sudo[102743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bef87f67-1f1b-4461-bbf2-3a1c6f649325 Jun 24 05:05:04 devstack sudo[102743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:04 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[7812d634-d01b-4c94-bd08-e7ba17c99bc9]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:05:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1c66f186-c780-48a2-a4a7-d417d46c5a24 tempest-VolumesListAdminTestJSON-2130399491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7f9cc2bc-e8d8-435b-bc38-c711946eb154 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:04 devstack sudo[102732]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9a6a87f0-a282-43aa-9370-b917c98f49bc tempest-VolumesListAdminTestJSON-2130399491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 1.029s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:04 devstack sudo[102746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7f9cc2bc-e8d8-435b-bc38-c711946eb154 Jun 24 05:05:04 devstack sudo[102746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:04 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-9a6a87f0-a282-43aa-9370-b917c98f49bc tempest-VolumesListAdminTestJSON-2130399491 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:05:04 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-9a6a87f0-a282-43aa-9370-b917c98f49bc tempest-VolumesListAdminTestJSON-2130399491 None] Deleted volume successfully. Jun 24 05:05:04 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9a6a87f0-a282-43aa-9370-b917c98f49bc tempest-VolumesListAdminTestJSON-2130399491 None] Lock "cinder-41a515d0-1859-435e-b2f5-959e4d1d2aaf-delete_volume" released by "delete_volume" :: held 3.165s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:05:05 devstack sudo[102741]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a9c4f7a1-4c79-4779-b2a3-e9b66f62ec33 tempest-AttachVolumeNegativeTest-111486486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-5cdb0dac-f29e-4078-b34e-3795072f4fd8 1073741824" returned: 0 in 1.061s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a9c4f7a1-4c79-4779-b2a3-e9b66f62ec33 tempest-AttachVolumeNegativeTest-111486486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-5cdb0dac-f29e-4078-b34e-3795072f4fd8 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:05 devstack sudo[102754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-5cdb0dac-f29e-4078-b34e-3795072f4fd8 Jun 24 05:05:05 devstack sudo[102754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:05 devstack sudo[102743]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2bab474c-2bb5-4807-b763-affffc47dae4 tempest-VolumesGetTest-404075134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bef87f67-1f1b-4461-bbf2-3a1c6f649325" returned: 0 in 0.936s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2bab474c-2bb5-4807-b763-affffc47dae4 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bef87f67-1f1b-4461-bbf2-3a1c6f649325 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:05 devstack sudo[102759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bef87f67-1f1b-4461-bbf2-3a1c6f649325 Jun 24 05:05:05 devstack sudo[102759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:05 devstack sudo[102746]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1c66f186-c780-48a2-a4a7-d417d46c5a24 tempest-VolumesListAdminTestJSON-2130399491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7f9cc2bc-e8d8-435b-bc38-c711946eb154" returned: 0 in 0.836s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1c66f186-c780-48a2-a4a7-d417d46c5a24 tempest-VolumesListAdminTestJSON-2130399491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7f9cc2bc-e8d8-435b-bc38-c711946eb154 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:05 devstack sudo[102761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7f9cc2bc-e8d8-435b-bc38-c711946eb154 Jun 24 05:05:05 devstack sudo[102761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:05 devstack sudo[102754]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a9c4f7a1-4c79-4779-b2a3-e9b66f62ec33 tempest-AttachVolumeNegativeTest-111486486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-5cdb0dac-f29e-4078-b34e-3795072f4fd8" returned: 0 in 0.690s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:05 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a9c4f7a1-4c79-4779-b2a3-e9b66f62ec33 tempest-AttachVolumeNegativeTest-111486486 None] <== create_volume: return (1802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:05:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a9c4f7a1-4c79-4779-b2a3-e9b66f62ec33 tempest-AttachVolumeNegativeTest-111486486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.807s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:05:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-cb921554-762b-4a69-8652-1a308b45db2d tempest-GroupSnapshotsV319Test-694389268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.411s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:05:05 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-cb921554-762b-4a69-8652-1a308b45db2d tempest-GroupSnapshotsV319Test-694389268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b235a447-d251-48ca-8f6a-070759d5e83b,created_at=2026-06-24T03:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-708467875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b235a447-d251-48ca-8f6a-070759d5e83b,host='devstack@QuobyteHD#QuobyteHD',id=15d3da9b-21dd-40c2-a031-7bddc3a79f7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b34ce0e000a46bdb10ea8fcb948394c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:05:04Z,use_quota=True,user_id='bbc6b0a449c041e4a986a406aeffd51f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f29a02fd-834a-47f4-8f5a-a02b75617107),volume_type_id=f29a02fd-834a-47f4-8f5a-a02b75617107)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:05:05 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-cb921554-762b-4a69-8652-1a308b45db2d tempest-GroupSnapshotsV319Test-694389268 None] Creating volume 15d3da9b-21dd-40c2-a031-7bddc3a79f7a {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:05:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-cb921554-762b-4a69-8652-1a308b45db2d tempest-GroupSnapshotsV319Test-694389268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:05:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-cb921554-762b-4a69-8652-1a308b45db2d tempest-GroupSnapshotsV319Test-694389268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:05:05 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-cb921554-762b-4a69-8652-1a308b45db2d tempest-GroupSnapshotsV319Test-694389268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:05:05 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-cb921554-762b-4a69-8652-1a308b45db2d tempest-GroupSnapshotsV319Test-694389268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:05:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-cb921554-762b-4a69-8652-1a308b45db2d tempest-GroupSnapshotsV319Test-694389268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:05:05 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-cb921554-762b-4a69-8652-1a308b45db2d tempest-GroupSnapshotsV319Test-694389268 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:05:05 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-cb921554-762b-4a69-8652-1a308b45db2d tempest-GroupSnapshotsV319Test-694389268 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:05:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-cb921554-762b-4a69-8652-1a308b45db2d tempest-GroupSnapshotsV319Test-694389268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:05 devstack sudo[102764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a 1073741824 Jun 24 05:05:05 devstack sudo[102764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:05 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a9c4f7a1-4c79-4779-b2a3-e9b66f62ec33 tempest-AttachVolumeNegativeTest-111486486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e767db04-0ce5-4195-b0af-6bbe26b6223e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cdb0dac-f29e-4078-b34e-3795072f4fd8', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:05 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a9c4f7a1-4c79-4779-b2a3-e9b66f62ec33 tempest-AttachVolumeNegativeTest-111486486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d239c61c-e638-4a60-9276-a385db248c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:05 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-a9c4f7a1-4c79-4779-b2a3-e9b66f62ec33 tempest-AttachVolumeNegativeTest-111486486 None] Volume volume-5cdb0dac-f29e-4078-b34e-3795072f4fd8 (5cdb0dac-f29e-4078-b34e-3795072f4fd8): created successfully Jun 24 05:05:05 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a9c4f7a1-4c79-4779-b2a3-e9b66f62ec33 tempest-AttachVolumeNegativeTest-111486486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d239c61c-e638-4a60-9276-a385db248c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:05 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a9c4f7a1-4c79-4779-b2a3-e9b66f62ec33 tempest-AttachVolumeNegativeTest-111486486 None] Flow 'volume_create_manager' (5780dd6a-7834-4014-a5d0-22e3e04e3039) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:05:05 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-a9c4f7a1-4c79-4779-b2a3-e9b66f62ec33 tempest-AttachVolumeNegativeTest-111486486 None] Created volume successfully. Jun 24 05:05:05 devstack sudo[102759]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2bab474c-2bb5-4807-b763-affffc47dae4 tempest-VolumesGetTest-404075134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bef87f67-1f1b-4461-bbf2-3a1c6f649325" returned: 0 in 0.739s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:05 devstack sudo[102761]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:05 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-2bab474c-2bb5-4807-b763-affffc47dae4 tempest-VolumesGetTest-404075134 None] Lock "cinder-quobyte-bef87f67-1f1b-4461-bbf2-3a1c6f649325" released by "delete_volume" :: held 1.762s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:05:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1c66f186-c780-48a2-a4a7-d417d46c5a24 tempest-VolumesListAdminTestJSON-2130399491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7f9cc2bc-e8d8-435b-bc38-c711946eb154" returned: 0 in 0.675s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:05 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-1c66f186-c780-48a2-a4a7-d417d46c5a24 tempest-VolumesListAdminTestJSON-2130399491 None] Lock "cinder-quobyte-7f9cc2bc-e8d8-435b-bc38-c711946eb154" released by "delete_volume" :: held 1.560s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:05:06 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-2bab474c-2bb5-4807-b763-affffc47dae4 tempest-VolumesGetTest-404075134 None] Created reservations ['24fd032d-72bb-4c90-b320-3b5de254a0e8', '570c0ba5-e87d-48ff-b7e2-a65d0eaea699', '74342ace-9323-4b57-872b-b7d1ae5a0e29', '2a124c1c-7299-475f-9522-ca75609b169b'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:05:06 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-1c66f186-c780-48a2-a4a7-d417d46c5a24 tempest-VolumesListAdminTestJSON-2130399491 None] Created reservations ['15d0c0f0-3db3-4a35-a2bd-92d524f13d3c', 'c8d2d9c3-cfde-4724-a6f5-6c8c4479989f', '30580ba2-e77a-4e84-90e6-30f7d1d61788', 'f749efdb-6f6f-4b78-bbea-022deb125c6c'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:05:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-2bab474c-2bb5-4807-b763-affffc47dae4 tempest-VolumesGetTest-404075134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:05:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-2bab474c-2bb5-4807-b763-affffc47dae4 tempest-VolumesGetTest-404075134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:05:06 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-2bab474c-2bb5-4807-b763-affffc47dae4 tempest-VolumesGetTest-404075134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:05:06 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-2bab474c-2bb5-4807-b763-affffc47dae4 tempest-VolumesGetTest-404075134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:05:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-2bab474c-2bb5-4807-b763-affffc47dae4 tempest-VolumesGetTest-404075134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:05:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2bab474c-2bb5-4807-b763-affffc47dae4 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:06 devstack sudo[102768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:05:06 devstack sudo[102768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1c66f186-c780-48a2-a4a7-d417d46c5a24 tempest-VolumesListAdminTestJSON-2130399491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:05:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1c66f186-c780-48a2-a4a7-d417d46c5a24 tempest-VolumesListAdminTestJSON-2130399491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:05:06 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-1c66f186-c780-48a2-a4a7-d417d46c5a24 tempest-VolumesListAdminTestJSON-2130399491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:05:06 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-1c66f186-c780-48a2-a4a7-d417d46c5a24 tempest-VolumesListAdminTestJSON-2130399491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:05:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1c66f186-c780-48a2-a4a7-d417d46c5a24 tempest-VolumesListAdminTestJSON-2130399491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:05:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1c66f186-c780-48a2-a4a7-d417d46c5a24 tempest-VolumesListAdminTestJSON-2130399491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:06 devstack sudo[102770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:05:06 devstack sudo[102770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:06 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-26ac81f8-d613-48bf-b322-5f5161064595 tempest-VolumesGetTest-404075134 None] Acquiring lock "cinder-18b2cac5-18fb-4994-a027-e8e49f05c5d0-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:05:06 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-26ac81f8-d613-48bf-b322-5f5161064595 tempest-VolumesGetTest-404075134 None] Lock "cinder-18b2cac5-18fb-4994-a027-e8e49f05c5d0-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:05:06 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-26ac81f8-d613-48bf-b322-5f5161064595 tempest-VolumesGetTest-404075134 None] Acquiring lock "cinder-quobyte-18b2cac5-18fb-4994-a027-e8e49f05c5d0" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:05:06 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-26ac81f8-d613-48bf-b322-5f5161064595 tempest-VolumesGetTest-404075134 None] Lock "cinder-quobyte-18b2cac5-18fb-4994-a027-e8e49f05c5d0" acquired by "delete_volume" :: waited 0.024s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:05:06 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a947d0f-8324-40e6-b580-994223c974f6]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:05:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-26ac81f8-d613-48bf-b322-5f5161064595 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-18b2cac5-18fb-4994-a027-e8e49f05c5d0 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:06 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-83661078-69a7-48c6-8abf-e9d05ef06dbc tempest-VolumesListAdminTestJSON-2130399491 None] Acquiring lock "cinder-877d5ad8-2905-4bca-8a4b-deaed4a959b8-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:05:06 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-83661078-69a7-48c6-8abf-e9d05ef06dbc tempest-VolumesListAdminTestJSON-2130399491 None] Lock "cinder-877d5ad8-2905-4bca-8a4b-deaed4a959b8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:05:06 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-83661078-69a7-48c6-8abf-e9d05ef06dbc tempest-VolumesListAdminTestJSON-2130399491 None] Acquiring lock "cinder-quobyte-877d5ad8-2905-4bca-8a4b-deaed4a959b8" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:05:06 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-83661078-69a7-48c6-8abf-e9d05ef06dbc tempest-VolumesListAdminTestJSON-2130399491 None] Lock "cinder-quobyte-877d5ad8-2905-4bca-8a4b-deaed4a959b8" acquired by "delete_volume" :: waited 0.017s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:05:06 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3589029-3b0e-481c-b4a9-02e08869684b]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:05:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-83661078-69a7-48c6-8abf-e9d05ef06dbc tempest-VolumesListAdminTestJSON-2130399491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-877d5ad8-2905-4bca-8a4b-deaed4a959b8 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:06 devstack sudo[102772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-18b2cac5-18fb-4994-a027-e8e49f05c5d0 Jun 24 05:05:06 devstack sudo[102772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:06 devstack sudo[102776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-877d5ad8-2905-4bca-8a4b-deaed4a959b8 Jun 24 05:05:06 devstack sudo[102776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:07 devstack sudo[102764]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-cb921554-762b-4a69-8652-1a308b45db2d tempest-GroupSnapshotsV319Test-694389268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a 1073741824" returned: 0 in 1.323s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-cb921554-762b-4a69-8652-1a308b45db2d tempest-GroupSnapshotsV319Test-694389268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:07 devstack sudo[102785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a Jun 24 05:05:07 devstack sudo[102785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:07 devstack sudo[102770]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1c66f186-c780-48a2-a4a7-d417d46c5a24 tempest-VolumesListAdminTestJSON-2130399491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 1.084s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:07 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-1c66f186-c780-48a2-a4a7-d417d46c5a24 tempest-VolumesListAdminTestJSON-2130399491 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:05:07 devstack sudo[102768]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2bab474c-2bb5-4807-b763-affffc47dae4 tempest-VolumesGetTest-404075134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 1.150s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:07 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-2bab474c-2bb5-4807-b763-affffc47dae4 tempest-VolumesGetTest-404075134 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:05:07 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-1c66f186-c780-48a2-a4a7-d417d46c5a24 tempest-VolumesListAdminTestJSON-2130399491 None] Deleted volume successfully. Jun 24 05:05:07 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-1c66f186-c780-48a2-a4a7-d417d46c5a24 tempest-VolumesListAdminTestJSON-2130399491 None] Lock "cinder-7f9cc2bc-e8d8-435b-bc38-c711946eb154-delete_volume" released by "delete_volume" :: held 3.086s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:05:07 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-2bab474c-2bb5-4807-b763-affffc47dae4 tempest-VolumesGetTest-404075134 None] Deleted volume successfully. Jun 24 05:05:07 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-2bab474c-2bb5-4807-b763-affffc47dae4 tempest-VolumesGetTest-404075134 None] Lock "cinder-bef87f67-1f1b-4461-bbf2-3a1c6f649325-delete_volume" released by "delete_volume" :: held 3.326s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:05:07 devstack sudo[102772]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-26ac81f8-d613-48bf-b322-5f5161064595 tempest-VolumesGetTest-404075134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-18b2cac5-18fb-4994-a027-e8e49f05c5d0" returned: 0 in 1.023s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-26ac81f8-d613-48bf-b322-5f5161064595 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-18b2cac5-18fb-4994-a027-e8e49f05c5d0 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:07 devstack sudo[102791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-18b2cac5-18fb-4994-a027-e8e49f05c5d0 Jun 24 05:05:07 devstack sudo[102791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:07 devstack sudo[102776]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-83661078-69a7-48c6-8abf-e9d05ef06dbc tempest-VolumesListAdminTestJSON-2130399491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-877d5ad8-2905-4bca-8a4b-deaed4a959b8" returned: 0 in 1.123s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-83661078-69a7-48c6-8abf-e9d05ef06dbc tempest-VolumesListAdminTestJSON-2130399491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-877d5ad8-2905-4bca-8a4b-deaed4a959b8 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:07 devstack sudo[102796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-877d5ad8-2905-4bca-8a4b-deaed4a959b8 Jun 24 05:05:07 devstack sudo[102796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:07 devstack sudo[102785]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-cb921554-762b-4a69-8652-1a308b45db2d tempest-GroupSnapshotsV319Test-694389268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a" returned: 0 in 0.753s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:07 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-cb921554-762b-4a69-8652-1a308b45db2d tempest-GroupSnapshotsV319Test-694389268 None] <== create_volume: return (2129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:05:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-cb921554-762b-4a69-8652-1a308b45db2d tempest-GroupSnapshotsV319Test-694389268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.132s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:05:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cb921554-762b-4a69-8652-1a308b45db2d tempest-GroupSnapshotsV319Test-694389268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7618b9ae-12d0-4425-97fe-8d06cd762fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cb921554-762b-4a69-8652-1a308b45db2d tempest-GroupSnapshotsV319Test-694389268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9462759b-14a3-488d-a28d-91ec3f6ec07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:07 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-cb921554-762b-4a69-8652-1a308b45db2d tempest-GroupSnapshotsV319Test-694389268 None] Volume volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a (15d3da9b-21dd-40c2-a031-7bddc3a79f7a): created successfully Jun 24 05:05:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cb921554-762b-4a69-8652-1a308b45db2d tempest-GroupSnapshotsV319Test-694389268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9462759b-14a3-488d-a28d-91ec3f6ec07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cb921554-762b-4a69-8652-1a308b45db2d tempest-GroupSnapshotsV319Test-694389268 None] Flow 'volume_create_manager' (ebc5bdf1-b17c-415f-a2eb-83b47460de61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:05:08 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-cb921554-762b-4a69-8652-1a308b45db2d tempest-GroupSnapshotsV319Test-694389268 None] Created volume successfully. Jun 24 05:05:08 devstack sudo[102791]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-26ac81f8-d613-48bf-b322-5f5161064595 tempest-VolumesGetTest-404075134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-18b2cac5-18fb-4994-a027-e8e49f05c5d0" returned: 0 in 0.696s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:08 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-26ac81f8-d613-48bf-b322-5f5161064595 tempest-VolumesGetTest-404075134 None] Lock "cinder-quobyte-18b2cac5-18fb-4994-a027-e8e49f05c5d0" released by "delete_volume" :: held 1.775s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:05:08 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-26ac81f8-d613-48bf-b322-5f5161064595 tempest-VolumesGetTest-404075134 None] Created reservations ['0d1d332c-2824-4984-b136-68d68daa00ae', '21f30f4f-a3f0-4bb7-b177-8604e6f8eda8', '571675fd-815b-4664-b61e-0b07f4bffec6', '6e169505-7f37-4782-8593-918e8620a241'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:05:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-26ac81f8-d613-48bf-b322-5f5161064595 tempest-VolumesGetTest-404075134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:05:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-26ac81f8-d613-48bf-b322-5f5161064595 tempest-VolumesGetTest-404075134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:05:08 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-26ac81f8-d613-48bf-b322-5f5161064595 tempest-VolumesGetTest-404075134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:05:08 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-26ac81f8-d613-48bf-b322-5f5161064595 tempest-VolumesGetTest-404075134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:05:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-26ac81f8-d613-48bf-b322-5f5161064595 tempest-VolumesGetTest-404075134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:05:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-26ac81f8-d613-48bf-b322-5f5161064595 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:08 devstack sudo[102800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:05:08 devstack sudo[102800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:08 devstack sudo[102796]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-83661078-69a7-48c6-8abf-e9d05ef06dbc tempest-VolumesListAdminTestJSON-2130399491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-877d5ad8-2905-4bca-8a4b-deaed4a959b8" returned: 0 in 0.699s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:08 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-83661078-69a7-48c6-8abf-e9d05ef06dbc tempest-VolumesListAdminTestJSON-2130399491 None] Lock "cinder-quobyte-877d5ad8-2905-4bca-8a4b-deaed4a959b8" released by "delete_volume" :: held 1.882s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:05:08 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-83661078-69a7-48c6-8abf-e9d05ef06dbc tempest-VolumesListAdminTestJSON-2130399491 None] Created reservations ['b12b8fda-d6c9-440d-b868-6462bffceca0', '36bbb6fe-6608-4645-9db3-c5373110f399', '1291ccbc-ac4e-4bfa-93ec-769a9cb82dcf', '4b28edff-a315-415a-8c19-6dba5380888a'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:05:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-83661078-69a7-48c6-8abf-e9d05ef06dbc tempest-VolumesListAdminTestJSON-2130399491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:05:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-83661078-69a7-48c6-8abf-e9d05ef06dbc tempest-VolumesListAdminTestJSON-2130399491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:05:08 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-83661078-69a7-48c6-8abf-e9d05ef06dbc tempest-VolumesListAdminTestJSON-2130399491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:05:08 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-83661078-69a7-48c6-8abf-e9d05ef06dbc tempest-VolumesListAdminTestJSON-2130399491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:05:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-83661078-69a7-48c6-8abf-e9d05ef06dbc tempest-VolumesListAdminTestJSON-2130399491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:05:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-83661078-69a7-48c6-8abf-e9d05ef06dbc tempest-VolumesListAdminTestJSON-2130399491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:08 devstack sudo[102803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:05:08 devstack sudo[102803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:09 devstack sudo[102800]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-26ac81f8-d613-48bf-b322-5f5161064595 tempest-VolumesGetTest-404075134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.732s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:09 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-26ac81f8-d613-48bf-b322-5f5161064595 tempest-VolumesGetTest-404075134 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:05:09 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-26ac81f8-d613-48bf-b322-5f5161064595 tempest-VolumesGetTest-404075134 None] Deleted volume successfully. Jun 24 05:05:09 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-26ac81f8-d613-48bf-b322-5f5161064595 tempest-VolumesGetTest-404075134 None] Lock "cinder-18b2cac5-18fb-4994-a027-e8e49f05c5d0-delete_volume" released by "delete_volume" :: held 2.764s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:05:09 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-772ec05b-ef04-41c7-b1bb-484553946f3d tempest-VolumesGetTest-404075134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:05:09 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-772ec05b-ef04-41c7-b1bb-484553946f3d tempest-VolumesGetTest-404075134 None] Flow 'volume_create_manager' (88256591-f348-4eb1-adb2-8ca01f7a305a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:05:09 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-772ec05b-ef04-41c7-b1bb-484553946f3d tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d18ce2bc-c7ea-4d5f-b956-28f0244aafc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:09 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-772ec05b-ef04-41c7-b1bb-484553946f3d tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d18ce2bc-c7ea-4d5f-b956-28f0244aafc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1176206331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4cc0f16-8b67-49b2-9976-b0a7a49f7398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8533bbf2c191435d8768a59ae13e2d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:05:09Z,use_quota=True,user_id='0963985d5fac4d9ba5a5d45cfd0c1ace',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:09 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-772ec05b-ef04-41c7-b1bb-484553946f3d tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b06fd8f8-5d33-42e5-aa27-5c42fbb07a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:09 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-772ec05b-ef04-41c7-b1bb-484553946f3d tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b06fd8f8-5d33-42e5-aa27-5c42fbb07a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:09 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-772ec05b-ef04-41c7-b1bb-484553946f3d tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a00b10b5-490a-440a-940a-1308f9e0bbde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:09 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-772ec05b-ef04-41c7-b1bb-484553946f3d tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a00b10b5-490a-440a-940a-1308f9e0bbde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4cc0f16-8b67-49b2-9976-b0a7a49f7398', 'volume_name': 'volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:09 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-772ec05b-ef04-41c7-b1bb-484553946f3d tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42c6f37f-a364-4b50-ac53-46a734638471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:09 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-772ec05b-ef04-41c7-b1bb-484553946f3d tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42c6f37f-a364-4b50-ac53-46a734638471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:09 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-772ec05b-ef04-41c7-b1bb-484553946f3d tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (955db1ab-db69-48f0-b266-07347dcf26d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:09 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-772ec05b-ef04-41c7-b1bb-484553946f3d tempest-VolumesGetTest-404075134 None] Volume f4cc0f16-8b67-49b2-9976-b0a7a49f7398: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398', 'volume_size': 1} Jun 24 05:05:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-772ec05b-ef04-41c7-b1bb-484553946f3d tempest-VolumesGetTest-404075134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:05:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-772ec05b-ef04-41c7-b1bb-484553946f3d tempest-VolumesGetTest-404075134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:05:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-772ec05b-ef04-41c7-b1bb-484553946f3d tempest-VolumesGetTest-404075134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1176206331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4cc0f16-8b67-49b2-9976-b0a7a49f7398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8533bbf2c191435d8768a59ae13e2d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:05:09Z,use_quota=True,user_id='0963985d5fac4d9ba5a5d45cfd0c1ace',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:05:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-772ec05b-ef04-41c7-b1bb-484553946f3d tempest-VolumesGetTest-404075134 None] Creating volume f4cc0f16-8b67-49b2-9976-b0a7a49f7398 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:05:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-772ec05b-ef04-41c7-b1bb-484553946f3d tempest-VolumesGetTest-404075134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:05:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-772ec05b-ef04-41c7-b1bb-484553946f3d tempest-VolumesGetTest-404075134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:05:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-772ec05b-ef04-41c7-b1bb-484553946f3d tempest-VolumesGetTest-404075134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:05:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-772ec05b-ef04-41c7-b1bb-484553946f3d tempest-VolumesGetTest-404075134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:05:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-772ec05b-ef04-41c7-b1bb-484553946f3d tempest-VolumesGetTest-404075134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:05:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-772ec05b-ef04-41c7-b1bb-484553946f3d tempest-VolumesGetTest-404075134 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:05:09 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-772ec05b-ef04-41c7-b1bb-484553946f3d tempest-VolumesGetTest-404075134 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:05:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-772ec05b-ef04-41c7-b1bb-484553946f3d tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:09 devstack sudo[102806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398 1073741824 Jun 24 05:05:09 devstack sudo[102806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:09 devstack sudo[102803]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-83661078-69a7-48c6-8abf-e9d05ef06dbc tempest-VolumesListAdminTestJSON-2130399491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.896s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:09 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-83661078-69a7-48c6-8abf-e9d05ef06dbc tempest-VolumesListAdminTestJSON-2130399491 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:05:09 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-83661078-69a7-48c6-8abf-e9d05ef06dbc tempest-VolumesListAdminTestJSON-2130399491 None] Deleted volume successfully. Jun 24 05:05:09 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-83661078-69a7-48c6-8abf-e9d05ef06dbc tempest-VolumesListAdminTestJSON-2130399491 None] Lock "cinder-877d5ad8-2905-4bca-8a4b-deaed4a959b8-delete_volume" released by "delete_volume" :: held 3.064s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:05:09 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 05:05:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:05:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:05:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:05:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:05:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:05:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:09 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-1b8d1ee6-8d6c-47a7-abff-7e6e9d883f27 tempest-GroupSnapshotsV319Test-694389268 None] GroupSnapshot c4b714c7-f5c6-4dfb-a30f-7eb009c4f523: creating. Jun 24 05:05:09 devstack sudo[102810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:05:09 devstack sudo[102810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:09 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1b8d1ee6-8d6c-47a7-abff-7e6e9d883f27 tempest-GroupSnapshotsV319Test-694389268 None] Group snapshot c4b714c7-f5c6-4dfb-a30f-7eb009c4f523: creating. {{(pid=93830) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 24 05:05:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1b8d1ee6-8d6c-47a7-abff-7e6e9d883f27 tempest-GroupSnapshotsV319Test-694389268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:05:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-6a16c4ba-7fa2-4068-8e92-d5a90bb4d30c req-e8f28b18-4828-4feb-8a4e-9a8072cf10e7 tempest-AttachVolumeNegativeTest-111486486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:05:10 devstack sudo[102806]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-772ec05b-ef04-41c7-b1bb-484553946f3d tempest-VolumesGetTest-404075134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398 1073741824" returned: 0 in 1.227s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:10 devstack sudo[102810]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.851s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:10 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:05:10 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager._thread_info {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 05:05:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread count: 9 {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 05:05:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread info: [<_MainThread(MainThread, started 130211312517248)>, , , , , , , , ] {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 05:05:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-772ec05b-ef04-41c7-b1bb-484553946f3d tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:10 devstack sudo[102827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398 Jun 24 05:05:10 devstack sudo[102827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:11 devstack sudo[102827]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-772ec05b-ef04-41c7-b1bb-484553946f3d tempest-VolumesGetTest-404075134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398" returned: 0 in 0.667s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:11 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-772ec05b-ef04-41c7-b1bb-484553946f3d tempest-VolumesGetTest-404075134 None] <== create_volume: return (1965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:05:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-772ec05b-ef04-41c7-b1bb-484553946f3d tempest-VolumesGetTest-404075134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.969s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:05:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1b8d1ee6-8d6c-47a7-abff-7e6e9d883f27 tempest-GroupSnapshotsV319Test-694389268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.497s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:05:11 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-772ec05b-ef04-41c7-b1bb-484553946f3d tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (955db1ab-db69-48f0-b266-07347dcf26d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:11 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-772ec05b-ef04-41c7-b1bb-484553946f3d tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5bf40cf-8df0-4eb6-bbf2-ea125dd62156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:11 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-1b8d1ee6-8d6c-47a7-abff-7e6e9d883f27 tempest-GroupSnapshotsV319Test-694389268 None] Creating offline snapshot e5b6fec6-3a91-4c6d-a83a-6fe705399512 of volume 15d3da9b-21dd-40c2-a031-7bddc3a79f7a {{(pid=93830) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 05:05:11 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-772ec05b-ef04-41c7-b1bb-484553946f3d tempest-VolumesGetTest-404075134 None] Volume volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398 (f4cc0f16-8b67-49b2-9976-b0a7a49f7398): created successfully Jun 24 05:05:11 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-772ec05b-ef04-41c7-b1bb-484553946f3d tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5bf40cf-8df0-4eb6-bbf2-ea125dd62156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:11 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-772ec05b-ef04-41c7-b1bb-484553946f3d tempest-VolumesGetTest-404075134 None] Flow 'volume_create_manager' (88256591-f348-4eb1-adb2-8ca01f7a305a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:05:11 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbec22e-4b7f-42f2-af1b-7c01ac94856c]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:05:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1b8d1ee6-8d6c-47a7-abff-7e6e9d883f27 tempest-GroupSnapshotsV319Test-694389268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:11 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-772ec05b-ef04-41c7-b1bb-484553946f3d tempest-VolumesGetTest-404075134 None] Created volume successfully. Jun 24 05:05:11 devstack sudo[102830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a Jun 24 05:05:11 devstack sudo[102830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:12 devstack sudo[102830]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1b8d1ee6-8d6c-47a7-abff-7e6e9d883f27 tempest-GroupSnapshotsV319Test-694389268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a" returned: 0 in 0.820s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1b8d1ee6-8d6c-47a7-abff-7e6e9d883f27 tempest-GroupSnapshotsV319Test-694389268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a.e5b6fec6-3a91-4c6d-a83a-6fe705399512 1G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:12 devstack sudo[102835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a.e5b6fec6-3a91-4c6d-a83a-6fe705399512 1G Jun 24 05:05:12 devstack sudo[102835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:12 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:05:12 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Flow 'volume_create_manager' (1c1c863f-3a6e-4d64-b14d-cb0e1cf118d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:05:12 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (101dc9eb-4ad5-470b-a918-ac6b30e57ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:12 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (101dc9eb-4ad5-470b-a918-ac6b30e57ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1497981116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85ff2dcd-eaef-4a5b-b9eb-718419e33c05,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8533bbf2c191435d8768a59ae13e2d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=f4cc0f16-8b67-49b2-9976-b0a7a49f7398,status='creating',terminated_at=None,updated_at=2026-06-24T03:05:13Z,use_quota=True,user_id='0963985d5fac4d9ba5a5d45cfd0c1ace',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:12 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1da199a-5bca-4b08-889a-026c74ed37d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:12 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1da199a-5bca-4b08-889a-026c74ed37d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:12 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07997918-d514-4597-bd91-a5c028e45e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:12 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07997918-d514-4597-bd91-a5c028e45e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '85ff2dcd-eaef-4a5b-b9eb-718419e33c05', 'volume_name': 'volume-85ff2dcd-eaef-4a5b-b9eb-718419e33c05', 'volume_size': 1, 'source_volid': 'f4cc0f16-8b67-49b2-9976-b0a7a49f7398', 'source_volstatus': 'available'}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:12 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c83039bc-2b8e-4716-885b-0c82598b3606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:12 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c83039bc-2b8e-4716-885b-0c82598b3606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:12 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40dc1b26-9e67-419f-9dfb-a08b4b6fd07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:12 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Volume 85ff2dcd-eaef-4a5b-b9eb-718419e33c05: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-85ff2dcd-eaef-4a5b-b9eb-718419e33c05', 'volume_size': 1, 'source_volid': 'f4cc0f16-8b67-49b2-9976-b0a7a49f7398', 'source_volstatus': 'available'} Jun 24 05:05:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:05:13 devstack sudo[102835]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1b8d1ee6-8d6c-47a7-abff-7e6e9d883f27 tempest-GroupSnapshotsV319Test-694389268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a.e5b6fec6-3a91-4c6d-a83a-6fe705399512 1G" returned: 0 in 0.916s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1b8d1ee6-8d6c-47a7-abff-7e6e9d883f27 tempest-GroupSnapshotsV319Test-694389268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a.e5b6fec6-3a91-4c6d-a83a-6fe705399512 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:13 devstack sudo[102841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a.e5b6fec6-3a91-4c6d-a83a-6fe705399512 Jun 24 05:05:13 devstack sudo[102841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:13 devstack sudo[102841]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1b8d1ee6-8d6c-47a7-abff-7e6e9d883f27 tempest-GroupSnapshotsV319Test-694389268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a.e5b6fec6-3a91-4c6d-a83a-6fe705399512" returned: 0 in 0.740s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:13 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-1b8d1ee6-8d6c-47a7-abff-7e6e9d883f27 tempest-GroupSnapshotsV319Test-694389268 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a.e5b6fec6-3a91-4c6d-a83a-6fe705399512 is being set with open permissions: ugo+rw: NotImplementedError Jun 24 05:05:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1b8d1ee6-8d6c-47a7-abff-7e6e9d883f27 tempest-GroupSnapshotsV319Test-694389268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a.e5b6fec6-3a91-4c6d-a83a-6fe705399512 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:13 devstack sudo[102847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a.e5b6fec6-3a91-4c6d-a83a-6fe705399512 Jun 24 05:05:13 devstack sudo[102847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:14 devstack sudo[102847]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:14 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1b8d1ee6-8d6c-47a7-abff-7e6e9d883f27 tempest-GroupSnapshotsV319Test-694389268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a.e5b6fec6-3a91-4c6d-a83a-6fe705399512" returned: 0 in 0.662s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:14 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1b8d1ee6-8d6c-47a7-abff-7e6e9d883f27 tempest-GroupSnapshotsV319Test-694389268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:14 devstack sudo[102850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a.info Jun 24 05:05:14 devstack sudo[102850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:15 devstack sudo[102850]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1b8d1ee6-8d6c-47a7-abff-7e6e9d883f27 tempest-GroupSnapshotsV319Test-694389268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a.info" returned: 0 in 0.656s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:15 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-1b8d1ee6-8d6c-47a7-abff-7e6e9d883f27 tempest-GroupSnapshotsV319Test-694389268 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a.info is being set with open permissions: ugo+rw: NotImplementedError Jun 24 05:05:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1b8d1ee6-8d6c-47a7-abff-7e6e9d883f27 tempest-GroupSnapshotsV319Test-694389268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:15 devstack sudo[102853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a.info Jun 24 05:05:15 devstack sudo[102853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:15 devstack sudo[102853]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1b8d1ee6-8d6c-47a7-abff-7e6e9d883f27 tempest-GroupSnapshotsV319Test-694389268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a.info" returned: 0 in 0.647s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1b8d1ee6-8d6c-47a7-abff-7e6e9d883f27 tempest-GroupSnapshotsV319Test-694389268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.554s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:05:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-6a16c4ba-7fa2-4068-8e92-d5a90bb4d30c req-e8f28b18-4828-4feb-8a4e-9a8072cf10e7 tempest-AttachVolumeNegativeTest-111486486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.317s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:05:15 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[800142b6-0011-4f91-bf71-73501a6b6d58]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:05:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-6a16c4ba-7fa2-4068-8e92-d5a90bb4d30c req-e8f28b18-4828-4feb-8a4e-9a8072cf10e7 tempest-AttachVolumeNegativeTest-111486486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-5cdb0dac-f29e-4078-b34e-3795072f4fd8 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:15 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-09e7cfa6-531c-4bfc-9610-9a0de6629e4c tempest-VolumesMetadataTest-194554741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:05:15 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-09e7cfa6-531c-4bfc-9610-9a0de6629e4c tempest-VolumesMetadataTest-194554741 None] Flow 'volume_create_manager' (c23caa5a-368e-4977-bddf-438772be423d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:05:15 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-09e7cfa6-531c-4bfc-9610-9a0de6629e4c tempest-VolumesMetadataTest-194554741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09e35a57-6ebc-4c2f-8674-84414ce14e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:15 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-09e7cfa6-531c-4bfc-9610-9a0de6629e4c tempest-VolumesMetadataTest-194554741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09e35a57-6ebc-4c2f-8674-84414ce14e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1615911261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e25eb077-a5ba-4a71-80e7-c9ff9180e4ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbfa926dc494f5086cfcc138380438a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:05:16Z,use_quota=True,user_id='ed4052c45fa84643a67feeaab211475f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:16 devstack sudo[102856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-5cdb0dac-f29e-4078-b34e-3795072f4fd8 Jun 24 05:05:16 devstack sudo[102856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:16 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-09e7cfa6-531c-4bfc-9610-9a0de6629e4c tempest-VolumesMetadataTest-194554741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e5b7f95-c31c-4b93-854c-2ff38e4375fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:16 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-09e7cfa6-531c-4bfc-9610-9a0de6629e4c tempest-VolumesMetadataTest-194554741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e5b7f95-c31c-4b93-854c-2ff38e4375fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:16 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-09e7cfa6-531c-4bfc-9610-9a0de6629e4c tempest-VolumesMetadataTest-194554741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df21ea85-124b-4900-bbe2-9a6e0bb08cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:16 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-09e7cfa6-531c-4bfc-9610-9a0de6629e4c tempest-VolumesMetadataTest-194554741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df21ea85-124b-4900-bbe2-9a6e0bb08cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e25eb077-a5ba-4a71-80e7-c9ff9180e4ae', 'volume_name': 'volume-e25eb077-a5ba-4a71-80e7-c9ff9180e4ae', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:16 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-09e7cfa6-531c-4bfc-9610-9a0de6629e4c tempest-VolumesMetadataTest-194554741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (389a6953-b486-450b-bf31-825b2c825ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:16 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-09e7cfa6-531c-4bfc-9610-9a0de6629e4c tempest-VolumesMetadataTest-194554741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (389a6953-b486-450b-bf31-825b2c825ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:16 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-09e7cfa6-531c-4bfc-9610-9a0de6629e4c tempest-VolumesMetadataTest-194554741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7668b86a-0d53-407c-8e51-63eacc7c3126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:16 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-09e7cfa6-531c-4bfc-9610-9a0de6629e4c tempest-VolumesMetadataTest-194554741 None] Volume e25eb077-a5ba-4a71-80e7-c9ff9180e4ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e25eb077-a5ba-4a71-80e7-c9ff9180e4ae', 'volume_size': 1} Jun 24 05:05:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-09e7cfa6-531c-4bfc-9610-9a0de6629e4c tempest-VolumesMetadataTest-194554741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:05:16 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-1b8d1ee6-8d6c-47a7-abff-7e6e9d883f27 tempest-GroupSnapshotsV319Test-694389268 None] group_snapshot c4b714c7-f5c6-4dfb-a30f-7eb009c4f523: created successfully Jun 24 05:05:16 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-e510c473-e553-4dc3-9b4a-c380633eeea7 tempest-GroupSnapshotsV319Test-694389268 None] group_snapshot c4b714c7-f5c6-4dfb-a30f-7eb009c4f523: deleting Jun 24 05:05:16 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e510c473-e553-4dc3-9b4a-c380633eeea7 tempest-GroupSnapshotsV319Test-694389268 None] group_snapshot c4b714c7-f5c6-4dfb-a30f-7eb009c4f523: deleting {{(pid=93830) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 24 05:05:16 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e510c473-e553-4dc3-9b4a-c380633eeea7 tempest-GroupSnapshotsV319Test-694389268 None] Acquiring lock "cinder-quobyte-15d3da9b-21dd-40c2-a031-7bddc3a79f7a" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:05:16 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e510c473-e553-4dc3-9b4a-c380633eeea7 tempest-GroupSnapshotsV319Test-694389268 None] Lock "cinder-quobyte-15d3da9b-21dd-40c2-a031-7bddc3a79f7a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:05:16 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e510c473-e553-4dc3-9b4a-c380633eeea7 tempest-GroupSnapshotsV319Test-694389268 None] Acquiring lock "cinder-quobyte-e5b6fec6-3a91-4c6d-a83a-6fe705399512" by "_delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:05:16 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e510c473-e553-4dc3-9b4a-c380633eeea7 tempest-GroupSnapshotsV319Test-694389268 None] Lock "cinder-quobyte-e5b6fec6-3a91-4c6d-a83a-6fe705399512" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:05:16 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-e510c473-e553-4dc3-9b4a-c380633eeea7 tempest-GroupSnapshotsV319Test-694389268 None] Deleting offline snapshot e5b6fec6-3a91-4c6d-a83a-6fe705399512 of volume 15d3da9b-21dd-40c2-a031-7bddc3a79f7a {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 05:05:16 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-e510c473-e553-4dc3-9b4a-c380633eeea7 tempest-GroupSnapshotsV319Test-694389268 None] snapshot_file for this snap is: volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a.e5b6fec6-3a91-4c6d-a83a-6fe705399512 {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 05:05:16 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2dff22-88e6-4993-9948-1ba2533537ec]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:05:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e510c473-e553-4dc3-9b4a-c380633eeea7 tempest-GroupSnapshotsV319Test-694389268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a.e5b6fec6-3a91-4c6d-a83a-6fe705399512 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:16 devstack sudo[102856]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-6a16c4ba-7fa2-4068-8e92-d5a90bb4d30c req-e8f28b18-4828-4feb-8a4e-9a8072cf10e7 tempest-AttachVolumeNegativeTest-111486486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-5cdb0dac-f29e-4078-b34e-3795072f4fd8" returned: 0 in 0.842s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-6a16c4ba-7fa2-4068-8e92-d5a90bb4d30c req-e8f28b18-4828-4feb-8a4e-9a8072cf10e7 tempest-AttachVolumeNegativeTest-111486486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.861s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:05:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.710s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:05:16 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Cloning volume f4cc0f16-8b67-49b2-9976-b0a7a49f7398 to volume 85ff2dcd-eaef-4a5b-b9eb-718419e33c05 Jun 24 05:05:16 devstack sudo[102861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a.e5b6fec6-3a91-4c6d-a83a-6fe705399512 Jun 24 05:05:16 devstack sudo[102861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:16 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-6a16c4ba-7fa2-4068-8e92-d5a90bb4d30c req-e8f28b18-4828-4feb-8a4e-9a8072cf10e7 tempest-AttachVolumeNegativeTest-111486486 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05', 'name': 'volume-5cdb0dac-f29e-4078-b34e-3795072f4fd8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '06a2bd2f-c1b1-4a21-bb96-b990e26b0c33', 'enforce_multipath': True} {{(pid=93830) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 05:05:16 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Creating offline snapshot 3e6f5132-9360-44ee-93c8-c924e45a32ce of volume f4cc0f16-8b67-49b2-9976-b0a7a49f7398 {{(pid=93830) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 05:05:16 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[352dcb77-d35b-456b-a8fc-28cadee1dd00]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:05:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:16 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-6a16c4ba-7fa2-4068-8e92-d5a90bb4d30c req-e8f28b18-4828-4feb-8a4e-9a8072cf10e7 tempest-AttachVolumeNegativeTest-111486486 None] attachment_update completed successfully. Jun 24 05:05:16 devstack sudo[102863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398 Jun 24 05:05:16 devstack sudo[102863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:17 devstack sudo[102861]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e510c473-e553-4dc3-9b4a-c380633eeea7 tempest-GroupSnapshotsV319Test-694389268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a.e5b6fec6-3a91-4c6d-a83a-6fe705399512" returned: 0 in 0.815s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:17 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-e510c473-e553-4dc3-9b4a-c380633eeea7 tempest-GroupSnapshotsV319Test-694389268 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:05:17 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bbe897-9d34-4e1b-b9a6-4f65ae818b8e]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:05:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e510c473-e553-4dc3-9b4a-c380633eeea7 tempest-GroupSnapshotsV319Test-694389268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:17 devstack sudo[102935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a Jun 24 05:05:17 devstack sudo[102935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:17 devstack sudo[102863]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398" returned: 0 in 0.858s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398.3e6f5132-9360-44ee-93c8-c924e45a32ce 1G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:17 devstack sudo[102940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398.3e6f5132-9360-44ee-93c8-c924e45a32ce 1G Jun 24 05:05:17 devstack sudo[102940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:18 devstack sudo[102935]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e510c473-e553-4dc3-9b4a-c380633eeea7 tempest-GroupSnapshotsV319Test-694389268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a" returned: 0 in 0.857s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e510c473-e553-4dc3-9b4a-c380633eeea7 tempest-GroupSnapshotsV319Test-694389268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a.e5b6fec6-3a91-4c6d-a83a-6fe705399512 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:18 devstack sudo[103269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a.e5b6fec6-3a91-4c6d-a83a-6fe705399512 Jun 24 05:05:18 devstack sudo[103269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:18 devstack sudo[102940]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398.3e6f5132-9360-44ee-93c8-c924e45a32ce 1G" returned: 0 in 0.861s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398.3e6f5132-9360-44ee-93c8-c924e45a32ce {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:18 devstack sudo[103271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398.3e6f5132-9360-44ee-93c8-c924e45a32ce Jun 24 05:05:18 devstack sudo[103271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:19 devstack sudo[103269]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e510c473-e553-4dc3-9b4a-c380633eeea7 tempest-GroupSnapshotsV319Test-694389268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a.e5b6fec6-3a91-4c6d-a83a-6fe705399512" returned: 0 in 0.760s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e510c473-e553-4dc3-9b4a-c380633eeea7 tempest-GroupSnapshotsV319Test-694389268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a.e5b6fec6-3a91-4c6d-a83a-6fe705399512 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:19 devstack sudo[103279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a.e5b6fec6-3a91-4c6d-a83a-6fe705399512 Jun 24 05:05:19 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:19 devstack sudo[103271]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398.3e6f5132-9360-44ee-93c8-c924e45a32ce" returned: 0 in 0.744s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:19 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398.3e6f5132-9360-44ee-93c8-c924e45a32ce is being set with open permissions: ugo+rw Jun 24 05:05:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398.3e6f5132-9360-44ee-93c8-c924e45a32ce {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:19 devstack sudo[103281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398.3e6f5132-9360-44ee-93c8-c924e45a32ce Jun 24 05:05:19 devstack sudo[103281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:19 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e510c473-e553-4dc3-9b4a-c380633eeea7 tempest-GroupSnapshotsV319Test-694389268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a.e5b6fec6-3a91-4c6d-a83a-6fe705399512" returned: 0 in 0.702s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:19 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e510c473-e553-4dc3-9b4a-c380633eeea7 tempest-GroupSnapshotsV319Test-694389268 None] Lock "cinder-quobyte-e5b6fec6-3a91-4c6d-a83a-6fe705399512" released by "_delete_snapshot" :: held 3.250s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:05:19 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e510c473-e553-4dc3-9b4a-c380633eeea7 tempest-GroupSnapshotsV319Test-694389268 None] Lock "cinder-quobyte-15d3da9b-21dd-40c2-a031-7bddc3a79f7a" released by "delete_snapshot" :: held 3.273s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:05:19 devstack cinder-volume[93830]: WARNING cinder.quota [None req-e510c473-e553-4dc3-9b4a-c380633eeea7 tempest-GroupSnapshotsV319Test-694389268 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-865377128 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-865377128, it is now deprecated. Please use the default quota class for default quota. Jun 24 05:05:19 devstack cinder-volume[93830]: WARNING cinder.quota [None req-e510c473-e553-4dc3-9b4a-c380633eeea7 tempest-GroupSnapshotsV319Test-694389268 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-865377128 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-865377128, it is now deprecated. Please use the default quota class for default quota. Jun 24 05:05:19 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-e510c473-e553-4dc3-9b4a-c380633eeea7 tempest-GroupSnapshotsV319Test-694389268 None] Created reservations ['570ab001-9b99-47f8-816b-ee7a1f315e26', 'c2fd48a3-978c-4fae-96dc-21de10e18906', '968e588a-d30a-456c-911a-9db25b785601', '17f63b50-a483-4dca-b1c5-114cce6bced3'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:05:19 devstack sudo[103281]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398.3e6f5132-9360-44ee-93c8-c924e45a32ce" returned: 0 in 0.687s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:20 devstack sudo[103286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398.info Jun 24 05:05:20 devstack sudo[103286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:20 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-e510c473-e553-4dc3-9b4a-c380633eeea7 tempest-GroupSnapshotsV319Test-694389268 None] group_snapshot c4b714c7-f5c6-4dfb-a30f-7eb009c4f523: deleted successfully Jun 24 05:05:20 devstack sudo[103286]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398.info" returned: 0 in 0.673s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:20 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398.info is being set with open permissions: ugo+rw Jun 24 05:05:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:20 devstack sudo[103289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398.info Jun 24 05:05:20 devstack sudo[103289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:21 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9984ff4f-0418-407b-b804-e0dcfec702d3 tempest-GroupSnapshotsV319Test-694389268 None] Acquiring lock "cinder-quobyte-15d3da9b-21dd-40c2-a031-7bddc3a79f7a" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:05:21 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9984ff4f-0418-407b-b804-e0dcfec702d3 tempest-GroupSnapshotsV319Test-694389268 None] Lock "cinder-quobyte-15d3da9b-21dd-40c2-a031-7bddc3a79f7a" acquired by "delete_volume" :: waited 0.021s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:05:21 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff7d3fa-8fed-48b5-975a-0f9c89fc3c42]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:05:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9984ff4f-0418-407b-b804-e0dcfec702d3 tempest-GroupSnapshotsV319Test-694389268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:21 devstack sudo[103289]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398.info" returned: 0 in 0.685s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:21 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Acquiring lock "cinder-quobyte-85ff2dcd-eaef-4a5b-b9eb-718419e33c05" by "_copy_volume_from_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:05:21 devstack sudo[103292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a Jun 24 05:05:21 devstack sudo[103292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:21 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Lock "cinder-quobyte-85ff2dcd-eaef-4a5b-b9eb-718419e33c05" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:05:21 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] snapshot: 3e6f5132-9360-44ee-93c8-c924e45a32ce, volume: 85ff2dcd-eaef-4a5b-b9eb-718419e33c05, {{(pid=93830) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 05:05:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:05:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:05:21 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:05:21 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:05:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:05:21 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52e966f-d2c5-44a5-989c-74a752bdaebf]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:05:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398.3e6f5132-9360-44ee-93c8-c924e45a32ce {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:21 devstack sudo[103294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398.3e6f5132-9360-44ee-93c8-c924e45a32ce Jun 24 05:05:21 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:22 devstack sudo[103292]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9984ff4f-0418-407b-b804-e0dcfec702d3 tempest-GroupSnapshotsV319Test-694389268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a" returned: 0 in 0.908s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9984ff4f-0418-407b-b804-e0dcfec702d3 tempest-GroupSnapshotsV319Test-694389268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:22 devstack sudo[103299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a Jun 24 05:05:22 devstack sudo[103299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:22 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398.3e6f5132-9360-44ee-93c8-c924e45a32ce" returned: 0 in 0.904s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:22 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:05:22 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398 {{(pid=93830) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 05:05:22 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Creating direct copy from snapshot {{(pid=93830) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 05:05:22 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8186a0-0dcc-43da-82e4-8c8d56ab078d]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:05:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:22 devstack sudo[103304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398 Jun 24 05:05:22 devstack sudo[103304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:22 devstack sudo[103299]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9984ff4f-0418-407b-b804-e0dcfec702d3 tempest-GroupSnapshotsV319Test-694389268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-15d3da9b-21dd-40c2-a031-7bddc3a79f7a" returned: 0 in 0.764s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:22 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9984ff4f-0418-407b-b804-e0dcfec702d3 tempest-GroupSnapshotsV319Test-694389268 None] Lock "cinder-quobyte-15d3da9b-21dd-40c2-a031-7bddc3a79f7a" released by "delete_volume" :: held 1.747s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:05:22 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-9984ff4f-0418-407b-b804-e0dcfec702d3 tempest-GroupSnapshotsV319Test-694389268 None] Created reservations ['07296ee2-6332-4e31-887f-6f6bfc39786d'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:05:23 devstack cinder-volume[93830]: WARNING cinder.quota [None req-9984ff4f-0418-407b-b804-e0dcfec702d3 tempest-GroupSnapshotsV319Test-694389268 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-865377128 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-865377128, it is now deprecated. Please use the default quota class for default quota. Jun 24 05:05:23 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-9984ff4f-0418-407b-b804-e0dcfec702d3 tempest-GroupSnapshotsV319Test-694389268 None] Created reservations ['07de56a7-3e34-4fc6-8500-a45cb15a32a4', '10987a9f-6829-493b-b301-294ce0a6b085', 'e3e4864d-e15d-4317-8854-b5bb645c5d3f', 'ddd947e2-e3f8-47c2-b086-a25956969834'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:05:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9984ff4f-0418-407b-b804-e0dcfec702d3 tempest-GroupSnapshotsV319Test-694389268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:05:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9984ff4f-0418-407b-b804-e0dcfec702d3 tempest-GroupSnapshotsV319Test-694389268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:05:23 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-9984ff4f-0418-407b-b804-e0dcfec702d3 tempest-GroupSnapshotsV319Test-694389268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:05:23 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-9984ff4f-0418-407b-b804-e0dcfec702d3 tempest-GroupSnapshotsV319Test-694389268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:05:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9984ff4f-0418-407b-b804-e0dcfec702d3 tempest-GroupSnapshotsV319Test-694389268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:05:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9984ff4f-0418-407b-b804-e0dcfec702d3 tempest-GroupSnapshotsV319Test-694389268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:23 devstack sudo[103312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:05:23 devstack sudo[103312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:23 devstack sudo[103304]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398" returned: 0 in 0.831s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:23 devstack cinder-volume[93830]: DEBUG cinder.utils [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Path /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-85ff2dcd-eaef-4a5b-b9eb-718419e33c05 not found in is_blk_device check {{(pid=93830) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 05:05:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-85ff2dcd-eaef-4a5b-b9eb-718419e33c05 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:23 devstack sudo[103314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-85ff2dcd-eaef-4a5b-b9eb-718419e33c05 Jun 24 05:05:23 devstack sudo[103314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:23 devstack sudo[103312]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9984ff4f-0418-407b-b804-e0dcfec702d3 tempest-GroupSnapshotsV319Test-694389268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.687s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:23 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-9984ff4f-0418-407b-b804-e0dcfec702d3 tempest-GroupSnapshotsV319Test-694389268 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:05:23 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-9984ff4f-0418-407b-b804-e0dcfec702d3 tempest-GroupSnapshotsV319Test-694389268 None] Delete group completed successfully. Jun 24 05:05:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-85ff2dcd-eaef-4a5b-b9eb-718419e33c05" returned: 0 in 6.706s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:29 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe034d6f-6de7-469c-ae4c-e85ad501cf39]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:05:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:30 devstack sudo[103379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398 Jun 24 05:05:30 devstack sudo[103379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:30 devstack sudo[103379]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398" returned: 0 in 0.946s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:30 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Image conversion details: src /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398, size 1024.00 MB, duration 6.71 sec, destination /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-85ff2dcd-eaef-4a5b-b9eb-718419e33c05 {{(pid=93830) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 05:05:30 devstack cinder-volume[93830]: INFO cinder.image.image_utils [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Converted 1024.00 MB image at 152.67 MB/s Jun 24 05:05:30 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-85ff2dcd-eaef-4a5b-b9eb-718419e33c05 is being set with open permissions: ugo+rw Jun 24 05:05:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-85ff2dcd-eaef-4a5b-b9eb-718419e33c05 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:30 devstack sudo[103384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-85ff2dcd-eaef-4a5b-b9eb-718419e33c05 Jun 24 05:05:30 devstack sudo[103384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:31 devstack sudo[103384]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-85ff2dcd-eaef-4a5b-b9eb-718419e33c05" returned: 0 in 0.654s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:31 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Lock "cinder-quobyte-85ff2dcd-eaef-4a5b-b9eb-718419e33c05" released by "_copy_volume_from_snapshot" :: held 10.159s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:05:31 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Acquiring lock "cinder-quobyte-3e6f5132-9360-44ee-93c8-c924e45a32ce" by "_delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:05:31 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Lock "cinder-quobyte-3e6f5132-9360-44ee-93c8-c924e45a32ce" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:05:31 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Deleting offline snapshot 3e6f5132-9360-44ee-93c8-c924e45a32ce of volume f4cc0f16-8b67-49b2-9976-b0a7a49f7398 {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 05:05:31 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] snapshot_file for this snap is: volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398.3e6f5132-9360-44ee-93c8-c924e45a32ce {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 05:05:31 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3ad52a-68cc-4aa5-90a9-96d4f3ad780d]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:05:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398.3e6f5132-9360-44ee-93c8-c924e45a32ce {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:31 devstack sudo[103387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398.3e6f5132-9360-44ee-93c8-c924e45a32ce Jun 24 05:05:31 devstack sudo[103387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:32 devstack sudo[103387]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398.3e6f5132-9360-44ee-93c8-c924e45a32ce" returned: 0 in 0.903s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:32 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:05:32 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bc128f-9a04-4eb8-8951-b088e18f18cf]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:05:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:32 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-f4d6916a-340a-4637-957d-188388ee631f tempest-GroupsV320Test-1390985118 None] Group tempest-GroupsV320Test-Group-972606947: creating Jun 24 05:05:32 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-f4d6916a-340a-4637-957d-188388ee631f tempest-GroupsV320Test-1390985118 None] Group tempest-GroupsV320Test-Group-972606947: created successfully Jun 24 05:05:32 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-f4d6916a-340a-4637-957d-188388ee631f tempest-GroupsV320Test-1390985118 None] Create group completed successfully. Jun 24 05:05:32 devstack sudo[103392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398 Jun 24 05:05:32 devstack sudo[103392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:33 devstack sudo[103392]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398" returned: 0 in 0.862s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398.3e6f5132-9360-44ee-93c8-c924e45a32ce {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:33 devstack sudo[103398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398.3e6f5132-9360-44ee-93c8-c924e45a32ce Jun 24 05:05:33 devstack sudo[103398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:34 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-1806fbed-4efb-4af6-8bc2-bcafb258c5c9 tempest-GroupsV320Test-1390985118 None] Created reservations ['fa962f6c-3cf9-4adc-85bf-27df8db2c75c'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:05:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1806fbed-4efb-4af6-8bc2-bcafb258c5c9 tempest-GroupsV320Test-1390985118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:05:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1806fbed-4efb-4af6-8bc2-bcafb258c5c9 tempest-GroupsV320Test-1390985118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:05:34 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-1806fbed-4efb-4af6-8bc2-bcafb258c5c9 tempest-GroupsV320Test-1390985118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:05:34 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-1806fbed-4efb-4af6-8bc2-bcafb258c5c9 tempest-GroupsV320Test-1390985118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:05:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1806fbed-4efb-4af6-8bc2-bcafb258c5c9 tempest-GroupsV320Test-1390985118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:05:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1806fbed-4efb-4af6-8bc2-bcafb258c5c9 tempest-GroupsV320Test-1390985118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:34 devstack sudo[103407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:05:34 devstack sudo[103407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:34 devstack sudo[103398]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398.3e6f5132-9360-44ee-93c8-c924e45a32ce" returned: 0 in 0.927s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398.3e6f5132-9360-44ee-93c8-c924e45a32ce {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:34 devstack sudo[103411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398.3e6f5132-9360-44ee-93c8-c924e45a32ce Jun 24 05:05:34 devstack sudo[103411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:35 devstack sudo[103407]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1806fbed-4efb-4af6-8bc2-bcafb258c5c9 tempest-GroupsV320Test-1390985118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.806s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:35 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-1806fbed-4efb-4af6-8bc2-bcafb258c5c9 tempest-GroupsV320Test-1390985118 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:05:35 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-1806fbed-4efb-4af6-8bc2-bcafb258c5c9 tempest-GroupsV320Test-1390985118 None] Delete group completed successfully. Jun 24 05:05:35 devstack sudo[103411]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398.3e6f5132-9360-44ee-93c8-c924e45a32ce" returned: 0 in 0.787s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:35 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Lock "cinder-quobyte-3e6f5132-9360-44ee-93c8-c924e45a32ce" released by "_delete_snapshot" :: held 3.596s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:05:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.519s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:05:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-09e7cfa6-531c-4bfc-9610-9a0de6629e4c tempest-VolumesMetadataTest-194554741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.204s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:05:35 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-09e7cfa6-531c-4bfc-9610-9a0de6629e4c tempest-VolumesMetadataTest-194554741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1615911261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e25eb077-a5ba-4a71-80e7-c9ff9180e4ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbfa926dc494f5086cfcc138380438a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:05:16Z,use_quota=True,user_id='ed4052c45fa84643a67feeaab211475f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:05:35 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-09e7cfa6-531c-4bfc-9610-9a0de6629e4c tempest-VolumesMetadataTest-194554741 None] Creating volume e25eb077-a5ba-4a71-80e7-c9ff9180e4ae {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:05:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-09e7cfa6-531c-4bfc-9610-9a0de6629e4c tempest-VolumesMetadataTest-194554741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:05:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-09e7cfa6-531c-4bfc-9610-9a0de6629e4c tempest-VolumesMetadataTest-194554741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:05:35 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-09e7cfa6-531c-4bfc-9610-9a0de6629e4c tempest-VolumesMetadataTest-194554741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:05:35 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-09e7cfa6-531c-4bfc-9610-9a0de6629e4c tempest-VolumesMetadataTest-194554741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:05:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-09e7cfa6-531c-4bfc-9610-9a0de6629e4c tempest-VolumesMetadataTest-194554741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:05:35 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-09e7cfa6-531c-4bfc-9610-9a0de6629e4c tempest-VolumesMetadataTest-194554741 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:05:35 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-09e7cfa6-531c-4bfc-9610-9a0de6629e4c tempest-VolumesMetadataTest-194554741 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:05:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-09e7cfa6-531c-4bfc-9610-9a0de6629e4c tempest-VolumesMetadataTest-194554741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e25eb077-a5ba-4a71-80e7-c9ff9180e4ae 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:35 devstack sudo[103427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e25eb077-a5ba-4a71-80e7-c9ff9180e4ae 1073741824 Jun 24 05:05:35 devstack sudo[103427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:35 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40dc1b26-9e67-419f-9dfb-a08b4b6fd07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85ff2dcd-eaef-4a5b-b9eb-718419e33c05', 'volume_size': 1, 'source_volid': 'f4cc0f16-8b67-49b2-9976-b0a7a49f7398', 'source_volstatus': 'available'}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:35 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f36e3df6-3f36-4a8c-aa5f-57ad4055339f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:35 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Volume volume-85ff2dcd-eaef-4a5b-b9eb-718419e33c05 (85ff2dcd-eaef-4a5b-b9eb-718419e33c05): created successfully Jun 24 05:05:35 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f36e3df6-3f36-4a8c-aa5f-57ad4055339f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:35 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Flow 'volume_create_manager' (1c1c863f-3a6e-4d64-b14d-cb0e1cf118d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:05:35 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-4f431bba-36b4-4d76-af07-5ebbf0d5c859 tempest-VolumesGetTest-404075134 None] Created volume successfully. Jun 24 05:05:36 devstack sudo[103427]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-09e7cfa6-531c-4bfc-9610-9a0de6629e4c tempest-VolumesMetadataTest-194554741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e25eb077-a5ba-4a71-80e7-c9ff9180e4ae 1073741824" returned: 0 in 0.927s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-09e7cfa6-531c-4bfc-9610-9a0de6629e4c tempest-VolumesMetadataTest-194554741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e25eb077-a5ba-4a71-80e7-c9ff9180e4ae {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:36 devstack sudo[103433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e25eb077-a5ba-4a71-80e7-c9ff9180e4ae Jun 24 05:05:36 devstack sudo[103433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:36 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-57ae76a9-7b7d-4e45-a5e4-fe30f391d509 tempest-VolumesGetTest-404075134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:05:36 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-57ae76a9-7b7d-4e45-a5e4-fe30f391d509 tempest-VolumesGetTest-404075134 None] Flow 'volume_create_manager' (9fcfdaff-5146-45bf-86da-f17e905869ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:05:36 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-57ae76a9-7b7d-4e45-a5e4-fe30f391d509 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aa75120-6870-4404-9afa-f8aad4e38969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:36 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-57ae76a9-7b7d-4e45-a5e4-fe30f391d509 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aa75120-6870-4404-9afa-f8aad4e38969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:05:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1427827310',display_name='tempest-VolumesGetTest-Volume-81049524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47aef920-0da0-43e3-8b72-a991e3ed5db5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8533bbf2c191435d8768a59ae13e2d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:05:37Z,use_quota=True,user_id='0963985d5fac4d9ba5a5d45cfd0c1ace',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:36 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-57ae76a9-7b7d-4e45-a5e4-fe30f391d509 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (894e7eec-7786-4f3e-b3a8-ca33e68aa4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:36 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-57ae76a9-7b7d-4e45-a5e4-fe30f391d509 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (894e7eec-7786-4f3e-b3a8-ca33e68aa4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:36 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-57ae76a9-7b7d-4e45-a5e4-fe30f391d509 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bec671ab-ebc2-4fe7-a003-7d8d4be87d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:36 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-57ae76a9-7b7d-4e45-a5e4-fe30f391d509 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bec671ab-ebc2-4fe7-a003-7d8d4be87d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47aef920-0da0-43e3-8b72-a991e3ed5db5', 'volume_name': 'volume-47aef920-0da0-43e3-8b72-a991e3ed5db5', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:36 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-57ae76a9-7b7d-4e45-a5e4-fe30f391d509 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff0e3fe6-b129-4cfa-879c-6eb2513cb69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:36 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-57ae76a9-7b7d-4e45-a5e4-fe30f391d509 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff0e3fe6-b129-4cfa-879c-6eb2513cb69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:36 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-57ae76a9-7b7d-4e45-a5e4-fe30f391d509 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfa47108-8244-4285-a04a-c8c892e51161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:36 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-57ae76a9-7b7d-4e45-a5e4-fe30f391d509 tempest-VolumesGetTest-404075134 None] Volume 47aef920-0da0-43e3-8b72-a991e3ed5db5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47aef920-0da0-43e3-8b72-a991e3ed5db5', 'volume_size': 1} Jun 24 05:05:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-57ae76a9-7b7d-4e45-a5e4-fe30f391d509 tempest-VolumesGetTest-404075134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:05:37 devstack sudo[103433]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-09e7cfa6-531c-4bfc-9610-9a0de6629e4c tempest-VolumesMetadataTest-194554741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e25eb077-a5ba-4a71-80e7-c9ff9180e4ae" returned: 0 in 0.806s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:37 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-09e7cfa6-531c-4bfc-9610-9a0de6629e4c tempest-VolumesMetadataTest-194554741 None] <== create_volume: return (1785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:05:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-09e7cfa6-531c-4bfc-9610-9a0de6629e4c tempest-VolumesMetadataTest-194554741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.787s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:05:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-57ae76a9-7b7d-4e45-a5e4-fe30f391d509 tempest-VolumesGetTest-404075134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.177s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:05:37 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-57ae76a9-7b7d-4e45-a5e4-fe30f391d509 tempest-VolumesGetTest-404075134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:05:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1427827310',display_name='tempest-VolumesGetTest-Volume-81049524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47aef920-0da0-43e3-8b72-a991e3ed5db5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8533bbf2c191435d8768a59ae13e2d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:05:37Z,use_quota=True,user_id='0963985d5fac4d9ba5a5d45cfd0c1ace',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:05:37 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-57ae76a9-7b7d-4e45-a5e4-fe30f391d509 tempest-VolumesGetTest-404075134 None] Creating volume 47aef920-0da0-43e3-8b72-a991e3ed5db5 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:05:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-57ae76a9-7b7d-4e45-a5e4-fe30f391d509 tempest-VolumesGetTest-404075134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:05:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-57ae76a9-7b7d-4e45-a5e4-fe30f391d509 tempest-VolumesGetTest-404075134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:05:37 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-57ae76a9-7b7d-4e45-a5e4-fe30f391d509 tempest-VolumesGetTest-404075134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:05:37 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-57ae76a9-7b7d-4e45-a5e4-fe30f391d509 tempest-VolumesGetTest-404075134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:05:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-57ae76a9-7b7d-4e45-a5e4-fe30f391d509 tempest-VolumesGetTest-404075134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:05:37 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-57ae76a9-7b7d-4e45-a5e4-fe30f391d509 tempest-VolumesGetTest-404075134 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:05:37 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-57ae76a9-7b7d-4e45-a5e4-fe30f391d509 tempest-VolumesGetTest-404075134 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:05:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-57ae76a9-7b7d-4e45-a5e4-fe30f391d509 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-47aef920-0da0-43e3-8b72-a991e3ed5db5 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:37 devstack sudo[103436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-47aef920-0da0-43e3-8b72-a991e3ed5db5 1073741824 Jun 24 05:05:37 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-09e7cfa6-531c-4bfc-9610-9a0de6629e4c tempest-VolumesMetadataTest-194554741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7668b86a-0d53-407c-8e51-63eacc7c3126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e25eb077-a5ba-4a71-80e7-c9ff9180e4ae', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:37 devstack sudo[103436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:37 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-09e7cfa6-531c-4bfc-9610-9a0de6629e4c tempest-VolumesMetadataTest-194554741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (915b61bd-171c-4126-a436-d1bd22ba5d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:37 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-09e7cfa6-531c-4bfc-9610-9a0de6629e4c tempest-VolumesMetadataTest-194554741 None] Volume volume-e25eb077-a5ba-4a71-80e7-c9ff9180e4ae (e25eb077-a5ba-4a71-80e7-c9ff9180e4ae): created successfully Jun 24 05:05:37 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-09e7cfa6-531c-4bfc-9610-9a0de6629e4c tempest-VolumesMetadataTest-194554741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (915b61bd-171c-4126-a436-d1bd22ba5d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:37 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-09e7cfa6-531c-4bfc-9610-9a0de6629e4c tempest-VolumesMetadataTest-194554741 None] Flow 'volume_create_manager' (c23caa5a-368e-4977-bddf-438772be423d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:05:37 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-09e7cfa6-531c-4bfc-9610-9a0de6629e4c tempest-VolumesMetadataTest-194554741 None] Created volume successfully. Jun 24 05:05:38 devstack sudo[103436]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-57ae76a9-7b7d-4e45-a5e4-fe30f391d509 tempest-VolumesGetTest-404075134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-47aef920-0da0-43e3-8b72-a991e3ed5db5 1073741824" returned: 0 in 1.014s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-57ae76a9-7b7d-4e45-a5e4-fe30f391d509 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-47aef920-0da0-43e3-8b72-a991e3ed5db5 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:38 devstack sudo[103469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-47aef920-0da0-43e3-8b72-a991e3ed5db5 Jun 24 05:05:38 devstack sudo[103469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:38 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-22ac200a-48bb-4a35-9f36-9bb8e4993a1e tempest-VolumesMetadataTest-194554741 None] Acquiring lock "cinder-e25eb077-a5ba-4a71-80e7-c9ff9180e4ae-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:05:38 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-22ac200a-48bb-4a35-9f36-9bb8e4993a1e tempest-VolumesMetadataTest-194554741 None] Lock "cinder-e25eb077-a5ba-4a71-80e7-c9ff9180e4ae-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:05:38 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-22ac200a-48bb-4a35-9f36-9bb8e4993a1e tempest-VolumesMetadataTest-194554741 None] Acquiring lock "cinder-quobyte-e25eb077-a5ba-4a71-80e7-c9ff9180e4ae" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:05:38 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-22ac200a-48bb-4a35-9f36-9bb8e4993a1e tempest-VolumesMetadataTest-194554741 None] Lock "cinder-quobyte-e25eb077-a5ba-4a71-80e7-c9ff9180e4ae" acquired by "delete_volume" :: waited 0.017s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:05:38 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[052b13d5-1c4e-47d7-be1b-ed8a6225d29b]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:05:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-22ac200a-48bb-4a35-9f36-9bb8e4993a1e tempest-VolumesMetadataTest-194554741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e25eb077-a5ba-4a71-80e7-c9ff9180e4ae {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:38 devstack sudo[103469]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-57ae76a9-7b7d-4e45-a5e4-fe30f391d509 tempest-VolumesGetTest-404075134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-47aef920-0da0-43e3-8b72-a991e3ed5db5" returned: 0 in 0.781s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:38 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-57ae76a9-7b7d-4e45-a5e4-fe30f391d509 tempest-VolumesGetTest-404075134 None] <== create_volume: return (1858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:05:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-57ae76a9-7b7d-4e45-a5e4-fe30f391d509 tempest-VolumesGetTest-404075134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.862s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:05:38 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-57ae76a9-7b7d-4e45-a5e4-fe30f391d509 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfa47108-8244-4285-a04a-c8c892e51161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47aef920-0da0-43e3-8b72-a991e3ed5db5', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:38 devstack sudo[103472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e25eb077-a5ba-4a71-80e7-c9ff9180e4ae Jun 24 05:05:38 devstack sudo[103472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:38 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-57ae76a9-7b7d-4e45-a5e4-fe30f391d509 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (519d4d84-8a13-4f04-bdf7-dcf685dafa54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:38 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-57ae76a9-7b7d-4e45-a5e4-fe30f391d509 tempest-VolumesGetTest-404075134 None] Volume volume-47aef920-0da0-43e3-8b72-a991e3ed5db5 (47aef920-0da0-43e3-8b72-a991e3ed5db5): created successfully Jun 24 05:05:38 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-57ae76a9-7b7d-4e45-a5e4-fe30f391d509 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (519d4d84-8a13-4f04-bdf7-dcf685dafa54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:38 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-57ae76a9-7b7d-4e45-a5e4-fe30f391d509 tempest-VolumesGetTest-404075134 None] Flow 'volume_create_manager' (9fcfdaff-5146-45bf-86da-f17e905869ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:05:38 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-57ae76a9-7b7d-4e45-a5e4-fe30f391d509 tempest-VolumesGetTest-404075134 None] Created volume successfully. Jun 24 05:05:39 devstack sudo[103472]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-22ac200a-48bb-4a35-9f36-9bb8e4993a1e tempest-VolumesMetadataTest-194554741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e25eb077-a5ba-4a71-80e7-c9ff9180e4ae" returned: 0 in 0.809s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-22ac200a-48bb-4a35-9f36-9bb8e4993a1e tempest-VolumesMetadataTest-194554741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e25eb077-a5ba-4a71-80e7-c9ff9180e4ae {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:39 devstack sudo[103483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e25eb077-a5ba-4a71-80e7-c9ff9180e4ae Jun 24 05:05:39 devstack sudo[103483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:40 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-2d0dd7f5-f9cf-496c-9b3a-62b63a53b662 tempest-VolumesGetTest-404075134 None] Acquiring lock "cinder-47aef920-0da0-43e3-8b72-a991e3ed5db5-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:05:40 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-2d0dd7f5-f9cf-496c-9b3a-62b63a53b662 tempest-VolumesGetTest-404075134 None] Lock "cinder-47aef920-0da0-43e3-8b72-a991e3ed5db5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:05:40 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-2d0dd7f5-f9cf-496c-9b3a-62b63a53b662 tempest-VolumesGetTest-404075134 None] Acquiring lock "cinder-quobyte-47aef920-0da0-43e3-8b72-a991e3ed5db5" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:05:40 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-2d0dd7f5-f9cf-496c-9b3a-62b63a53b662 tempest-VolumesGetTest-404075134 None] Lock "cinder-quobyte-47aef920-0da0-43e3-8b72-a991e3ed5db5" acquired by "delete_volume" :: waited 0.063s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:05:40 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[657bce7a-19ac-450c-8b9c-7405252d239a]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:05:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2d0dd7f5-f9cf-496c-9b3a-62b63a53b662 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-47aef920-0da0-43e3-8b72-a991e3ed5db5 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:40 devstack sudo[103511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-47aef920-0da0-43e3-8b72-a991e3ed5db5 Jun 24 05:05:40 devstack sudo[103511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:40 devstack sudo[103483]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-22ac200a-48bb-4a35-9f36-9bb8e4993a1e tempest-VolumesMetadataTest-194554741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e25eb077-a5ba-4a71-80e7-c9ff9180e4ae" returned: 0 in 1.036s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:40 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-22ac200a-48bb-4a35-9f36-9bb8e4993a1e tempest-VolumesMetadataTest-194554741 None] Lock "cinder-quobyte-e25eb077-a5ba-4a71-80e7-c9ff9180e4ae" released by "delete_volume" :: held 1.915s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:05:40 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-22ac200a-48bb-4a35-9f36-9bb8e4993a1e tempest-VolumesMetadataTest-194554741 None] Created reservations ['01c729e9-7177-4c31-8dbd-08454d2562b7', '2c1c5b41-2d51-4025-8333-3aa3249c6606', '0ae56b9a-97f3-4c22-bbe6-80384ea4afd3', 'f9e3fe09-f10d-4a22-ac9a-93bf4ee273a1'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:05:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-22ac200a-48bb-4a35-9f36-9bb8e4993a1e tempest-VolumesMetadataTest-194554741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:05:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-22ac200a-48bb-4a35-9f36-9bb8e4993a1e tempest-VolumesMetadataTest-194554741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:05:40 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-22ac200a-48bb-4a35-9f36-9bb8e4993a1e tempest-VolumesMetadataTest-194554741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:05:40 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-22ac200a-48bb-4a35-9f36-9bb8e4993a1e tempest-VolumesMetadataTest-194554741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:05:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-22ac200a-48bb-4a35-9f36-9bb8e4993a1e tempest-VolumesMetadataTest-194554741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:05:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-22ac200a-48bb-4a35-9f36-9bb8e4993a1e tempest-VolumesMetadataTest-194554741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:40 devstack sudo[103536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:05:40 devstack sudo[103536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:42 devstack sudo[103511]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2d0dd7f5-f9cf-496c-9b3a-62b63a53b662 tempest-VolumesGetTest-404075134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-47aef920-0da0-43e3-8b72-a991e3ed5db5" returned: 0 in 1.648s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2d0dd7f5-f9cf-496c-9b3a-62b63a53b662 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-47aef920-0da0-43e3-8b72-a991e3ed5db5 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:42 devstack sudo[103542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-47aef920-0da0-43e3-8b72-a991e3ed5db5 Jun 24 05:05:42 devstack sudo[103542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:42 devstack sudo[103536]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-22ac200a-48bb-4a35-9f36-9bb8e4993a1e tempest-VolumesMetadataTest-194554741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 1.304s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:42 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-22ac200a-48bb-4a35-9f36-9bb8e4993a1e tempest-VolumesMetadataTest-194554741 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:05:42 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-22ac200a-48bb-4a35-9f36-9bb8e4993a1e tempest-VolumesMetadataTest-194554741 None] Deleted volume successfully. Jun 24 05:05:42 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-22ac200a-48bb-4a35-9f36-9bb8e4993a1e tempest-VolumesMetadataTest-194554741 None] Lock "cinder-e25eb077-a5ba-4a71-80e7-c9ff9180e4ae-delete_volume" released by "delete_volume" :: held 3.648s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:05:43 devstack sudo[103542]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2d0dd7f5-f9cf-496c-9b3a-62b63a53b662 tempest-VolumesGetTest-404075134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-47aef920-0da0-43e3-8b72-a991e3ed5db5" returned: 0 in 1.386s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:43 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-2d0dd7f5-f9cf-496c-9b3a-62b63a53b662 tempest-VolumesGetTest-404075134 None] Lock "cinder-quobyte-47aef920-0da0-43e3-8b72-a991e3ed5db5" released by "delete_volume" :: held 3.160s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:05:43 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:INSERT=26,cinder:UPDATE=142,cinder:SELECT=102,cinder:DELETE=10 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:05:43 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-2d0dd7f5-f9cf-496c-9b3a-62b63a53b662 tempest-VolumesGetTest-404075134 None] Created reservations ['b0916fe6-7cfb-4a5f-9e79-4781914a73e8', 'dd16e08b-01da-426e-a9d3-ca1c38bb3800', 'a70413c3-bab4-4614-abe7-c7b37159305e', '3a053617-8ba6-4d3d-b4a4-f87f96566f5e'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:05:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-2d0dd7f5-f9cf-496c-9b3a-62b63a53b662 tempest-VolumesGetTest-404075134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:05:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-2d0dd7f5-f9cf-496c-9b3a-62b63a53b662 tempest-VolumesGetTest-404075134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:05:43 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-2d0dd7f5-f9cf-496c-9b3a-62b63a53b662 tempest-VolumesGetTest-404075134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:05:43 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-2d0dd7f5-f9cf-496c-9b3a-62b63a53b662 tempest-VolumesGetTest-404075134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:05:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-2d0dd7f5-f9cf-496c-9b3a-62b63a53b662 tempest-VolumesGetTest-404075134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:05:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2d0dd7f5-f9cf-496c-9b3a-62b63a53b662 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:43 devstack sudo[103548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:05:43 devstack sudo[103548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:44 devstack sudo[103548]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2d0dd7f5-f9cf-496c-9b3a-62b63a53b662 tempest-VolumesGetTest-404075134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.854s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:44 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-2d0dd7f5-f9cf-496c-9b3a-62b63a53b662 tempest-VolumesGetTest-404075134 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:05:44 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-2d0dd7f5-f9cf-496c-9b3a-62b63a53b662 tempest-VolumesGetTest-404075134 None] Deleted volume successfully. Jun 24 05:05:44 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-2d0dd7f5-f9cf-496c-9b3a-62b63a53b662 tempest-VolumesGetTest-404075134 None] Lock "cinder-47aef920-0da0-43e3-8b72-a991e3ed5db5-delete_volume" released by "delete_volume" :: held 4.478s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:05:44 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-91a80c8f-6b31-4be5-849f-c7c60bd6498c tempest-VolumesGetTest-404075134 None] Acquiring lock "cinder-85ff2dcd-eaef-4a5b-b9eb-718419e33c05-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:05:44 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-91a80c8f-6b31-4be5-849f-c7c60bd6498c tempest-VolumesGetTest-404075134 None] Lock "cinder-85ff2dcd-eaef-4a5b-b9eb-718419e33c05-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:05:45 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-91a80c8f-6b31-4be5-849f-c7c60bd6498c tempest-VolumesGetTest-404075134 None] Acquiring lock "cinder-quobyte-85ff2dcd-eaef-4a5b-b9eb-718419e33c05" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:05:45 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-91a80c8f-6b31-4be5-849f-c7c60bd6498c tempest-VolumesGetTest-404075134 None] Lock "cinder-quobyte-85ff2dcd-eaef-4a5b-b9eb-718419e33c05" acquired by "delete_volume" :: waited 0.031s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:05:45 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a19944-cf03-4d91-acd8-140c119df492]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:05:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-91a80c8f-6b31-4be5-849f-c7c60bd6498c tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-85ff2dcd-eaef-4a5b-b9eb-718419e33c05 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:45 devstack sudo[103552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-85ff2dcd-eaef-4a5b-b9eb-718419e33c05 Jun 24 05:05:45 devstack sudo[103552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:46 devstack sudo[103552]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-91a80c8f-6b31-4be5-849f-c7c60bd6498c tempest-VolumesGetTest-404075134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-85ff2dcd-eaef-4a5b-b9eb-718419e33c05" returned: 0 in 1.246s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-91a80c8f-6b31-4be5-849f-c7c60bd6498c tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-85ff2dcd-eaef-4a5b-b9eb-718419e33c05 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:46 devstack sudo[103557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-85ff2dcd-eaef-4a5b-b9eb-718419e33c05 Jun 24 05:05:46 devstack sudo[103557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:46 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfb3cdfd-32c9-4ad1-a4a9-8432c4c636fc tempest-VolumesCloneNegativeTest-1615119750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:05:46 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-bfb3cdfd-32c9-4ad1-a4a9-8432c4c636fc tempest-VolumesCloneNegativeTest-1615119750 None] Flow 'volume_create_manager' (b5cd8962-b396-4f7a-97c7-85a1a25e1cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:05:46 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-bfb3cdfd-32c9-4ad1-a4a9-8432c4c636fc tempest-VolumesCloneNegativeTest-1615119750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc0ce5db-9dbf-491e-9232-9d8047a740eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:46 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-bfb3cdfd-32c9-4ad1-a4a9-8432c4c636fc tempest-VolumesCloneNegativeTest-1615119750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc0ce5db-9dbf-491e-9232-9d8047a740eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:05:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1300261062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63bfadbd-9a01-4dde-9328-c7349c947dbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fef124019d044f3694a35ae28616d237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:05:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:05:47Z,use_quota=True,user_id='34fd2e0a8514426d98eb8922d30afcdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:46 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-bfb3cdfd-32c9-4ad1-a4a9-8432c4c636fc tempest-VolumesCloneNegativeTest-1615119750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c5f0cef-554c-4c83-91b8-3d9e2e9a2571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:46 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-bfb3cdfd-32c9-4ad1-a4a9-8432c4c636fc tempest-VolumesCloneNegativeTest-1615119750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c5f0cef-554c-4c83-91b8-3d9e2e9a2571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:46 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-bfb3cdfd-32c9-4ad1-a4a9-8432c4c636fc tempest-VolumesCloneNegativeTest-1615119750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cf9cb47-36fa-4745-894e-57bb9f84b23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:46 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-bfb3cdfd-32c9-4ad1-a4a9-8432c4c636fc tempest-VolumesCloneNegativeTest-1615119750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cf9cb47-36fa-4745-894e-57bb9f84b23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63bfadbd-9a01-4dde-9328-c7349c947dbc', 'volume_name': 'volume-63bfadbd-9a01-4dde-9328-c7349c947dbc', 'volume_size': 2}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:46 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-bfb3cdfd-32c9-4ad1-a4a9-8432c4c636fc tempest-VolumesCloneNegativeTest-1615119750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f09e8070-3551-464e-be17-747023c50074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:46 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-bfb3cdfd-32c9-4ad1-a4a9-8432c4c636fc tempest-VolumesCloneNegativeTest-1615119750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f09e8070-3551-464e-be17-747023c50074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:46 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-bfb3cdfd-32c9-4ad1-a4a9-8432c4c636fc tempest-VolumesCloneNegativeTest-1615119750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6e84877-17d8-479f-ba3e-c1faa7fdfbfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:46 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-bfb3cdfd-32c9-4ad1-a4a9-8432c4c636fc tempest-VolumesCloneNegativeTest-1615119750 None] Volume 63bfadbd-9a01-4dde-9328-c7349c947dbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63bfadbd-9a01-4dde-9328-c7349c947dbc', 'volume_size': 2} Jun 24 05:05:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-bfb3cdfd-32c9-4ad1-a4a9-8432c4c636fc tempest-VolumesCloneNegativeTest-1615119750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:05:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-bfb3cdfd-32c9-4ad1-a4a9-8432c4c636fc tempest-VolumesCloneNegativeTest-1615119750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:05:46 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-bfb3cdfd-32c9-4ad1-a4a9-8432c4c636fc tempest-VolumesCloneNegativeTest-1615119750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:05:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1300261062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63bfadbd-9a01-4dde-9328-c7349c947dbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fef124019d044f3694a35ae28616d237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:05:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:05:47Z,use_quota=True,user_id='34fd2e0a8514426d98eb8922d30afcdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:05:46 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-bfb3cdfd-32c9-4ad1-a4a9-8432c4c636fc tempest-VolumesCloneNegativeTest-1615119750 None] Creating volume 63bfadbd-9a01-4dde-9328-c7349c947dbc {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:05:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-bfb3cdfd-32c9-4ad1-a4a9-8432c4c636fc tempest-VolumesCloneNegativeTest-1615119750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:05:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-bfb3cdfd-32c9-4ad1-a4a9-8432c4c636fc tempest-VolumesCloneNegativeTest-1615119750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:05:46 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-bfb3cdfd-32c9-4ad1-a4a9-8432c4c636fc tempest-VolumesCloneNegativeTest-1615119750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:05:46 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-bfb3cdfd-32c9-4ad1-a4a9-8432c4c636fc tempest-VolumesCloneNegativeTest-1615119750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:05:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-bfb3cdfd-32c9-4ad1-a4a9-8432c4c636fc tempest-VolumesCloneNegativeTest-1615119750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:05:46 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-bfb3cdfd-32c9-4ad1-a4a9-8432c4c636fc tempest-VolumesCloneNegativeTest-1615119750 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:05:46 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-bfb3cdfd-32c9-4ad1-a4a9-8432c4c636fc tempest-VolumesCloneNegativeTest-1615119750 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:05:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-bfb3cdfd-32c9-4ad1-a4a9-8432c4c636fc tempest-VolumesCloneNegativeTest-1615119750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-63bfadbd-9a01-4dde-9328-c7349c947dbc 2147483648 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:46 devstack sudo[103560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-63bfadbd-9a01-4dde-9328-c7349c947dbc 2147483648 Jun 24 05:05:46 devstack sudo[103560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:47 devstack sudo[103557]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-91a80c8f-6b31-4be5-849f-c7c60bd6498c tempest-VolumesGetTest-404075134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-85ff2dcd-eaef-4a5b-b9eb-718419e33c05" returned: 0 in 1.117s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:47 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-91a80c8f-6b31-4be5-849f-c7c60bd6498c tempest-VolumesGetTest-404075134 None] Lock "cinder-quobyte-85ff2dcd-eaef-4a5b-b9eb-718419e33c05" released by "delete_volume" :: held 2.445s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:05:47 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-91a80c8f-6b31-4be5-849f-c7c60bd6498c tempest-VolumesGetTest-404075134 None] Created reservations ['20243b2e-9b39-4849-ab13-38a42a7b55a2', '0fec306c-a902-4c8a-b92f-98cf090879e0', 'a3fb05ea-2d97-44b3-a017-f554aa4da43c', '8ffe0e41-8baa-4269-8a8a-0c41bdd0af93'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:05:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-91a80c8f-6b31-4be5-849f-c7c60bd6498c tempest-VolumesGetTest-404075134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:05:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-91a80c8f-6b31-4be5-849f-c7c60bd6498c tempest-VolumesGetTest-404075134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:05:47 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-91a80c8f-6b31-4be5-849f-c7c60bd6498c tempest-VolumesGetTest-404075134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:05:47 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-91a80c8f-6b31-4be5-849f-c7c60bd6498c tempest-VolumesGetTest-404075134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:05:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-91a80c8f-6b31-4be5-849f-c7c60bd6498c tempest-VolumesGetTest-404075134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:05:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-91a80c8f-6b31-4be5-849f-c7c60bd6498c tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:47 devstack sudo[103567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:05:47 devstack sudo[103567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:48 devstack sudo[103560]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-bfb3cdfd-32c9-4ad1-a4a9-8432c4c636fc tempest-VolumesCloneNegativeTest-1615119750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-63bfadbd-9a01-4dde-9328-c7349c947dbc 2147483648" returned: 0 in 1.251s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-bfb3cdfd-32c9-4ad1-a4a9-8432c4c636fc tempest-VolumesCloneNegativeTest-1615119750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-63bfadbd-9a01-4dde-9328-c7349c947dbc {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:48 devstack sudo[103572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-63bfadbd-9a01-4dde-9328-c7349c947dbc Jun 24 05:05:48 devstack sudo[103572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:48 devstack sudo[103567]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-91a80c8f-6b31-4be5-849f-c7c60bd6498c tempest-VolumesGetTest-404075134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 1.042s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:48 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-91a80c8f-6b31-4be5-849f-c7c60bd6498c tempest-VolumesGetTest-404075134 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:05:48 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-91a80c8f-6b31-4be5-849f-c7c60bd6498c tempest-VolumesGetTest-404075134 None] Deleted volume successfully. Jun 24 05:05:48 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-575d4739-e999-44ff-9747-ed754caddac0 tempest-VolumesGetTest-404075134 None] Acquiring lock "cinder-f4cc0f16-8b67-49b2-9976-b0a7a49f7398-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:05:48 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-91a80c8f-6b31-4be5-849f-c7c60bd6498c tempest-VolumesGetTest-404075134 None] Lock "cinder-85ff2dcd-eaef-4a5b-b9eb-718419e33c05-delete_volume" released by "delete_volume" :: held 3.893s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:05:48 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-575d4739-e999-44ff-9747-ed754caddac0 tempest-VolumesGetTest-404075134 None] Lock "cinder-f4cc0f16-8b67-49b2-9976-b0a7a49f7398-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:05:48 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-575d4739-e999-44ff-9747-ed754caddac0 tempest-VolumesGetTest-404075134 None] Acquiring lock "cinder-quobyte-f4cc0f16-8b67-49b2-9976-b0a7a49f7398" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:05:48 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-575d4739-e999-44ff-9747-ed754caddac0 tempest-VolumesGetTest-404075134 None] Lock "cinder-quobyte-f4cc0f16-8b67-49b2-9976-b0a7a49f7398" acquired by "delete_volume" :: waited 0.049s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:05:49 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bdde91-4942-40f1-85d1-1ed6982d0ddb]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:05:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-575d4739-e999-44ff-9747-ed754caddac0 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:49 devstack sudo[103575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398 Jun 24 05:05:49 devstack sudo[103575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:49 devstack sudo[103572]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-bfb3cdfd-32c9-4ad1-a4a9-8432c4c636fc tempest-VolumesCloneNegativeTest-1615119750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-63bfadbd-9a01-4dde-9328-c7349c947dbc" returned: 0 in 1.286s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:49 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-bfb3cdfd-32c9-4ad1-a4a9-8432c4c636fc tempest-VolumesCloneNegativeTest-1615119750 None] <== create_volume: return (2610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:05:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-bfb3cdfd-32c9-4ad1-a4a9-8432c4c636fc tempest-VolumesCloneNegativeTest-1615119750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.612s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:05:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-bfb3cdfd-32c9-4ad1-a4a9-8432c4c636fc tempest-VolumesCloneNegativeTest-1615119750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6e84877-17d8-479f-ba3e-c1faa7fdfbfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63bfadbd-9a01-4dde-9328-c7349c947dbc', 'volume_size': 2}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-bfb3cdfd-32c9-4ad1-a4a9-8432c4c636fc tempest-VolumesCloneNegativeTest-1615119750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c0b1ea9-ac6a-4d96-9d42-fcd426251851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:49 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-bfb3cdfd-32c9-4ad1-a4a9-8432c4c636fc tempest-VolumesCloneNegativeTest-1615119750 None] Volume volume-63bfadbd-9a01-4dde-9328-c7349c947dbc (63bfadbd-9a01-4dde-9328-c7349c947dbc): created successfully Jun 24 05:05:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-bfb3cdfd-32c9-4ad1-a4a9-8432c4c636fc tempest-VolumesCloneNegativeTest-1615119750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c0b1ea9-ac6a-4d96-9d42-fcd426251851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-bfb3cdfd-32c9-4ad1-a4a9-8432c4c636fc tempest-VolumesCloneNegativeTest-1615119750 None] Flow 'volume_create_manager' (b5cd8962-b396-4f7a-97c7-85a1a25e1cca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:05:49 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-bfb3cdfd-32c9-4ad1-a4a9-8432c4c636fc tempest-VolumesCloneNegativeTest-1615119750 None] Created volume successfully. Jun 24 05:05:49 devstack sudo[103575]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-575d4739-e999-44ff-9747-ed754caddac0 tempest-VolumesGetTest-404075134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398" returned: 0 in 0.859s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-575d4739-e999-44ff-9747-ed754caddac0 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:49 devstack sudo[103582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398 Jun 24 05:05:49 devstack sudo[103582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:50 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-efde525c-e1bd-4d29-88c2-b78761d97fc4 tempest-VolumesCloneNegativeTest-1615119750 None] Acquiring lock "cinder-63bfadbd-9a01-4dde-9328-c7349c947dbc-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:05:50 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-efde525c-e1bd-4d29-88c2-b78761d97fc4 tempest-VolumesCloneNegativeTest-1615119750 None] Lock "cinder-63bfadbd-9a01-4dde-9328-c7349c947dbc-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:05:50 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-efde525c-e1bd-4d29-88c2-b78761d97fc4 tempest-VolumesCloneNegativeTest-1615119750 None] Acquiring lock "cinder-quobyte-63bfadbd-9a01-4dde-9328-c7349c947dbc" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:05:50 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-efde525c-e1bd-4d29-88c2-b78761d97fc4 tempest-VolumesCloneNegativeTest-1615119750 None] Lock "cinder-quobyte-63bfadbd-9a01-4dde-9328-c7349c947dbc" acquired by "delete_volume" :: waited 0.033s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:05:50 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcc9f5d-8427-4794-9bc1-9d3da9822037]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:05:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-efde525c-e1bd-4d29-88c2-b78761d97fc4 tempest-VolumesCloneNegativeTest-1615119750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-63bfadbd-9a01-4dde-9328-c7349c947dbc {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:50 devstack sudo[103584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-63bfadbd-9a01-4dde-9328-c7349c947dbc Jun 24 05:05:50 devstack sudo[103584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:50 devstack sudo[103582]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-575d4739-e999-44ff-9747-ed754caddac0 tempest-VolumesGetTest-404075134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f4cc0f16-8b67-49b2-9976-b0a7a49f7398" returned: 0 in 0.940s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:50 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-575d4739-e999-44ff-9747-ed754caddac0 tempest-VolumesGetTest-404075134 None] Lock "cinder-quobyte-f4cc0f16-8b67-49b2-9976-b0a7a49f7398" released by "delete_volume" :: held 1.894s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:05:50 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-575d4739-e999-44ff-9747-ed754caddac0 tempest-VolumesGetTest-404075134 None] Created reservations ['87b60f9d-c158-4ca9-9072-5dd4036d1500', '87c5dcce-9f02-47f2-82a5-6f978cb19b2b', '8ef3a70d-47af-4107-8188-aabab0f2122a', '6769006b-763c-43c4-8b89-5cf43cbebe13'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:05:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-575d4739-e999-44ff-9747-ed754caddac0 tempest-VolumesGetTest-404075134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:05:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-575d4739-e999-44ff-9747-ed754caddac0 tempest-VolumesGetTest-404075134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:05:51 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-575d4739-e999-44ff-9747-ed754caddac0 tempest-VolumesGetTest-404075134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:05:51 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-575d4739-e999-44ff-9747-ed754caddac0 tempest-VolumesGetTest-404075134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:05:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-575d4739-e999-44ff-9747-ed754caddac0 tempest-VolumesGetTest-404075134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:05:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-575d4739-e999-44ff-9747-ed754caddac0 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:51 devstack sudo[103587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:05:51 devstack sudo[103587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:51 devstack sudo[103584]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-efde525c-e1bd-4d29-88c2-b78761d97fc4 tempest-VolumesCloneNegativeTest-1615119750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-63bfadbd-9a01-4dde-9328-c7349c947dbc" returned: 0 in 1.026s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-efde525c-e1bd-4d29-88c2-b78761d97fc4 tempest-VolumesCloneNegativeTest-1615119750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-63bfadbd-9a01-4dde-9328-c7349c947dbc {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:51 devstack sudo[103592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-63bfadbd-9a01-4dde-9328-c7349c947dbc Jun 24 05:05:51 devstack sudo[103592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:52 devstack sudo[103587]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-575d4739-e999-44ff-9747-ed754caddac0 tempest-VolumesGetTest-404075134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 1.052s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:52 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-575d4739-e999-44ff-9747-ed754caddac0 tempest-VolumesGetTest-404075134 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:05:52 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-575d4739-e999-44ff-9747-ed754caddac0 tempest-VolumesGetTest-404075134 None] Deleted volume successfully. Jun 24 05:05:52 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-575d4739-e999-44ff-9747-ed754caddac0 tempest-VolumesGetTest-404075134 None] Lock "cinder-f4cc0f16-8b67-49b2-9976-b0a7a49f7398-delete_volume" released by "delete_volume" :: held 3.282s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:05:52 devstack sudo[103592]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-efde525c-e1bd-4d29-88c2-b78761d97fc4 tempest-VolumesCloneNegativeTest-1615119750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-63bfadbd-9a01-4dde-9328-c7349c947dbc" returned: 0 in 0.968s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:52 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-efde525c-e1bd-4d29-88c2-b78761d97fc4 tempest-VolumesCloneNegativeTest-1615119750 None] Lock "cinder-quobyte-63bfadbd-9a01-4dde-9328-c7349c947dbc" released by "delete_volume" :: held 2.086s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:05:52 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-efde525c-e1bd-4d29-88c2-b78761d97fc4 tempest-VolumesCloneNegativeTest-1615119750 None] Created reservations ['2eb78e42-563d-4732-a2b6-d425cc502206', '65d1a47b-236a-4c7f-9fa3-b34f5e4ffffb', '994e5212-7903-4c07-b1c8-f5a950e47820', '744bc71e-540d-4f57-8881-d71c1da7bfbc'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:05:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-efde525c-e1bd-4d29-88c2-b78761d97fc4 tempest-VolumesCloneNegativeTest-1615119750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:05:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-efde525c-e1bd-4d29-88c2-b78761d97fc4 tempest-VolumesCloneNegativeTest-1615119750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:05:52 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-efde525c-e1bd-4d29-88c2-b78761d97fc4 tempest-VolumesCloneNegativeTest-1615119750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:05:52 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-efde525c-e1bd-4d29-88c2-b78761d97fc4 tempest-VolumesCloneNegativeTest-1615119750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:05:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-efde525c-e1bd-4d29-88c2-b78761d97fc4 tempest-VolumesCloneNegativeTest-1615119750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:05:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-efde525c-e1bd-4d29-88c2-b78761d97fc4 tempest-VolumesCloneNegativeTest-1615119750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:52 devstack sudo[103596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:05:52 devstack sudo[103596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:53 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:05:53 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Flow 'volume_create_manager' (6929397d-1b70-4cff-bca3-c3241d3807f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:05:53 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1269a6a2-1ded-4991-a7c8-760feaddb916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:53 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1269a6a2-1ded-4991-a7c8-760feaddb916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1080711574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f63592ab-f0f4-437e-9e91-15a2e82829d5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8533bbf2c191435d8768a59ae13e2d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:05:53Z,use_quota=True,user_id='0963985d5fac4d9ba5a5d45cfd0c1ace',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:53 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f1a9c34-e893-40f8-b51c-d3e6b1b9fd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:53 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f1a9c34-e893-40f8-b51c-d3e6b1b9fd24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:53 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (118bde83-110e-4f4c-9503-655e99f09c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:53 devstack cinder-volume[93830]: DEBUG cinder.image.glance [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Creating Keystone auth plugin from conf {{(pid=93830) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 24 05:05:53 devstack sudo[103596]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-efde525c-e1bd-4d29-88c2-b78761d97fc4 tempest-VolumesCloneNegativeTest-1615119750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 1.167s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:53 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-efde525c-e1bd-4d29-88c2-b78761d97fc4 tempest-VolumesCloneNegativeTest-1615119750 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:05:53 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-efde525c-e1bd-4d29-88c2-b78761d97fc4 tempest-VolumesCloneNegativeTest-1615119750 None] Deleted volume successfully. Jun 24 05:05:53 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-efde525c-e1bd-4d29-88c2-b78761d97fc4 tempest-VolumesCloneNegativeTest-1615119750 None] Lock "cinder-63bfadbd-9a01-4dde-9328-c7349c947dbc-delete_volume" released by "delete_volume" :: held 3.542s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:05:54 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (118bde83-110e-4f4c-9503-655e99f09c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f63592ab-f0f4-437e-9e91-15a2e82829d5', 'volume_name': 'volume-f63592ab-f0f4-437e-9e91-15a2e82829d5', 'volume_size': 1, 'image_id': 'f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f7b9466e67614ef6a2783f0123a80489', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'created_at': datetime.datetime(2026, 6, 24, 2, 51, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 51, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:54 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89cb2fba-1677-49a0-a395-6e7129c7df94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:54 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89cb2fba-1677-49a0-a395-6e7129c7df94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:54 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7446fe5-211e-48e8-bbad-1254c6717c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:54 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Volume f63592ab-f0f4-437e-9e91-15a2e82829d5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f63592ab-f0f4-437e-9e91-15a2e82829d5', 'volume_size': 1, 'image_id': 'f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f7b9466e67614ef6a2783f0123a80489', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'created_at': datetime.datetime(2026, 6, 24, 2, 51, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 51, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 24 05:05:54 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Trying to clone f63592ab-f0f4-437e-9e91-15a2e82829d5 from image f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'metadata': {}}]). {{(pid=93830) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 24 05:05:55 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_cn7wub7ydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93830) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 24 05:05:55 devstack cinder-volume[93830]: INFO cinder.image.image_utils [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Image download 20.69 MB at 20.69 MB/s Jun 24 05:05:55 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3724df1-0d84-48e7-911f-3db528975bc1 tempest-VolumeQuotasAdminTestJSON-367548064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:05:55 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f3724df1-0d84-48e7-911f-3db528975bc1 tempest-VolumeQuotasAdminTestJSON-367548064 None] Flow 'volume_create_manager' (09b52350-4f80-4287-8529-5ea69ffd630d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:05:55 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f3724df1-0d84-48e7-911f-3db528975bc1 tempest-VolumeQuotasAdminTestJSON-367548064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e889c10d-f9e9-4168-b5d8-7fcb8e2e90b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:55 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f3724df1-0d84-48e7-911f-3db528975bc1 tempest-VolumeQuotasAdminTestJSON-367548064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e889c10d-f9e9-4168-b5d8-7fcb8e2e90b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-747277281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c778c5aa-d636-411a-89a8-7f7c822356eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0aceeab92e94370840b7b16e380da2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:05:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:05:55Z,use_quota=True,user_id='394ff74802474c05b697566c8e4b9eb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:55 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f3724df1-0d84-48e7-911f-3db528975bc1 tempest-VolumeQuotasAdminTestJSON-367548064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2075db9c-9219-4f81-95a0-a52ae31e8b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:55 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f3724df1-0d84-48e7-911f-3db528975bc1 tempest-VolumeQuotasAdminTestJSON-367548064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2075db9c-9219-4f81-95a0-a52ae31e8b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:55 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f3724df1-0d84-48e7-911f-3db528975bc1 tempest-VolumeQuotasAdminTestJSON-367548064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (077f8575-bc68-4af5-9011-d8ae4c68e778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:55 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f3724df1-0d84-48e7-911f-3db528975bc1 tempest-VolumeQuotasAdminTestJSON-367548064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (077f8575-bc68-4af5-9011-d8ae4c68e778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c778c5aa-d636-411a-89a8-7f7c822356eb', 'volume_name': 'volume-c778c5aa-d636-411a-89a8-7f7c822356eb', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:55 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f3724df1-0d84-48e7-911f-3db528975bc1 tempest-VolumeQuotasAdminTestJSON-367548064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06fb659c-0571-426f-b928-93e423e0c050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:55 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f3724df1-0d84-48e7-911f-3db528975bc1 tempest-VolumeQuotasAdminTestJSON-367548064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06fb659c-0571-426f-b928-93e423e0c050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:55 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f3724df1-0d84-48e7-911f-3db528975bc1 tempest-VolumeQuotasAdminTestJSON-367548064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b3f0607-2b84-4d48-802a-bd9d56c24fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:55 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-f3724df1-0d84-48e7-911f-3db528975bc1 tempest-VolumeQuotasAdminTestJSON-367548064 None] Volume c778c5aa-d636-411a-89a8-7f7c822356eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c778c5aa-d636-411a-89a8-7f7c822356eb', 'volume_size': 1} Jun 24 05:05:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f3724df1-0d84-48e7-911f-3db528975bc1 tempest-VolumeQuotasAdminTestJSON-367548064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:05:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f3724df1-0d84-48e7-911f-3db528975bc1 tempest-VolumeQuotasAdminTestJSON-367548064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:05:55 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f3724df1-0d84-48e7-911f-3db528975bc1 tempest-VolumeQuotasAdminTestJSON-367548064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-747277281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c778c5aa-d636-411a-89a8-7f7c822356eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0aceeab92e94370840b7b16e380da2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:05:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:05:55Z,use_quota=True,user_id='394ff74802474c05b697566c8e4b9eb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:05:55 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-f3724df1-0d84-48e7-911f-3db528975bc1 tempest-VolumeQuotasAdminTestJSON-367548064 None] Creating volume c778c5aa-d636-411a-89a8-7f7c822356eb {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:05:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f3724df1-0d84-48e7-911f-3db528975bc1 tempest-VolumeQuotasAdminTestJSON-367548064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:05:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f3724df1-0d84-48e7-911f-3db528975bc1 tempest-VolumeQuotasAdminTestJSON-367548064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:05:55 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f3724df1-0d84-48e7-911f-3db528975bc1 tempest-VolumeQuotasAdminTestJSON-367548064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:05:55 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f3724df1-0d84-48e7-911f-3db528975bc1 tempest-VolumeQuotasAdminTestJSON-367548064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:05:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f3724df1-0d84-48e7-911f-3db528975bc1 tempest-VolumeQuotasAdminTestJSON-367548064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:05:55 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f3724df1-0d84-48e7-911f-3db528975bc1 tempest-VolumeQuotasAdminTestJSON-367548064 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:05:55 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-f3724df1-0d84-48e7-911f-3db528975bc1 tempest-VolumeQuotasAdminTestJSON-367548064 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:05:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f3724df1-0d84-48e7-911f-3db528975bc1 tempest-VolumeQuotasAdminTestJSON-367548064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c778c5aa-d636-411a-89a8-7f7c822356eb 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:55 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[9686cffa-9b3b-43a3-a970-808a43ba9262]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:05:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_cn7wub7ydevstack@QuobyteHD {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:55 devstack sudo[103644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c778c5aa-d636-411a-89a8-7f7c822356eb 1073741824 Jun 24 05:05:55 devstack sudo[103644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:55 devstack sudo[103645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_cn7wub7ydevstack@QuobyteHD Jun 24 05:05:55 devstack sudo[103645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:56 devstack sudo[103645]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_cn7wub7ydevstack@QuobyteHD" returned: 0 in 0.824s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:56 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Temporary image f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1 is fetched for user 0963985d5fac4d9ba5a5d45cfd0c1ace. {{(pid=93830) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 24 05:05:56 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:SELECT=114,cinder:UPDATE=144,cinder:INSERT=41,cinder:DELETE=10 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:05:56 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[496d8ddb-f940-45d7-b71c-3ab6ad38e023]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:05:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_cn7wub7ydevstack@QuobyteHD {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:56 devstack sudo[103644]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f3724df1-0d84-48e7-911f-3db528975bc1 tempest-VolumeQuotasAdminTestJSON-367548064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c778c5aa-d636-411a-89a8-7f7c822356eb 1073741824" returned: 0 in 1.020s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f3724df1-0d84-48e7-911f-3db528975bc1 tempest-VolumeQuotasAdminTestJSON-367548064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c778c5aa-d636-411a-89a8-7f7c822356eb {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:56 devstack sudo[103655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_cn7wub7ydevstack@QuobyteHD Jun 24 05:05:56 devstack sudo[103655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:56 devstack sudo[103657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c778c5aa-d636-411a-89a8-7f7c822356eb Jun 24 05:05:56 devstack sudo[103657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:56 devstack sudo[103655]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_cn7wub7ydevstack@QuobyteHD" returned: 0 in 0.797s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:05:56 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-da0f3c3a-c218-47d5-9b19-8e56510674ea tempest-VolumesNegativeTest-95720529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:05:56 devstack sudo[103657]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:56 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-da0f3c3a-c218-47d5-9b19-8e56510674ea tempest-VolumesNegativeTest-95720529 None] Flow 'volume_create_manager' (6cbef067-758d-432a-858a-f0ee7919fb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:05:56 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-da0f3c3a-c218-47d5-9b19-8e56510674ea tempest-VolumesNegativeTest-95720529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09ed4cda-6b9a-42f0-a45f-e6229f724185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f3724df1-0d84-48e7-911f-3db528975bc1 tempest-VolumeQuotasAdminTestJSON-367548064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c778c5aa-d636-411a-89a8-7f7c822356eb" returned: 0 in 0.729s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:56 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f3724df1-0d84-48e7-911f-3db528975bc1 tempest-VolumeQuotasAdminTestJSON-367548064 None] <== create_volume: return (1798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:05:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f3724df1-0d84-48e7-911f-3db528975bc1 tempest-VolumeQuotasAdminTestJSON-367548064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:05:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.058s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:05:56 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1080711574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f63592ab-f0f4-437e-9e91-15a2e82829d5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8533bbf2c191435d8768a59ae13e2d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:05:53Z,use_quota=True,user_id='0963985d5fac4d9ba5a5d45cfd0c1ace',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:05:56 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Creating volume f63592ab-f0f4-437e-9e91-15a2e82829d5 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:05:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:05:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:05:56 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:05:56 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:05:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:05:56 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:05:56 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:05:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f63592ab-f0f4-437e-9e91-15a2e82829d5 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:57 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-da0f3c3a-c218-47d5-9b19-8e56510674ea tempest-VolumesNegativeTest-95720529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09ed4cda-6b9a-42f0-a45f-e6229f724185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-893744467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e627525a-97fe-409b-8841-47406191b9cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceca0f3239444ad9bd1a4ecc6e3d4630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:05:57Z,use_quota=True,user_id='26fd832c2b59485ab991fc7a6199329e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:57 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-da0f3c3a-c218-47d5-9b19-8e56510674ea tempest-VolumesNegativeTest-95720529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b2fae1c-e697-4896-a20c-126fd2c850aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:57 devstack sudo[103663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f63592ab-f0f4-437e-9e91-15a2e82829d5 1073741824 Jun 24 05:05:57 devstack sudo[103663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:57 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-da0f3c3a-c218-47d5-9b19-8e56510674ea tempest-VolumesNegativeTest-95720529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b2fae1c-e697-4896-a20c-126fd2c850aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:57 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-da0f3c3a-c218-47d5-9b19-8e56510674ea tempest-VolumesNegativeTest-95720529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b60e92-286f-4687-9ae2-fa2eb6055d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:57 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-da0f3c3a-c218-47d5-9b19-8e56510674ea tempest-VolumesNegativeTest-95720529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b60e92-286f-4687-9ae2-fa2eb6055d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e627525a-97fe-409b-8841-47406191b9cc', 'volume_name': 'volume-e627525a-97fe-409b-8841-47406191b9cc', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:57 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-da0f3c3a-c218-47d5-9b19-8e56510674ea tempest-VolumesNegativeTest-95720529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72fd4437-e29d-476b-9a90-3bb2ca42ef66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:57 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-da0f3c3a-c218-47d5-9b19-8e56510674ea tempest-VolumesNegativeTest-95720529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72fd4437-e29d-476b-9a90-3bb2ca42ef66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:57 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-da0f3c3a-c218-47d5-9b19-8e56510674ea tempest-VolumesNegativeTest-95720529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef575f8a-783e-4b94-8d7c-1d641de238e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:57 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-da0f3c3a-c218-47d5-9b19-8e56510674ea tempest-VolumesNegativeTest-95720529 None] Volume e627525a-97fe-409b-8841-47406191b9cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e627525a-97fe-409b-8841-47406191b9cc', 'volume_size': 1} Jun 24 05:05:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-da0f3c3a-c218-47d5-9b19-8e56510674ea tempest-VolumesNegativeTest-95720529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:05:57 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f3724df1-0d84-48e7-911f-3db528975bc1 tempest-VolumeQuotasAdminTestJSON-367548064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b3f0607-2b84-4d48-802a-bd9d56c24fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c778c5aa-d636-411a-89a8-7f7c822356eb', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:57 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f3724df1-0d84-48e7-911f-3db528975bc1 tempest-VolumeQuotasAdminTestJSON-367548064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f114eeb-a646-4ce6-8cbb-272fc385ea25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:05:57 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-f3724df1-0d84-48e7-911f-3db528975bc1 tempest-VolumeQuotasAdminTestJSON-367548064 None] Volume volume-c778c5aa-d636-411a-89a8-7f7c822356eb (c778c5aa-d636-411a-89a8-7f7c822356eb): created successfully Jun 24 05:05:57 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f3724df1-0d84-48e7-911f-3db528975bc1 tempest-VolumeQuotasAdminTestJSON-367548064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f114eeb-a646-4ce6-8cbb-272fc385ea25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:05:57 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f3724df1-0d84-48e7-911f-3db528975bc1 tempest-VolumeQuotasAdminTestJSON-367548064 None] Flow 'volume_create_manager' (09b52350-4f80-4287-8529-5ea69ffd630d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:05:57 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-f3724df1-0d84-48e7-911f-3db528975bc1 tempest-VolumeQuotasAdminTestJSON-367548064 None] Created volume successfully. Jun 24 05:05:57 devstack sudo[103663]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f63592ab-f0f4-437e-9e91-15a2e82829d5 1073741824" returned: 0 in 0.796s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f63592ab-f0f4-437e-9e91-15a2e82829d5 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:57 devstack sudo[103668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f63592ab-f0f4-437e-9e91-15a2e82829d5 Jun 24 05:05:57 devstack sudo[103668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:58 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-c79ba5b0-40a4-4d1f-b9d4-9081b52787b3 tempest-VolumeQuotasAdminTestJSON-367548064 None] Acquiring lock "cinder-c778c5aa-d636-411a-89a8-7f7c822356eb-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:05:58 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-c79ba5b0-40a4-4d1f-b9d4-9081b52787b3 tempest-VolumeQuotasAdminTestJSON-367548064 None] Lock "cinder-c778c5aa-d636-411a-89a8-7f7c822356eb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:05:58 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-c79ba5b0-40a4-4d1f-b9d4-9081b52787b3 tempest-VolumeQuotasAdminTestJSON-367548064 None] Acquiring lock "cinder-quobyte-c778c5aa-d636-411a-89a8-7f7c822356eb" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:05:58 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-c79ba5b0-40a4-4d1f-b9d4-9081b52787b3 tempest-VolumeQuotasAdminTestJSON-367548064 None] Lock "cinder-quobyte-c778c5aa-d636-411a-89a8-7f7c822356eb" acquired by "delete_volume" :: waited 0.016s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:05:58 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[014eb920-e942-42af-9c36-78ccac750c5d]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:05:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c79ba5b0-40a4-4d1f-b9d4-9081b52787b3 tempest-VolumeQuotasAdminTestJSON-367548064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c778c5aa-d636-411a-89a8-7f7c822356eb {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:58 devstack sudo[103670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c778c5aa-d636-411a-89a8-7f7c822356eb Jun 24 05:05:58 devstack sudo[103670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:58 devstack sudo[103668]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f63592ab-f0f4-437e-9e91-15a2e82829d5" returned: 0 in 0.679s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:58 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] <== create_volume: return (1511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:05:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:05:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-da0f3c3a-c218-47d5-9b19-8e56510674ea tempest-VolumesNegativeTest-95720529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.451s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:05:58 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-da0f3c3a-c218-47d5-9b19-8e56510674ea tempest-VolumesNegativeTest-95720529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-893744467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e627525a-97fe-409b-8841-47406191b9cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ceca0f3239444ad9bd1a4ecc6e3d4630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:05:57Z,use_quota=True,user_id='26fd832c2b59485ab991fc7a6199329e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:05:58 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-da0f3c3a-c218-47d5-9b19-8e56510674ea tempest-VolumesNegativeTest-95720529 None] Creating volume e627525a-97fe-409b-8841-47406191b9cc {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:05:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-da0f3c3a-c218-47d5-9b19-8e56510674ea tempest-VolumesNegativeTest-95720529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:05:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-da0f3c3a-c218-47d5-9b19-8e56510674ea tempest-VolumesNegativeTest-95720529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:05:58 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-da0f3c3a-c218-47d5-9b19-8e56510674ea tempest-VolumesNegativeTest-95720529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:05:58 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-da0f3c3a-c218-47d5-9b19-8e56510674ea tempest-VolumesNegativeTest-95720529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:05:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-da0f3c3a-c218-47d5-9b19-8e56510674ea tempest-VolumesNegativeTest-95720529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:05:58 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-da0f3c3a-c218-47d5-9b19-8e56510674ea tempest-VolumesNegativeTest-95720529 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:05:58 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-da0f3c3a-c218-47d5-9b19-8e56510674ea tempest-VolumesNegativeTest-95720529 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:05:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-da0f3c3a-c218-47d5-9b19-8e56510674ea tempest-VolumesNegativeTest-95720529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e627525a-97fe-409b-8841-47406191b9cc 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:58 devstack sudo[103673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e627525a-97fe-409b-8841-47406191b9cc 1073741824 Jun 24 05:05:58 devstack sudo[103673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:58 devstack cinder-volume[93830]: DEBUG cinder.volume.volume_utils [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Attempting download of f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1 ((None, [{'url': 'file:///opt/stack/data/glance/images/f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'metadata': {}}])) to volume f63592ab-f0f4-437e-9e91-15a2e82829d5. {{(pid=93830) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 24 05:05:58 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a618de9-4f0a-4332-b404-bbaded52a5b5]: (4, 'raw') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:05:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_o6acrrx5 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:58 devstack sudo[103675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_o6acrrx5 Jun 24 05:05:58 devstack sudo[103675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:59 devstack sudo[103670]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c79ba5b0-40a4-4d1f-b9d4-9081b52787b3 tempest-VolumeQuotasAdminTestJSON-367548064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c778c5aa-d636-411a-89a8-7f7c822356eb" returned: 0 in 0.797s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c79ba5b0-40a4-4d1f-b9d4-9081b52787b3 tempest-VolumeQuotasAdminTestJSON-367548064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c778c5aa-d636-411a-89a8-7f7c822356eb {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:59 devstack sudo[103683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c778c5aa-d636-411a-89a8-7f7c822356eb Jun 24 05:05:59 devstack sudo[103683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:59 devstack sudo[103673]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-da0f3c3a-c218-47d5-9b19-8e56510674ea tempest-VolumesNegativeTest-95720529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e627525a-97fe-409b-8841-47406191b9cc 1073741824" returned: 0 in 0.880s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:59 devstack sudo[103675]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_o6acrrx5" returned: 0 in 0.781s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_o6acrrx5 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-da0f3c3a-c218-47d5-9b19-8e56510674ea tempest-VolumesNegativeTest-95720529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e627525a-97fe-409b-8841-47406191b9cc {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:59 devstack sudo[103690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e627525a-97fe-409b-8841-47406191b9cc Jun 24 05:05:59 devstack sudo[103690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:59 devstack sudo[103689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_o6acrrx5 Jun 24 05:05:59 devstack sudo[103689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:05:59 devstack sudo[103683]: pam_unix(sudo:session): session closed for user root Jun 24 05:05:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c79ba5b0-40a4-4d1f-b9d4-9081b52787b3 tempest-VolumeQuotasAdminTestJSON-367548064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c778c5aa-d636-411a-89a8-7f7c822356eb" returned: 0 in 0.699s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:05:59 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-c79ba5b0-40a4-4d1f-b9d4-9081b52787b3 tempest-VolumeQuotasAdminTestJSON-367548064 None] Lock "cinder-quobyte-c778c5aa-d636-411a-89a8-7f7c822356eb" released by "delete_volume" :: held 1.545s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:05:59 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-c79ba5b0-40a4-4d1f-b9d4-9081b52787b3 tempest-VolumeQuotasAdminTestJSON-367548064 None] Created reservations ['0364d0bd-7f92-4f62-bee8-da452540b720', 'b25ca406-20fc-4e07-9bab-2ff27e4303da', 'eea0fb02-7543-4363-b6a1-467b2f987db1', '184e8e55-77ea-4997-b69a-e02f0c06b156'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:05:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-c79ba5b0-40a4-4d1f-b9d4-9081b52787b3 tempest-VolumeQuotasAdminTestJSON-367548064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:05:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-c79ba5b0-40a4-4d1f-b9d4-9081b52787b3 tempest-VolumeQuotasAdminTestJSON-367548064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:05:59 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-c79ba5b0-40a4-4d1f-b9d4-9081b52787b3 tempest-VolumeQuotasAdminTestJSON-367548064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:05:59 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-c79ba5b0-40a4-4d1f-b9d4-9081b52787b3 tempest-VolumeQuotasAdminTestJSON-367548064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:05:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-c79ba5b0-40a4-4d1f-b9d4-9081b52787b3 tempest-VolumeQuotasAdminTestJSON-367548064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:05:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c79ba5b0-40a4-4d1f-b9d4-9081b52787b3 tempest-VolumeQuotasAdminTestJSON-367548064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:05:59 devstack sudo[103695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:05:59 devstack sudo[103695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:00 devstack sudo[103690]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-da0f3c3a-c218-47d5-9b19-8e56510674ea tempest-VolumesNegativeTest-95720529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e627525a-97fe-409b-8841-47406191b9cc" returned: 0 in 0.642s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:00 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-da0f3c3a-c218-47d5-9b19-8e56510674ea tempest-VolumesNegativeTest-95720529 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:06:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-da0f3c3a-c218-47d5-9b19-8e56510674ea tempest-VolumesNegativeTest-95720529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:06:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-da0f3c3a-c218-47d5-9b19-8e56510674ea tempest-VolumesNegativeTest-95720529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef575f8a-783e-4b94-8d7c-1d641de238e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e627525a-97fe-409b-8841-47406191b9cc', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-da0f3c3a-c218-47d5-9b19-8e56510674ea tempest-VolumesNegativeTest-95720529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5463e0f6-49e2-4737-9bf2-962e39d575ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:00 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-da0f3c3a-c218-47d5-9b19-8e56510674ea tempest-VolumesNegativeTest-95720529 None] Volume volume-e627525a-97fe-409b-8841-47406191b9cc (e627525a-97fe-409b-8841-47406191b9cc): created successfully Jun 24 05:06:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-da0f3c3a-c218-47d5-9b19-8e56510674ea tempest-VolumesNegativeTest-95720529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5463e0f6-49e2-4737-9bf2-962e39d575ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-da0f3c3a-c218-47d5-9b19-8e56510674ea tempest-VolumesNegativeTest-95720529 None] Flow 'volume_create_manager' (6cbef067-758d-432a-858a-f0ee7919fb4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:06:00 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-da0f3c3a-c218-47d5-9b19-8e56510674ea tempest-VolumesNegativeTest-95720529 None] Created volume successfully. Jun 24 05:06:00 devstack sudo[103689]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_o6acrrx5" returned: 1 in 0.832s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_o6acrrx5' failed. Not Retrying. {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 05:06:00 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5e8750-1169-4ca0-974b-17c52724824e]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:06:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_cn7wub7ydevstack@QuobyteHD {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:00 devstack sudo[103700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_cn7wub7ydevstack@QuobyteHD Jun 24 05:06:00 devstack sudo[103700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:00 devstack sudo[103695]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c79ba5b0-40a4-4d1f-b9d4-9081b52787b3 tempest-VolumeQuotasAdminTestJSON-367548064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.664s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:00 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-c79ba5b0-40a4-4d1f-b9d4-9081b52787b3 tempest-VolumeQuotasAdminTestJSON-367548064 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:06:00 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-c79ba5b0-40a4-4d1f-b9d4-9081b52787b3 tempest-VolumeQuotasAdminTestJSON-367548064 None] Deleted volume successfully. Jun 24 05:06:00 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-c79ba5b0-40a4-4d1f-b9d4-9081b52787b3 tempest-VolumeQuotasAdminTestJSON-367548064 None] Lock "cinder-c778c5aa-d636-411a-89a8-7f7c822356eb-delete_volume" released by "delete_volume" :: held 2.439s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:06:00 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-21754b2c-37bb-4c5b-9354-6a01bd677605 tempest-VolumeQuotasAdminTestJSON-367548064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:06:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-21754b2c-37bb-4c5b-9354-6a01bd677605 tempest-VolumeQuotasAdminTestJSON-367548064 None] Flow 'volume_create_manager' (1807a5f0-90d2-484e-8484-f91c27c00ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:06:00 devstack sudo[103700]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-21754b2c-37bb-4c5b-9354-6a01bd677605 tempest-VolumeQuotasAdminTestJSON-367548064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbfdabb5-6c27-4f28-8fc8-4de056750baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_cn7wub7ydevstack@QuobyteHD" returned: 0 in 0.757s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:00 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1 was qcow2, converting to raw {{(pid=93830) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 24 05:06:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_cn7wub7ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f63592ab-f0f4-437e-9e91-15a2e82829d5 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-21754b2c-37bb-4c5b-9354-6a01bd677605 tempest-VolumeQuotasAdminTestJSON-367548064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbfdabb5-6c27-4f28-8fc8-4de056750baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1599698539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b6571aa-8484-4a0e-8da3-920fcf837318,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0aceeab92e94370840b7b16e380da2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:06:01Z,use_quota=True,user_id='394ff74802474c05b697566c8e4b9eb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:01 devstack sudo[103720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_cn7wub7ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f63592ab-f0f4-437e-9e91-15a2e82829d5 Jun 24 05:06:01 devstack sudo[103720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-21754b2c-37bb-4c5b-9354-6a01bd677605 tempest-VolumeQuotasAdminTestJSON-367548064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b78438f-1fd1-43ba-ae5c-cd1d8d4df67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-21754b2c-37bb-4c5b-9354-6a01bd677605 tempest-VolumeQuotasAdminTestJSON-367548064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b78438f-1fd1-43ba-ae5c-cd1d8d4df67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-21754b2c-37bb-4c5b-9354-6a01bd677605 tempest-VolumeQuotasAdminTestJSON-367548064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (956fac53-cb1e-41c5-9cfe-698240abdc06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-21754b2c-37bb-4c5b-9354-6a01bd677605 tempest-VolumeQuotasAdminTestJSON-367548064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (956fac53-cb1e-41c5-9cfe-698240abdc06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b6571aa-8484-4a0e-8da3-920fcf837318', 'volume_name': 'volume-1b6571aa-8484-4a0e-8da3-920fcf837318', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-21754b2c-37bb-4c5b-9354-6a01bd677605 tempest-VolumeQuotasAdminTestJSON-367548064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8268d79f-b2dd-4b5f-bdb7-f17a67bc6f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-21754b2c-37bb-4c5b-9354-6a01bd677605 tempest-VolumeQuotasAdminTestJSON-367548064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8268d79f-b2dd-4b5f-bdb7-f17a67bc6f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-21754b2c-37bb-4c5b-9354-6a01bd677605 tempest-VolumeQuotasAdminTestJSON-367548064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c5e3ca9-a198-40b8-8fcd-b68fe949eb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:01 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-21754b2c-37bb-4c5b-9354-6a01bd677605 tempest-VolumeQuotasAdminTestJSON-367548064 None] Volume 1b6571aa-8484-4a0e-8da3-920fcf837318: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b6571aa-8484-4a0e-8da3-920fcf837318', 'volume_size': 1} Jun 24 05:06:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-21754b2c-37bb-4c5b-9354-6a01bd677605 tempest-VolumeQuotasAdminTestJSON-367548064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:06:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-21754b2c-37bb-4c5b-9354-6a01bd677605 tempest-VolumeQuotasAdminTestJSON-367548064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:06:01 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-21754b2c-37bb-4c5b-9354-6a01bd677605 tempest-VolumeQuotasAdminTestJSON-367548064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1599698539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b6571aa-8484-4a0e-8da3-920fcf837318,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0aceeab92e94370840b7b16e380da2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:06:01Z,use_quota=True,user_id='394ff74802474c05b697566c8e4b9eb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:06:01 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-21754b2c-37bb-4c5b-9354-6a01bd677605 tempest-VolumeQuotasAdminTestJSON-367548064 None] Creating volume 1b6571aa-8484-4a0e-8da3-920fcf837318 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:06:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-21754b2c-37bb-4c5b-9354-6a01bd677605 tempest-VolumeQuotasAdminTestJSON-367548064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:06:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-21754b2c-37bb-4c5b-9354-6a01bd677605 tempest-VolumeQuotasAdminTestJSON-367548064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:06:01 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-21754b2c-37bb-4c5b-9354-6a01bd677605 tempest-VolumeQuotasAdminTestJSON-367548064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:06:01 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-21754b2c-37bb-4c5b-9354-6a01bd677605 tempest-VolumeQuotasAdminTestJSON-367548064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:06:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-21754b2c-37bb-4c5b-9354-6a01bd677605 tempest-VolumeQuotasAdminTestJSON-367548064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:06:01 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-21754b2c-37bb-4c5b-9354-6a01bd677605 tempest-VolumeQuotasAdminTestJSON-367548064 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:06:01 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-21754b2c-37bb-4c5b-9354-6a01bd677605 tempest-VolumeQuotasAdminTestJSON-367548064 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:06:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-21754b2c-37bb-4c5b-9354-6a01bd677605 tempest-VolumeQuotasAdminTestJSON-367548064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-1b6571aa-8484-4a0e-8da3-920fcf837318 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:01 devstack sudo[103722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-1b6571aa-8484-4a0e-8da3-920fcf837318 1073741824 Jun 24 05:06:01 devstack sudo[103722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:02 devstack sudo[103722]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-21754b2c-37bb-4c5b-9354-6a01bd677605 tempest-VolumeQuotasAdminTestJSON-367548064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-1b6571aa-8484-4a0e-8da3-920fcf837318 1073741824" returned: 0 in 0.994s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-21754b2c-37bb-4c5b-9354-6a01bd677605 tempest-VolumeQuotasAdminTestJSON-367548064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-1b6571aa-8484-4a0e-8da3-920fcf837318 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:02 devstack sudo[103745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-1b6571aa-8484-4a0e-8da3-920fcf837318 Jun 24 05:06:02 devstack sudo[103745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:02 devstack sudo[103745]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-21754b2c-37bb-4c5b-9354-6a01bd677605 tempest-VolumeQuotasAdminTestJSON-367548064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-1b6571aa-8484-4a0e-8da3-920fcf837318" returned: 0 in 0.795s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:02 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-21754b2c-37bb-4c5b-9354-6a01bd677605 tempest-VolumeQuotasAdminTestJSON-367548064 None] <== create_volume: return (1834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:06:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-21754b2c-37bb-4c5b-9354-6a01bd677605 tempest-VolumeQuotasAdminTestJSON-367548064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.837s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:06:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-21754b2c-37bb-4c5b-9354-6a01bd677605 tempest-VolumeQuotasAdminTestJSON-367548064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c5e3ca9-a198-40b8-8fcd-b68fe949eb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b6571aa-8484-4a0e-8da3-920fcf837318', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-21754b2c-37bb-4c5b-9354-6a01bd677605 tempest-VolumeQuotasAdminTestJSON-367548064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ed5118-de4a-4d3f-93b6-fee01a5ea7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:02 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-21754b2c-37bb-4c5b-9354-6a01bd677605 tempest-VolumeQuotasAdminTestJSON-367548064 None] Volume volume-1b6571aa-8484-4a0e-8da3-920fcf837318 (1b6571aa-8484-4a0e-8da3-920fcf837318): created successfully Jun 24 05:06:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-21754b2c-37bb-4c5b-9354-6a01bd677605 tempest-VolumeQuotasAdminTestJSON-367548064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ed5118-de4a-4d3f-93b6-fee01a5ea7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-21754b2c-37bb-4c5b-9354-6a01bd677605 tempest-VolumeQuotasAdminTestJSON-367548064 None] Flow 'volume_create_manager' (1807a5f0-90d2-484e-8484-f91c27c00ba2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:06:02 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-21754b2c-37bb-4c5b-9354-6a01bd677605 tempest-VolumeQuotasAdminTestJSON-367548064 None] Created volume successfully. Jun 24 05:06:03 devstack sudo[103720]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_cn7wub7ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f63592ab-f0f4-437e-9e91-15a2e82829d5" returned: 0 in 2.371s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:03 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_cn7wub7ydevstack@QuobyteHD, size 112.00 MB, duration 2.37 sec, destination /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f63592ab-f0f4-437e-9e91-15a2e82829d5 {{(pid=93830) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 05:06:03 devstack cinder-volume[93830]: INFO cinder.image.image_utils [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Converted 112.00 MB image at 47.21 MB/s Jun 24 05:06:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f63592ab-f0f4-437e-9e91-15a2e82829d5 1G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:03 devstack sudo[103749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f63592ab-f0f4-437e-9e91-15a2e82829d5 1G Jun 24 05:06:03 devstack sudo[103749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:03 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-fe11146a-984d-48f0-962f-54c4bac73648 tempest-VolumeQuotasAdminTestJSON-211986191 None] Transfer volume completed successfully. Jun 24 05:06:04 devstack sudo[103749]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f63592ab-f0f4-437e-9e91-15a2e82829d5 1G" returned: 0 in 0.788s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:04 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4298406-848f-4421-82b2-16dacf6c471f]: (4, 'raw') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:06:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f63592ab-f0f4-437e-9e91-15a2e82829d5 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:04 devstack sudo[103760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f63592ab-f0f4-437e-9e91-15a2e82829d5 Jun 24 05:06:04 devstack sudo[103760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:04 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f1398805-9b22-4270-a11e-4646efdafe0a tempest-VolumeQuotasAdminTestJSON-1006063024 None] Acquiring lock "cinder-1b6571aa-8484-4a0e-8da3-920fcf837318-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:06:04 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f1398805-9b22-4270-a11e-4646efdafe0a tempest-VolumeQuotasAdminTestJSON-1006063024 None] Lock "cinder-1b6571aa-8484-4a0e-8da3-920fcf837318-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:06:04 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f1398805-9b22-4270-a11e-4646efdafe0a tempest-VolumeQuotasAdminTestJSON-1006063024 None] Acquiring lock "cinder-quobyte-1b6571aa-8484-4a0e-8da3-920fcf837318" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:06:04 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f1398805-9b22-4270-a11e-4646efdafe0a tempest-VolumeQuotasAdminTestJSON-1006063024 None] Lock "cinder-quobyte-1b6571aa-8484-4a0e-8da3-920fcf837318" acquired by "delete_volume" :: waited 0.017s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:06:04 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6695711-4d97-44c3-9bc2-952d66b1dbd2]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:06:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f1398805-9b22-4270-a11e-4646efdafe0a tempest-VolumeQuotasAdminTestJSON-1006063024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-1b6571aa-8484-4a0e-8da3-920fcf837318 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:04 devstack sudo[103760]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f63592ab-f0f4-437e-9e91-15a2e82829d5" returned: 0 in 0.764s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f63592ab-f0f4-437e-9e91-15a2e82829d5 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:05 devstack sudo[103764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-1b6571aa-8484-4a0e-8da3-920fcf837318 Jun 24 05:06:05 devstack sudo[103764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:05 devstack sudo[103765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f63592ab-f0f4-437e-9e91-15a2e82829d5 Jun 24 05:06:05 devstack sudo[103765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:05 devstack sudo[103765]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f63592ab-f0f4-437e-9e91-15a2e82829d5" returned: 1 in 0.735s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f63592ab-f0f4-437e-9e91-15a2e82829d5' failed. Not Retrying. {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 05:06:05 devstack cinder-volume[93830]: DEBUG cinder.volume.volume_utils [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Downloaded image f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1 ((None, [{'url': 'file:///opt/stack/data/glance/images/f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'metadata': {}}])) to volume f63592ab-f0f4-437e-9e91-15a2e82829d5 successfully. {{(pid=93830) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 24 05:06:05 devstack sudo[103764]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:05 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Temporary image f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1 for user 0963985d5fac4d9ba5a5d45cfd0c1ace is deleted. {{(pid=93830) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 24 05:06:05 devstack cinder-volume[93830]: DEBUG cinder.volume.volume_utils [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Marking volume f63592ab-f0f4-437e-9e91-15a2e82829d5 as bootable. {{(pid=93830) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 24 05:06:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f1398805-9b22-4270-a11e-4646efdafe0a tempest-VolumeQuotasAdminTestJSON-1006063024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-1b6571aa-8484-4a0e-8da3-920fcf837318" returned: 0 in 0.797s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f1398805-9b22-4270-a11e-4646efdafe0a tempest-VolumeQuotasAdminTestJSON-1006063024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-1b6571aa-8484-4a0e-8da3-920fcf837318 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:05 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Copying metadata from image f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1 to f63592ab-f0f4-437e-9e91-15a2e82829d5. {{(pid=93830) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 24 05:06:05 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Creating volume glance metadata for volume f63592ab-f0f4-437e-9e91-15a2e82829d5 backed by image f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93830) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 24 05:06:05 devstack sudo[103774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-1b6571aa-8484-4a0e-8da3-920fcf837318 Jun 24 05:06:05 devstack sudo[103774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:05 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7446fe5-211e-48e8-bbad-1254c6717c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f63592ab-f0f4-437e-9e91-15a2e82829d5', 'volume_size': 1, 'image_id': 'f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f7b9466e67614ef6a2783f0123a80489', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'created_at': datetime.datetime(2026, 6, 24, 2, 51, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 51, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:05 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a657c14-c027-4f8a-9dff-9e9f5778a7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:05 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Volume volume-f63592ab-f0f4-437e-9e91-15a2e82829d5 (f63592ab-f0f4-437e-9e91-15a2e82829d5): created successfully Jun 24 05:06:05 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a657c14-c027-4f8a-9dff-9e9f5778a7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:05 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Flow 'volume_create_manager' (6929397d-1b70-4cff-bca3-c3241d3807f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:06:05 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-9e33b9b9-8377-438d-99c9-c7d296609c57 tempest-VolumesGetTest-404075134 None] Created volume successfully. Jun 24 05:06:06 devstack sudo[103774]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f1398805-9b22-4270-a11e-4646efdafe0a tempest-VolumeQuotasAdminTestJSON-1006063024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-1b6571aa-8484-4a0e-8da3-920fcf837318" returned: 0 in 0.734s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:06 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f1398805-9b22-4270-a11e-4646efdafe0a tempest-VolumeQuotasAdminTestJSON-1006063024 None] Lock "cinder-quobyte-1b6571aa-8484-4a0e-8da3-920fcf837318" released by "delete_volume" :: held 1.573s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:06:06 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-f1398805-9b22-4270-a11e-4646efdafe0a tempest-VolumeQuotasAdminTestJSON-1006063024 None] Created reservations ['5601dfac-5968-48cb-8a72-9d9d47761291', 'd92aeda6-cb7c-40b5-b38c-f915512bd6e6', '522491d5-3177-4db2-9a46-5908f91e3d7f', '1ca42ee1-fa76-467c-b1e0-2b4c36888918'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:06:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f1398805-9b22-4270-a11e-4646efdafe0a tempest-VolumeQuotasAdminTestJSON-1006063024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:06:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f1398805-9b22-4270-a11e-4646efdafe0a tempest-VolumeQuotasAdminTestJSON-1006063024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:06:06 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f1398805-9b22-4270-a11e-4646efdafe0a tempest-VolumeQuotasAdminTestJSON-1006063024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:06:06 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f1398805-9b22-4270-a11e-4646efdafe0a tempest-VolumeQuotasAdminTestJSON-1006063024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:06:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f1398805-9b22-4270-a11e-4646efdafe0a tempest-VolumeQuotasAdminTestJSON-1006063024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:06:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f1398805-9b22-4270-a11e-4646efdafe0a tempest-VolumeQuotasAdminTestJSON-1006063024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:06 devstack sudo[103777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:06:06 devstack sudo[103777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:06 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-13af2945-451c-46b7-abc6-1b1a2b9e0ef5 tempest-VolumesGetTest-404075134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:06:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-13af2945-451c-46b7-abc6-1b1a2b9e0ef5 tempest-VolumesGetTest-404075134 None] Flow 'volume_create_manager' (1336e75c-3430-48eb-9461-3e0f21827a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:06:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-13af2945-451c-46b7-abc6-1b1a2b9e0ef5 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (191bff2a-66a0-4f2a-806f-6415fcdedf6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-13af2945-451c-46b7-abc6-1b1a2b9e0ef5 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (191bff2a-66a0-4f2a-806f-6415fcdedf6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:06:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-779794906',display_name='tempest-VolumesGetTest-Volume-363104706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffaafa32-78d5-44b3-9982-da904f6abcf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8533bbf2c191435d8768a59ae13e2d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:06:07Z,use_quota=True,user_id='0963985d5fac4d9ba5a5d45cfd0c1ace',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-13af2945-451c-46b7-abc6-1b1a2b9e0ef5 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b368a1b3-3fcf-4d4b-9400-d15f1b3a8ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-13af2945-451c-46b7-abc6-1b1a2b9e0ef5 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b368a1b3-3fcf-4d4b-9400-d15f1b3a8ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-13af2945-451c-46b7-abc6-1b1a2b9e0ef5 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (899f53eb-ee80-4b7b-ba2d-8b35170559af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-13af2945-451c-46b7-abc6-1b1a2b9e0ef5 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (899f53eb-ee80-4b7b-ba2d-8b35170559af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffaafa32-78d5-44b3-9982-da904f6abcf2', 'volume_name': 'volume-ffaafa32-78d5-44b3-9982-da904f6abcf2', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-13af2945-451c-46b7-abc6-1b1a2b9e0ef5 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8f8e4c4-225c-4367-ac83-30f4b4fb607f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-13af2945-451c-46b7-abc6-1b1a2b9e0ef5 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8f8e4c4-225c-4367-ac83-30f4b4fb607f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-13af2945-451c-46b7-abc6-1b1a2b9e0ef5 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d54e021-4a24-4c60-be3d-0527a3aca591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:07 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-13af2945-451c-46b7-abc6-1b1a2b9e0ef5 tempest-VolumesGetTest-404075134 None] Volume ffaafa32-78d5-44b3-9982-da904f6abcf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffaafa32-78d5-44b3-9982-da904f6abcf2', 'volume_size': 1} Jun 24 05:06:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-13af2945-451c-46b7-abc6-1b1a2b9e0ef5 tempest-VolumesGetTest-404075134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:06:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-13af2945-451c-46b7-abc6-1b1a2b9e0ef5 tempest-VolumesGetTest-404075134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:06:07 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-13af2945-451c-46b7-abc6-1b1a2b9e0ef5 tempest-VolumesGetTest-404075134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:06:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-779794906',display_name='tempest-VolumesGetTest-Volume-363104706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffaafa32-78d5-44b3-9982-da904f6abcf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8533bbf2c191435d8768a59ae13e2d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:06:07Z,use_quota=True,user_id='0963985d5fac4d9ba5a5d45cfd0c1ace',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:06:07 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-13af2945-451c-46b7-abc6-1b1a2b9e0ef5 tempest-VolumesGetTest-404075134 None] Creating volume ffaafa32-78d5-44b3-9982-da904f6abcf2 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:06:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-13af2945-451c-46b7-abc6-1b1a2b9e0ef5 tempest-VolumesGetTest-404075134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:06:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-13af2945-451c-46b7-abc6-1b1a2b9e0ef5 tempest-VolumesGetTest-404075134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:06:07 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-13af2945-451c-46b7-abc6-1b1a2b9e0ef5 tempest-VolumesGetTest-404075134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:06:07 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-13af2945-451c-46b7-abc6-1b1a2b9e0ef5 tempest-VolumesGetTest-404075134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:06:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-13af2945-451c-46b7-abc6-1b1a2b9e0ef5 tempest-VolumesGetTest-404075134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:06:07 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-13af2945-451c-46b7-abc6-1b1a2b9e0ef5 tempest-VolumesGetTest-404075134 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:06:07 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-13af2945-451c-46b7-abc6-1b1a2b9e0ef5 tempest-VolumesGetTest-404075134 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:06:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-13af2945-451c-46b7-abc6-1b1a2b9e0ef5 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ffaafa32-78d5-44b3-9982-da904f6abcf2 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:07 devstack sudo[103781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ffaafa32-78d5-44b3-9982-da904f6abcf2 1073741824 Jun 24 05:06:07 devstack sudo[103781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:07 devstack sudo[103777]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f1398805-9b22-4270-a11e-4646efdafe0a tempest-VolumeQuotasAdminTestJSON-1006063024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 1.228s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:07 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-f1398805-9b22-4270-a11e-4646efdafe0a tempest-VolumeQuotasAdminTestJSON-1006063024 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:06:07 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-f1398805-9b22-4270-a11e-4646efdafe0a tempest-VolumeQuotasAdminTestJSON-1006063024 None] Deleted volume successfully. Jun 24 05:06:07 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f1398805-9b22-4270-a11e-4646efdafe0a tempest-VolumeQuotasAdminTestJSON-1006063024 None] Lock "cinder-1b6571aa-8484-4a0e-8da3-920fcf837318-delete_volume" released by "delete_volume" :: held 3.073s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:06:08 devstack sudo[103781]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-13af2945-451c-46b7-abc6-1b1a2b9e0ef5 tempest-VolumesGetTest-404075134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ffaafa32-78d5-44b3-9982-da904f6abcf2 1073741824" returned: 0 in 1.241s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-13af2945-451c-46b7-abc6-1b1a2b9e0ef5 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ffaafa32-78d5-44b3-9982-da904f6abcf2 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:08 devstack sudo[103790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ffaafa32-78d5-44b3-9982-da904f6abcf2 Jun 24 05:06:08 devstack sudo[103790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:09 devstack sudo[103790]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-13af2945-451c-46b7-abc6-1b1a2b9e0ef5 tempest-VolumesGetTest-404075134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ffaafa32-78d5-44b3-9982-da904f6abcf2" returned: 0 in 1.026s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-13af2945-451c-46b7-abc6-1b1a2b9e0ef5 tempest-VolumesGetTest-404075134 None] <== create_volume: return (2323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:06:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-13af2945-451c-46b7-abc6-1b1a2b9e0ef5 tempest-VolumesGetTest-404075134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.326s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:06:09 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-13af2945-451c-46b7-abc6-1b1a2b9e0ef5 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d54e021-4a24-4c60-be3d-0527a3aca591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffaafa32-78d5-44b3-9982-da904f6abcf2', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:09 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-13af2945-451c-46b7-abc6-1b1a2b9e0ef5 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84706c19-45cc-4ae6-a959-88a47012a8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:09 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-13af2945-451c-46b7-abc6-1b1a2b9e0ef5 tempest-VolumesGetTest-404075134 None] Volume volume-ffaafa32-78d5-44b3-9982-da904f6abcf2 (ffaafa32-78d5-44b3-9982-da904f6abcf2): created successfully Jun 24 05:06:09 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-13af2945-451c-46b7-abc6-1b1a2b9e0ef5 tempest-VolumesGetTest-404075134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84706c19-45cc-4ae6-a959-88a47012a8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:09 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-13af2945-451c-46b7-abc6-1b1a2b9e0ef5 tempest-VolumesGetTest-404075134 None] Flow 'volume_create_manager' (1336e75c-3430-48eb-9461-3e0f21827a5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:06:09 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-13af2945-451c-46b7-abc6-1b1a2b9e0ef5 tempest-VolumesGetTest-404075134 None] Created volume successfully. Jun 24 05:06:09 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 05:06:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:06:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:06:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:06:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:06:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:06:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:09 devstack sudo[103850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:06:09 devstack sudo[103850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:10 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-5358f2c5-1bd3-41aa-a252-01d4d2c7e3f3 tempest-VolumesGetTest-404075134 None] Acquiring lock "cinder-ffaafa32-78d5-44b3-9982-da904f6abcf2-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:06:10 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-5358f2c5-1bd3-41aa-a252-01d4d2c7e3f3 tempest-VolumesGetTest-404075134 None] Lock "cinder-ffaafa32-78d5-44b3-9982-da904f6abcf2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:06:10 devstack sudo[103850]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.781s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:10 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:06:10 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager._thread_info {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 05:06:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread count: 29 {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 05:06:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread info: [<_MainThread(MainThread, started 130211312517248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 05:06:10 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-5358f2c5-1bd3-41aa-a252-01d4d2c7e3f3 tempest-VolumesGetTest-404075134 None] Acquiring lock "cinder-quobyte-ffaafa32-78d5-44b3-9982-da904f6abcf2" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:06:10 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-5358f2c5-1bd3-41aa-a252-01d4d2c7e3f3 tempest-VolumesGetTest-404075134 None] Lock "cinder-quobyte-ffaafa32-78d5-44b3-9982-da904f6abcf2" acquired by "delete_volume" :: waited 0.019s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:06:10 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a684ca9-54c5-4f27-813e-090c0946edef]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:06:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5358f2c5-1bd3-41aa-a252-01d4d2c7e3f3 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ffaafa32-78d5-44b3-9982-da904f6abcf2 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:10 devstack sudo[103856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ffaafa32-78d5-44b3-9982-da904f6abcf2 Jun 24 05:06:10 devstack sudo[103856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:11 devstack sudo[103856]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5358f2c5-1bd3-41aa-a252-01d4d2c7e3f3 tempest-VolumesGetTest-404075134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ffaafa32-78d5-44b3-9982-da904f6abcf2" returned: 0 in 0.935s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5358f2c5-1bd3-41aa-a252-01d4d2c7e3f3 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ffaafa32-78d5-44b3-9982-da904f6abcf2 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:11 devstack sudo[103863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ffaafa32-78d5-44b3-9982-da904f6abcf2 Jun 24 05:06:11 devstack sudo[103863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:12 devstack sudo[103863]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5358f2c5-1bd3-41aa-a252-01d4d2c7e3f3 tempest-VolumesGetTest-404075134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ffaafa32-78d5-44b3-9982-da904f6abcf2" returned: 0 in 0.865s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:12 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-5358f2c5-1bd3-41aa-a252-01d4d2c7e3f3 tempest-VolumesGetTest-404075134 None] Lock "cinder-quobyte-ffaafa32-78d5-44b3-9982-da904f6abcf2" released by "delete_volume" :: held 1.863s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:06:12 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-5358f2c5-1bd3-41aa-a252-01d4d2c7e3f3 tempest-VolumesGetTest-404075134 None] Created reservations ['05361957-1e54-4e61-8467-5f9a2a4aa0a1', '457b0a46-bbaf-4f2b-91c9-fdd065c515d1', 'c974b892-92d6-42df-9b96-fdfff66a24f9', '15b8cb0c-0364-45fb-a18b-3cb7d68f87aa'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:06:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5358f2c5-1bd3-41aa-a252-01d4d2c7e3f3 tempest-VolumesGetTest-404075134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:06:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5358f2c5-1bd3-41aa-a252-01d4d2c7e3f3 tempest-VolumesGetTest-404075134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:06:12 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-5358f2c5-1bd3-41aa-a252-01d4d2c7e3f3 tempest-VolumesGetTest-404075134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:06:12 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-5358f2c5-1bd3-41aa-a252-01d4d2c7e3f3 tempest-VolumesGetTest-404075134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:06:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5358f2c5-1bd3-41aa-a252-01d4d2c7e3f3 tempest-VolumesGetTest-404075134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:06:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5358f2c5-1bd3-41aa-a252-01d4d2c7e3f3 tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:12 devstack sudo[103867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:06:12 devstack sudo[103867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:12 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-0877d2b0-ca1e-4ab5-a14c-4f8aa79289ec tempest-VolumesGetTest-404075134 None] Acquiring lock "cinder-f63592ab-f0f4-437e-9e91-15a2e82829d5-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:06:12 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-0877d2b0-ca1e-4ab5-a14c-4f8aa79289ec tempest-VolumesGetTest-404075134 None] Lock "cinder-f63592ab-f0f4-437e-9e91-15a2e82829d5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:06:12 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-0877d2b0-ca1e-4ab5-a14c-4f8aa79289ec tempest-VolumesGetTest-404075134 None] Acquiring lock "cinder-quobyte-f63592ab-f0f4-437e-9e91-15a2e82829d5" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:06:12 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-0877d2b0-ca1e-4ab5-a14c-4f8aa79289ec tempest-VolumesGetTest-404075134 None] Lock "cinder-quobyte-f63592ab-f0f4-437e-9e91-15a2e82829d5" acquired by "delete_volume" :: waited 0.038s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:06:13 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e39e56-ff17-4f59-b079-ac5c3795553e]: (4, 'raw') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:06:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0877d2b0-ca1e-4ab5-a14c-4f8aa79289ec tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f63592ab-f0f4-437e-9e91-15a2e82829d5 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:13 devstack sudo[103869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f63592ab-f0f4-437e-9e91-15a2e82829d5 Jun 24 05:06:13 devstack sudo[103869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5358f2c5-1bd3-41aa-a252-01d4d2c7e3f3 tempest-VolumesGetTest-404075134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.817s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:13 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-5358f2c5-1bd3-41aa-a252-01d4d2c7e3f3 tempest-VolumesGetTest-404075134 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:06:13 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-5358f2c5-1bd3-41aa-a252-01d4d2c7e3f3 tempest-VolumesGetTest-404075134 None] Deleted volume successfully. Jun 24 05:06:13 devstack sudo[103867]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:13 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-5358f2c5-1bd3-41aa-a252-01d4d2c7e3f3 tempest-VolumesGetTest-404075134 None] Lock "cinder-ffaafa32-78d5-44b3-9982-da904f6abcf2-delete_volume" released by "delete_volume" :: held 3.000s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:06:14 devstack sudo[103869]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:14 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0877d2b0-ca1e-4ab5-a14c-4f8aa79289ec tempest-VolumesGetTest-404075134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f63592ab-f0f4-437e-9e91-15a2e82829d5" returned: 0 in 1.054s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:14 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0877d2b0-ca1e-4ab5-a14c-4f8aa79289ec tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f63592ab-f0f4-437e-9e91-15a2e82829d5 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:14 devstack sudo[103878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f63592ab-f0f4-437e-9e91-15a2e82829d5 Jun 24 05:06:14 devstack sudo[103878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:14 devstack sudo[103878]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:14 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0877d2b0-ca1e-4ab5-a14c-4f8aa79289ec tempest-VolumesGetTest-404075134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f63592ab-f0f4-437e-9e91-15a2e82829d5" returned: 1 in 0.778s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:14 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0877d2b0-ca1e-4ab5-a14c-4f8aa79289ec tempest-VolumesGetTest-404075134 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f63592ab-f0f4-437e-9e91-15a2e82829d5' failed. Not Retrying. {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 05:06:14 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0877d2b0-ca1e-4ab5-a14c-4f8aa79289ec tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f63592ab-f0f4-437e-9e91-15a2e82829d5 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:14 devstack sudo[103883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f63592ab-f0f4-437e-9e91-15a2e82829d5 Jun 24 05:06:14 devstack sudo[103883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:15 devstack sudo[103883]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0877d2b0-ca1e-4ab5-a14c-4f8aa79289ec tempest-VolumesGetTest-404075134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f63592ab-f0f4-437e-9e91-15a2e82829d5" returned: 0 in 0.725s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:15 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-0877d2b0-ca1e-4ab5-a14c-4f8aa79289ec tempest-VolumesGetTest-404075134 None] Lock "cinder-quobyte-f63592ab-f0f4-437e-9e91-15a2e82829d5" released by "delete_volume" :: held 2.681s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:06:15 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-0877d2b0-ca1e-4ab5-a14c-4f8aa79289ec tempest-VolumesGetTest-404075134 None] Created reservations ['ac7113bc-0f2c-416b-837e-b7eb5a8b1100', 'e6ef9d0b-2ebf-474f-ac25-5627e4c9663e', '8a9de57a-85ab-4945-88c9-5fbbdd7bf8ad', '811dfa97-92f7-42e6-a08b-470d88d5dfbd'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:06:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-0877d2b0-ca1e-4ab5-a14c-4f8aa79289ec tempest-VolumesGetTest-404075134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:06:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-0877d2b0-ca1e-4ab5-a14c-4f8aa79289ec tempest-VolumesGetTest-404075134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:06:15 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-0877d2b0-ca1e-4ab5-a14c-4f8aa79289ec tempest-VolumesGetTest-404075134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:06:15 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-0877d2b0-ca1e-4ab5-a14c-4f8aa79289ec tempest-VolumesGetTest-404075134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:06:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-0877d2b0-ca1e-4ab5-a14c-4f8aa79289ec tempest-VolumesGetTest-404075134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:06:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0877d2b0-ca1e-4ab5-a14c-4f8aa79289ec tempest-VolumesGetTest-404075134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:15 devstack sudo[103901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:06:15 devstack sudo[103901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:17 devstack sudo[103901]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0877d2b0-ca1e-4ab5-a14c-4f8aa79289ec tempest-VolumesGetTest-404075134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 1.641s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:17 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-0877d2b0-ca1e-4ab5-a14c-4f8aa79289ec tempest-VolumesGetTest-404075134 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:06:17 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-0877d2b0-ca1e-4ab5-a14c-4f8aa79289ec tempest-VolumesGetTest-404075134 None] Deleted volume successfully. Jun 24 05:06:17 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-0877d2b0-ca1e-4ab5-a14c-4f8aa79289ec tempest-VolumesGetTest-404075134 None] Lock "cinder-f63592ab-f0f4-437e-9e91-15a2e82829d5-delete_volume" released by "delete_volume" :: held 4.627s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:06:21 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-bfdd1341-ac9e-4732-979c-38ba51db1597 req-dfbc39c9-0645-4842-b037-b20bd345818b tempest-AttachVolumeNegativeTest-111486486 None] Terminate volume connection completed successfully. Jun 24 05:06:21 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-bfdd1341-ac9e-4732-979c-38ba51db1597 req-dfbc39c9-0645-4842-b037-b20bd345818b tempest-AttachVolumeNegativeTest-111486486 None] Deleting attachment 06a2bd2f-c1b1-4a21-bb96-b990e26b0c33. {{(pid=93830) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 05:06:25 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ed40de7-c5eb-4296-a2b3-86edd5dca78d tempest-VolumesSnapshotListTestJSON-495348509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:06:25 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-0ed40de7-c5eb-4296-a2b3-86edd5dca78d tempest-VolumesSnapshotListTestJSON-495348509 None] Flow 'volume_create_manager' (70ffcb73-2d76-45ef-84fe-058a8ab7f1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:06:25 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-0ed40de7-c5eb-4296-a2b3-86edd5dca78d tempest-VolumesSnapshotListTestJSON-495348509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35f28222-2bdd-4d31-bb68-a11722391f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:25 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-0ed40de7-c5eb-4296-a2b3-86edd5dca78d tempest-VolumesSnapshotListTestJSON-495348509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35f28222-2bdd-4d31-bb68-a11722391f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1260220134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=036704a1-68c7-4408-95b5-7b3e4a2f7b66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='750e046982524b968a44bd3246b0adee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:06:26Z,use_quota=True,user_id='ce336e88165f4273a2b31c1ff69b0c0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:25 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-0ed40de7-c5eb-4296-a2b3-86edd5dca78d tempest-VolumesSnapshotListTestJSON-495348509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d4ed459-5f52-4149-bf50-ae159056ec7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:25 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-0ed40de7-c5eb-4296-a2b3-86edd5dca78d tempest-VolumesSnapshotListTestJSON-495348509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d4ed459-5f52-4149-bf50-ae159056ec7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:25 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-0ed40de7-c5eb-4296-a2b3-86edd5dca78d tempest-VolumesSnapshotListTestJSON-495348509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77d0757e-c0d9-4b81-ae70-5dd163eee6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:25 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-0ed40de7-c5eb-4296-a2b3-86edd5dca78d tempest-VolumesSnapshotListTestJSON-495348509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77d0757e-c0d9-4b81-ae70-5dd163eee6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '036704a1-68c7-4408-95b5-7b3e4a2f7b66', 'volume_name': 'volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:25 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-0ed40de7-c5eb-4296-a2b3-86edd5dca78d tempest-VolumesSnapshotListTestJSON-495348509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a221d845-9dc0-43f2-aacd-62d0da033cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:25 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-0ed40de7-c5eb-4296-a2b3-86edd5dca78d tempest-VolumesSnapshotListTestJSON-495348509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a221d845-9dc0-43f2-aacd-62d0da033cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:26 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-0ed40de7-c5eb-4296-a2b3-86edd5dca78d tempest-VolumesSnapshotListTestJSON-495348509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3935641e-2b03-41b6-9c13-c4c1a5557965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:26 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-0ed40de7-c5eb-4296-a2b3-86edd5dca78d tempest-VolumesSnapshotListTestJSON-495348509 None] Volume 036704a1-68c7-4408-95b5-7b3e4a2f7b66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66', 'volume_size': 1} Jun 24 05:06:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-0ed40de7-c5eb-4296-a2b3-86edd5dca78d tempest-VolumesSnapshotListTestJSON-495348509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:06:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-0ed40de7-c5eb-4296-a2b3-86edd5dca78d tempest-VolumesSnapshotListTestJSON-495348509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:06:26 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-0ed40de7-c5eb-4296-a2b3-86edd5dca78d tempest-VolumesSnapshotListTestJSON-495348509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1260220134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=036704a1-68c7-4408-95b5-7b3e4a2f7b66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='750e046982524b968a44bd3246b0adee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:06:26Z,use_quota=True,user_id='ce336e88165f4273a2b31c1ff69b0c0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:06:26 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-0ed40de7-c5eb-4296-a2b3-86edd5dca78d tempest-VolumesSnapshotListTestJSON-495348509 None] Creating volume 036704a1-68c7-4408-95b5-7b3e4a2f7b66 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:06:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-0ed40de7-c5eb-4296-a2b3-86edd5dca78d tempest-VolumesSnapshotListTestJSON-495348509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:06:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-0ed40de7-c5eb-4296-a2b3-86edd5dca78d tempest-VolumesSnapshotListTestJSON-495348509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:06:26 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-0ed40de7-c5eb-4296-a2b3-86edd5dca78d tempest-VolumesSnapshotListTestJSON-495348509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:06:26 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-0ed40de7-c5eb-4296-a2b3-86edd5dca78d tempest-VolumesSnapshotListTestJSON-495348509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:06:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-0ed40de7-c5eb-4296-a2b3-86edd5dca78d tempest-VolumesSnapshotListTestJSON-495348509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:06:26 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-0ed40de7-c5eb-4296-a2b3-86edd5dca78d tempest-VolumesSnapshotListTestJSON-495348509 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:06:26 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-0ed40de7-c5eb-4296-a2b3-86edd5dca78d tempest-VolumesSnapshotListTestJSON-495348509 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:06:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0ed40de7-c5eb-4296-a2b3-86edd5dca78d tempest-VolumesSnapshotListTestJSON-495348509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:26 devstack sudo[104072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66 1073741824 Jun 24 05:06:26 devstack sudo[104072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:27 devstack sudo[104072]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0ed40de7-c5eb-4296-a2b3-86edd5dca78d tempest-VolumesSnapshotListTestJSON-495348509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66 1073741824" returned: 0 in 1.213s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0ed40de7-c5eb-4296-a2b3-86edd5dca78d tempest-VolumesSnapshotListTestJSON-495348509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:27 devstack sudo[104080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66 Jun 24 05:06:27 devstack sudo[104080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:28 devstack sudo[104080]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0ed40de7-c5eb-4296-a2b3-86edd5dca78d tempest-VolumesSnapshotListTestJSON-495348509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66" returned: 0 in 0.835s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:28 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-0ed40de7-c5eb-4296-a2b3-86edd5dca78d tempest-VolumesSnapshotListTestJSON-495348509 None] <== create_volume: return (2096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:06:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-0ed40de7-c5eb-4296-a2b3-86edd5dca78d tempest-VolumesSnapshotListTestJSON-495348509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.098s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:06:28 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-0ed40de7-c5eb-4296-a2b3-86edd5dca78d tempest-VolumesSnapshotListTestJSON-495348509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3935641e-2b03-41b6-9c13-c4c1a5557965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:28 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-0ed40de7-c5eb-4296-a2b3-86edd5dca78d tempest-VolumesSnapshotListTestJSON-495348509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d538e11-620d-403a-b5da-a41531a89ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:28 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-0ed40de7-c5eb-4296-a2b3-86edd5dca78d tempest-VolumesSnapshotListTestJSON-495348509 None] Volume volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66 (036704a1-68c7-4408-95b5-7b3e4a2f7b66): created successfully Jun 24 05:06:28 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-0ed40de7-c5eb-4296-a2b3-86edd5dca78d tempest-VolumesSnapshotListTestJSON-495348509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d538e11-620d-403a-b5da-a41531a89ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:28 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-0ed40de7-c5eb-4296-a2b3-86edd5dca78d tempest-VolumesSnapshotListTestJSON-495348509 None] Flow 'volume_create_manager' (70ffcb73-2d76-45ef-84fe-058a8ab7f1dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:06:28 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-0ed40de7-c5eb-4296-a2b3-86edd5dca78d tempest-VolumesSnapshotListTestJSON-495348509 None] Created volume successfully. Jun 24 05:06:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-caec80c9-5926-4ac8-9d34-a33847b7e9ff tempest-VolumesSnapshotListTestJSON-495348509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:06:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-caec80c9-5926-4ac8-9d34-a33847b7e9ff tempest-VolumesSnapshotListTestJSON-495348509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:06:29 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-caec80c9-5926-4ac8-9d34-a33847b7e9ff tempest-VolumesSnapshotListTestJSON-495348509 None] Creating offline snapshot 6bede0a7-39bc-451b-b457-080547a822ee of volume 036704a1-68c7-4408-95b5-7b3e4a2f7b66 {{(pid=93830) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 05:06:29 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c183dc-c7d4-4593-86e8-36b007239af8]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:06:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-caec80c9-5926-4ac8-9d34-a33847b7e9ff tempest-VolumesSnapshotListTestJSON-495348509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:29 devstack sudo[104121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66 Jun 24 05:06:29 devstack sudo[104121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:30 devstack sudo[104121]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-caec80c9-5926-4ac8-9d34-a33847b7e9ff tempest-VolumesSnapshotListTestJSON-495348509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66" returned: 0 in 0.948s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-caec80c9-5926-4ac8-9d34-a33847b7e9ff tempest-VolumesSnapshotListTestJSON-495348509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.6bede0a7-39bc-451b-b457-080547a822ee 1G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:30 devstack sudo[104127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.6bede0a7-39bc-451b-b457-080547a822ee 1G Jun 24 05:06:30 devstack sudo[104127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:31 devstack sudo[104127]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-caec80c9-5926-4ac8-9d34-a33847b7e9ff tempest-VolumesSnapshotListTestJSON-495348509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.6bede0a7-39bc-451b-b457-080547a822ee 1G" returned: 0 in 0.888s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-caec80c9-5926-4ac8-9d34-a33847b7e9ff tempest-VolumesSnapshotListTestJSON-495348509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.6bede0a7-39bc-451b-b457-080547a822ee {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:31 devstack sudo[104136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.6bede0a7-39bc-451b-b457-080547a822ee Jun 24 05:06:31 devstack sudo[104136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:31 devstack sudo[104136]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-caec80c9-5926-4ac8-9d34-a33847b7e9ff tempest-VolumesSnapshotListTestJSON-495348509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.6bede0a7-39bc-451b-b457-080547a822ee" returned: 0 in 0.874s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:31 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-caec80c9-5926-4ac8-9d34-a33847b7e9ff tempest-VolumesSnapshotListTestJSON-495348509 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.6bede0a7-39bc-451b-b457-080547a822ee is being set with open permissions: ugo+rw Jun 24 05:06:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-caec80c9-5926-4ac8-9d34-a33847b7e9ff tempest-VolumesSnapshotListTestJSON-495348509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.6bede0a7-39bc-451b-b457-080547a822ee {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:31 devstack sudo[104141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.6bede0a7-39bc-451b-b457-080547a822ee Jun 24 05:06:31 devstack sudo[104141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:32 devstack sudo[104141]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-caec80c9-5926-4ac8-9d34-a33847b7e9ff tempest-VolumesSnapshotListTestJSON-495348509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.6bede0a7-39bc-451b-b457-080547a822ee" returned: 0 in 0.894s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-caec80c9-5926-4ac8-9d34-a33847b7e9ff tempest-VolumesSnapshotListTestJSON-495348509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:32 devstack sudo[104145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.info Jun 24 05:06:32 devstack sudo[104145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:33 devstack sudo[104145]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-caec80c9-5926-4ac8-9d34-a33847b7e9ff tempest-VolumesSnapshotListTestJSON-495348509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.info" returned: 0 in 1.012s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:33 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-caec80c9-5926-4ac8-9d34-a33847b7e9ff tempest-VolumesSnapshotListTestJSON-495348509 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.info is being set with open permissions: ugo+rw Jun 24 05:06:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-caec80c9-5926-4ac8-9d34-a33847b7e9ff tempest-VolumesSnapshotListTestJSON-495348509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:33 devstack sudo[104148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.info Jun 24 05:06:33 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:34 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-caec80c9-5926-4ac8-9d34-a33847b7e9ff tempest-VolumesSnapshotListTestJSON-495348509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.info" returned: 0 in 0.805s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-caec80c9-5926-4ac8-9d34-a33847b7e9ff tempest-VolumesSnapshotListTestJSON-495348509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.543s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:06:34 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-caec80c9-5926-4ac8-9d34-a33847b7e9ff tempest-VolumesSnapshotListTestJSON-495348509 None] Create snapshot completed successfully Jun 24 05:06:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-6896f038-9636-4faa-9093-b4c05ba92e40 tempest-VolumesSnapshotListTestJSON-495348509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:06:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-6896f038-9636-4faa-9093-b4c05ba92e40 tempest-VolumesSnapshotListTestJSON-495348509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:06:35 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-6896f038-9636-4faa-9093-b4c05ba92e40 tempest-VolumesSnapshotListTestJSON-495348509 None] Creating offline snapshot 08648313-6d9f-49df-a50f-9e6d280fb1b2 of volume 036704a1-68c7-4408-95b5-7b3e4a2f7b66 {{(pid=93830) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 05:06:35 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a51d2d-3003-4f7f-b649-317f735390cc]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:06:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6896f038-9636-4faa-9093-b4c05ba92e40 tempest-VolumesSnapshotListTestJSON-495348509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.6bede0a7-39bc-451b-b457-080547a822ee {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:36 devstack sudo[104152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.6bede0a7-39bc-451b-b457-080547a822ee Jun 24 05:06:36 devstack sudo[104152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:36 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-243439c6-31ed-4fee-89cd-d3e02bda7bcb tempest-VolumesTransfersV355Test-91951047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:06:36 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-243439c6-31ed-4fee-89cd-d3e02bda7bcb tempest-VolumesTransfersV355Test-91951047 None] Flow 'volume_create_manager' (a950f05f-ce9c-46a9-b45d-5e15c7c23304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:06:36 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-243439c6-31ed-4fee-89cd-d3e02bda7bcb tempest-VolumesTransfersV355Test-91951047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (734a58c1-26cc-4cab-beb8-c1522543e158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:36 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-243439c6-31ed-4fee-89cd-d3e02bda7bcb tempest-VolumesTransfersV355Test-91951047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (734a58c1-26cc-4cab-beb8-c1522543e158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-152233081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=924df8e5-dbd1-4d45-9500-ec00f276eb9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='393d9bcdc9d24c4bb28d6182602927a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:06:37Z,use_quota=True,user_id='87f104326a144147b4046f10170e9ff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:36 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-243439c6-31ed-4fee-89cd-d3e02bda7bcb tempest-VolumesTransfersV355Test-91951047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fb68c58-1ac8-4dc0-b164-747a30865f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:36 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-243439c6-31ed-4fee-89cd-d3e02bda7bcb tempest-VolumesTransfersV355Test-91951047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fb68c58-1ac8-4dc0-b164-747a30865f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:36 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-243439c6-31ed-4fee-89cd-d3e02bda7bcb tempest-VolumesTransfersV355Test-91951047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d963ed04-04b4-420a-a864-051b378771e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:36 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-243439c6-31ed-4fee-89cd-d3e02bda7bcb tempest-VolumesTransfersV355Test-91951047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d963ed04-04b4-420a-a864-051b378771e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '924df8e5-dbd1-4d45-9500-ec00f276eb9e', 'volume_name': 'volume-924df8e5-dbd1-4d45-9500-ec00f276eb9e', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:36 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-243439c6-31ed-4fee-89cd-d3e02bda7bcb tempest-VolumesTransfersV355Test-91951047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecf02539-78a1-4ac5-b537-4c7b703144cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:36 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-243439c6-31ed-4fee-89cd-d3e02bda7bcb tempest-VolumesTransfersV355Test-91951047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecf02539-78a1-4ac5-b537-4c7b703144cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:36 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-243439c6-31ed-4fee-89cd-d3e02bda7bcb tempest-VolumesTransfersV355Test-91951047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0311a475-0f78-4ecf-b00f-abb2868b59e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:36 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-243439c6-31ed-4fee-89cd-d3e02bda7bcb tempest-VolumesTransfersV355Test-91951047 None] Volume 924df8e5-dbd1-4d45-9500-ec00f276eb9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-924df8e5-dbd1-4d45-9500-ec00f276eb9e', 'volume_size': 1} Jun 24 05:06:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-243439c6-31ed-4fee-89cd-d3e02bda7bcb tempest-VolumesTransfersV355Test-91951047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:06:36 devstack sudo[104152]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6896f038-9636-4faa-9093-b4c05ba92e40 tempest-VolumesSnapshotListTestJSON-495348509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.6bede0a7-39bc-451b-b457-080547a822ee" returned: 0 in 1.027s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:36 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-6896f038-9636-4faa-9093-b4c05ba92e40 tempest-VolumesSnapshotListTestJSON-495348509 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:06:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6896f038-9636-4faa-9093-b4c05ba92e40 tempest-VolumesSnapshotListTestJSON-495348509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.6bede0a7-39bc-451b-b457-080547a822ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.08648313-6d9f-49df-a50f-9e6d280fb1b2 1G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:36 devstack sudo[104157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.6bede0a7-39bc-451b-b457-080547a822ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.08648313-6d9f-49df-a50f-9e6d280fb1b2 1G Jun 24 05:06:36 devstack sudo[104157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:37 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-5d775896-fff1-48aa-824d-74a8739b5e23 tempest-VolumesNegativeTest-95720529 None] Acquiring lock "cinder-e627525a-97fe-409b-8841-47406191b9cc-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:06:37 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-5d775896-fff1-48aa-824d-74a8739b5e23 tempest-VolumesNegativeTest-95720529 None] Lock "cinder-e627525a-97fe-409b-8841-47406191b9cc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:06:37 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-5d775896-fff1-48aa-824d-74a8739b5e23 tempest-VolumesNegativeTest-95720529 None] Acquiring lock "cinder-quobyte-e627525a-97fe-409b-8841-47406191b9cc" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:06:37 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-5d775896-fff1-48aa-824d-74a8739b5e23 tempest-VolumesNegativeTest-95720529 None] Lock "cinder-quobyte-e627525a-97fe-409b-8841-47406191b9cc" acquired by "delete_volume" :: waited 0.016s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:06:37 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82db15e-df9e-4107-939c-38f151ad294b]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:06:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5d775896-fff1-48aa-824d-74a8739b5e23 tempest-VolumesNegativeTest-95720529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e627525a-97fe-409b-8841-47406191b9cc {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:37 devstack sudo[104166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e627525a-97fe-409b-8841-47406191b9cc Jun 24 05:06:37 devstack sudo[104166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:37 devstack sudo[104157]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6896f038-9636-4faa-9093-b4c05ba92e40 tempest-VolumesSnapshotListTestJSON-495348509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.6bede0a7-39bc-451b-b457-080547a822ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.08648313-6d9f-49df-a50f-9e6d280fb1b2 1G" returned: 0 in 0.994s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6896f038-9636-4faa-9093-b4c05ba92e40 tempest-VolumesSnapshotListTestJSON-495348509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.6bede0a7-39bc-451b-b457-080547a822ee -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.08648313-6d9f-49df-a50f-9e6d280fb1b2 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:37 devstack sudo[104168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.6bede0a7-39bc-451b-b457-080547a822ee -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.08648313-6d9f-49df-a50f-9e6d280fb1b2 Jun 24 05:06:37 devstack sudo[104168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:38 devstack sudo[104166]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5d775896-fff1-48aa-824d-74a8739b5e23 tempest-VolumesNegativeTest-95720529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e627525a-97fe-409b-8841-47406191b9cc" returned: 0 in 0.775s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5d775896-fff1-48aa-824d-74a8739b5e23 tempest-VolumesNegativeTest-95720529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e627525a-97fe-409b-8841-47406191b9cc {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:38 devstack sudo[104175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e627525a-97fe-409b-8841-47406191b9cc Jun 24 05:06:38 devstack sudo[104175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:38 devstack sudo[104168]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6896f038-9636-4faa-9093-b4c05ba92e40 tempest-VolumesSnapshotListTestJSON-495348509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.6bede0a7-39bc-451b-b457-080547a822ee -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.08648313-6d9f-49df-a50f-9e6d280fb1b2" returned: 0 in 0.726s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:38 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-6896f038-9636-4faa-9093-b4c05ba92e40 tempest-VolumesSnapshotListTestJSON-495348509 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.08648313-6d9f-49df-a50f-9e6d280fb1b2 is being set with open permissions: ugo+rw Jun 24 05:06:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6896f038-9636-4faa-9093-b4c05ba92e40 tempest-VolumesSnapshotListTestJSON-495348509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.08648313-6d9f-49df-a50f-9e6d280fb1b2 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:38 devstack sudo[104178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.08648313-6d9f-49df-a50f-9e6d280fb1b2 Jun 24 05:06:38 devstack sudo[104178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:39 devstack sudo[104175]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5d775896-fff1-48aa-824d-74a8739b5e23 tempest-VolumesNegativeTest-95720529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e627525a-97fe-409b-8841-47406191b9cc" returned: 0 in 0.694s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:39 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-5d775896-fff1-48aa-824d-74a8739b5e23 tempest-VolumesNegativeTest-95720529 None] Lock "cinder-quobyte-e627525a-97fe-409b-8841-47406191b9cc" released by "delete_volume" :: held 1.519s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:06:39 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-5d775896-fff1-48aa-824d-74a8739b5e23 tempest-VolumesNegativeTest-95720529 None] Created reservations ['ab6a6af4-b4da-49bf-9fe4-6442966504e0', '6a414262-2e85-4f6c-9efc-bbcee2068053', 'e129a8ec-b369-4b62-a3a2-71d5a189b18d', '40a5bf44-7c1a-44d1-a2ab-22ff061b08a8'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:06:39 devstack sudo[104178]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6896f038-9636-4faa-9093-b4c05ba92e40 tempest-VolumesSnapshotListTestJSON-495348509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.08648313-6d9f-49df-a50f-9e6d280fb1b2" returned: 0 in 0.675s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5d775896-fff1-48aa-824d-74a8739b5e23 tempest-VolumesNegativeTest-95720529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:06:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5d775896-fff1-48aa-824d-74a8739b5e23 tempest-VolumesNegativeTest-95720529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:06:39 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-5d775896-fff1-48aa-824d-74a8739b5e23 tempest-VolumesNegativeTest-95720529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:06:39 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-5d775896-fff1-48aa-824d-74a8739b5e23 tempest-VolumesNegativeTest-95720529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:06:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5d775896-fff1-48aa-824d-74a8739b5e23 tempest-VolumesNegativeTest-95720529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:06:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5d775896-fff1-48aa-824d-74a8739b5e23 tempest-VolumesNegativeTest-95720529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:39 devstack sudo[104182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:06:39 devstack sudo[104182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-6896f038-9636-4faa-9093-b4c05ba92e40 tempest-VolumesSnapshotListTestJSON-495348509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.594s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:06:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-243439c6-31ed-4fee-89cd-d3e02bda7bcb tempest-VolumesTransfersV355Test-91951047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.666s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:06:39 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-243439c6-31ed-4fee-89cd-d3e02bda7bcb tempest-VolumesTransfersV355Test-91951047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-152233081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=924df8e5-dbd1-4d45-9500-ec00f276eb9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='393d9bcdc9d24c4bb28d6182602927a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:06:37Z,use_quota=True,user_id='87f104326a144147b4046f10170e9ff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:06:39 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-243439c6-31ed-4fee-89cd-d3e02bda7bcb tempest-VolumesTransfersV355Test-91951047 None] Creating volume 924df8e5-dbd1-4d45-9500-ec00f276eb9e {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:06:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-243439c6-31ed-4fee-89cd-d3e02bda7bcb tempest-VolumesTransfersV355Test-91951047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:06:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-243439c6-31ed-4fee-89cd-d3e02bda7bcb tempest-VolumesTransfersV355Test-91951047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:06:39 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-243439c6-31ed-4fee-89cd-d3e02bda7bcb tempest-VolumesTransfersV355Test-91951047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:06:39 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-243439c6-31ed-4fee-89cd-d3e02bda7bcb tempest-VolumesTransfersV355Test-91951047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:06:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-243439c6-31ed-4fee-89cd-d3e02bda7bcb tempest-VolumesTransfersV355Test-91951047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:06:39 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-243439c6-31ed-4fee-89cd-d3e02bda7bcb tempest-VolumesTransfersV355Test-91951047 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:06:39 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-243439c6-31ed-4fee-89cd-d3e02bda7bcb tempest-VolumesTransfersV355Test-91951047 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:06:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-243439c6-31ed-4fee-89cd-d3e02bda7bcb tempest-VolumesTransfersV355Test-91951047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-924df8e5-dbd1-4d45-9500-ec00f276eb9e 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:39 devstack sudo[104184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-924df8e5-dbd1-4d45-9500-ec00f276eb9e 1073741824 Jun 24 05:06:39 devstack sudo[104184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:39 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-6896f038-9636-4faa-9093-b4c05ba92e40 tempest-VolumesSnapshotListTestJSON-495348509 None] Create snapshot completed successfully Jun 24 05:06:40 devstack sudo[104182]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5d775896-fff1-48aa-824d-74a8739b5e23 tempest-VolumesNegativeTest-95720529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.723s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:40 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-5d775896-fff1-48aa-824d-74a8739b5e23 tempest-VolumesNegativeTest-95720529 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:06:40 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-5d775896-fff1-48aa-824d-74a8739b5e23 tempest-VolumesNegativeTest-95720529 None] Deleted volume successfully. Jun 24 05:06:40 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-5d775896-fff1-48aa-824d-74a8739b5e23 tempest-VolumesNegativeTest-95720529 None] Lock "cinder-e627525a-97fe-409b-8841-47406191b9cc-delete_volume" released by "delete_volume" :: held 2.483s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:06:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-6a2f989f-c105-4dc9-b669-21618d554b19 tempest-VolumesSnapshotListTestJSON-495348509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:06:40 devstack sudo[104184]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-243439c6-31ed-4fee-89cd-d3e02bda7bcb tempest-VolumesTransfersV355Test-91951047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-924df8e5-dbd1-4d45-9500-ec00f276eb9e 1073741824" returned: 0 in 0.935s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-243439c6-31ed-4fee-89cd-d3e02bda7bcb tempest-VolumesTransfersV355Test-91951047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-924df8e5-dbd1-4d45-9500-ec00f276eb9e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:40 devstack sudo[104192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-924df8e5-dbd1-4d45-9500-ec00f276eb9e Jun 24 05:06:40 devstack sudo[104192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:41 devstack sudo[104192]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-243439c6-31ed-4fee-89cd-d3e02bda7bcb tempest-VolumesTransfersV355Test-91951047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-924df8e5-dbd1-4d45-9500-ec00f276eb9e" returned: 0 in 0.708s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:41 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-243439c6-31ed-4fee-89cd-d3e02bda7bcb tempest-VolumesTransfersV355Test-91951047 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:06:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-243439c6-31ed-4fee-89cd-d3e02bda7bcb tempest-VolumesTransfersV355Test-91951047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.691s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:06:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-6a2f989f-c105-4dc9-b669-21618d554b19 tempest-VolumesSnapshotListTestJSON-495348509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.879s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:06:41 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-6a2f989f-c105-4dc9-b669-21618d554b19 tempest-VolumesSnapshotListTestJSON-495348509 None] Creating offline snapshot 8eb88da1-a7c1-420b-a6ce-ad2193943ecc of volume 036704a1-68c7-4408-95b5-7b3e4a2f7b66 {{(pid=93830) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 05:06:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-243439c6-31ed-4fee-89cd-d3e02bda7bcb tempest-VolumesTransfersV355Test-91951047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0311a475-0f78-4ecf-b00f-abb2868b59e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-924df8e5-dbd1-4d45-9500-ec00f276eb9e', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-243439c6-31ed-4fee-89cd-d3e02bda7bcb tempest-VolumesTransfersV355Test-91951047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7f1a6db-d835-4e6d-b4a1-60ca78f8893b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:41 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6cdd9de-707f-42b6-a3c3-b4810aecd9e4]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:06:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6a2f989f-c105-4dc9-b669-21618d554b19 tempest-VolumesSnapshotListTestJSON-495348509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.08648313-6d9f-49df-a50f-9e6d280fb1b2 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:41 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-243439c6-31ed-4fee-89cd-d3e02bda7bcb tempest-VolumesTransfersV355Test-91951047 None] Volume volume-924df8e5-dbd1-4d45-9500-ec00f276eb9e (924df8e5-dbd1-4d45-9500-ec00f276eb9e): created successfully Jun 24 05:06:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-243439c6-31ed-4fee-89cd-d3e02bda7bcb tempest-VolumesTransfersV355Test-91951047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7f1a6db-d835-4e6d-b4a1-60ca78f8893b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-243439c6-31ed-4fee-89cd-d3e02bda7bcb tempest-VolumesTransfersV355Test-91951047 None] Flow 'volume_create_manager' (a950f05f-ce9c-46a9-b45d-5e15c7c23304) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:06:41 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-243439c6-31ed-4fee-89cd-d3e02bda7bcb tempest-VolumesTransfersV355Test-91951047 None] Created volume successfully. Jun 24 05:06:41 devstack sudo[104195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.08648313-6d9f-49df-a50f-9e6d280fb1b2 Jun 24 05:06:41 devstack sudo[104195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:42 devstack sudo[104195]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6a2f989f-c105-4dc9-b669-21618d554b19 tempest-VolumesSnapshotListTestJSON-495348509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.08648313-6d9f-49df-a50f-9e6d280fb1b2" returned: 0 in 0.934s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:42 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-6a2f989f-c105-4dc9-b669-21618d554b19 tempest-VolumesSnapshotListTestJSON-495348509 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:06:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6a2f989f-c105-4dc9-b669-21618d554b19 tempest-VolumesSnapshotListTestJSON-495348509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.08648313-6d9f-49df-a50f-9e6d280fb1b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.8eb88da1-a7c1-420b-a6ce-ad2193943ecc 1G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:42 devstack sudo[104200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.08648313-6d9f-49df-a50f-9e6d280fb1b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.8eb88da1-a7c1-420b-a6ce-ad2193943ecc 1G Jun 24 05:06:42 devstack sudo[104200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:42 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-a5b3fe53-d1ba-4932-9db4-d1cc4f4f232d tempest-VolumesTransfersV355Test-241227030 None] Transfer volume completed successfully. Jun 24 05:06:42 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2cf7c68-cff9-4681-911a-7459c34fad13 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:06:42 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a2cf7c68-cff9-4681-911a-7459c34fad13 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Flow 'volume_create_manager' (da938e22-f72d-4103-9177-48318d608a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:06:42 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a2cf7c68-cff9-4681-911a-7459c34fad13 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8180dbf7-825b-4fe4-b93a-05a2a4d0efe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:42 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a2cf7c68-cff9-4681-911a-7459c34fad13 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8180dbf7-825b-4fe4-b93a-05a2a4d0efe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-661460633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cde2d8f-065b-4c2c-b76b-d3f75e3c7969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1d4b362c544563986aa42e280ac43e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:06:43Z,use_quota=True,user_id='cd5a5153b855404fbcf1c2753f4bb242',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:42 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a2cf7c68-cff9-4681-911a-7459c34fad13 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32c3ad3f-04a5-4e02-8d4f-745160e689c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:42 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a2cf7c68-cff9-4681-911a-7459c34fad13 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32c3ad3f-04a5-4e02-8d4f-745160e689c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:42 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a2cf7c68-cff9-4681-911a-7459c34fad13 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36c6472b-8c5c-4040-8b4d-4e3a96f815b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:42 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a2cf7c68-cff9-4681-911a-7459c34fad13 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36c6472b-8c5c-4040-8b4d-4e3a96f815b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cde2d8f-065b-4c2c-b76b-d3f75e3c7969', 'volume_name': 'volume-6cde2d8f-065b-4c2c-b76b-d3f75e3c7969', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:43 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a2cf7c68-cff9-4681-911a-7459c34fad13 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81d4d4de-1ae5-48a5-abff-a68ef62ee404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:43 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a2cf7c68-cff9-4681-911a-7459c34fad13 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81d4d4de-1ae5-48a5-abff-a68ef62ee404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:43 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a2cf7c68-cff9-4681-911a-7459c34fad13 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a823dd10-833c-446b-97d5-394aa2ccad2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:43 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-a2cf7c68-cff9-4681-911a-7459c34fad13 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Volume 6cde2d8f-065b-4c2c-b76b-d3f75e3c7969: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cde2d8f-065b-4c2c-b76b-d3f75e3c7969', 'volume_size': 1} Jun 24 05:06:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a2cf7c68-cff9-4681-911a-7459c34fad13 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:06:43 devstack sudo[104200]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6a2f989f-c105-4dc9-b669-21618d554b19 tempest-VolumesSnapshotListTestJSON-495348509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.08648313-6d9f-49df-a50f-9e6d280fb1b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.8eb88da1-a7c1-420b-a6ce-ad2193943ecc 1G" returned: 0 in 1.263s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6a2f989f-c105-4dc9-b669-21618d554b19 tempest-VolumesSnapshotListTestJSON-495348509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.08648313-6d9f-49df-a50f-9e6d280fb1b2 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.8eb88da1-a7c1-420b-a6ce-ad2193943ecc {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:43 devstack sudo[104206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.08648313-6d9f-49df-a50f-9e6d280fb1b2 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.8eb88da1-a7c1-420b-a6ce-ad2193943ecc Jun 24 05:06:43 devstack sudo[104206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:44 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-dd07b18c-b936-4565-a2db-bf21d2e76970 tempest-VolumesTransfersV355Test-732464465 None] Acquiring lock "cinder-924df8e5-dbd1-4d45-9500-ec00f276eb9e-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:06:44 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-dd07b18c-b936-4565-a2db-bf21d2e76970 tempest-VolumesTransfersV355Test-732464465 None] Lock "cinder-924df8e5-dbd1-4d45-9500-ec00f276eb9e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:06:44 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:SELECT=73,cinder:INSERT=29,cinder:UPDATE=111,cinder:DELETE=7 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:06:44 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-dd07b18c-b936-4565-a2db-bf21d2e76970 tempest-VolumesTransfersV355Test-732464465 None] Acquiring lock "cinder-quobyte-924df8e5-dbd1-4d45-9500-ec00f276eb9e" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:06:44 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-dd07b18c-b936-4565-a2db-bf21d2e76970 tempest-VolumesTransfersV355Test-732464465 None] Lock "cinder-quobyte-924df8e5-dbd1-4d45-9500-ec00f276eb9e" acquired by "delete_volume" :: waited 0.020s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:06:44 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[936e3178-5ebe-466a-b829-59f04030d3f1]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:06:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dd07b18c-b936-4565-a2db-bf21d2e76970 tempest-VolumesTransfersV355Test-732464465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-924df8e5-dbd1-4d45-9500-ec00f276eb9e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:44 devstack sudo[104206]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6a2f989f-c105-4dc9-b669-21618d554b19 tempest-VolumesSnapshotListTestJSON-495348509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.08648313-6d9f-49df-a50f-9e6d280fb1b2 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.8eb88da1-a7c1-420b-a6ce-ad2193943ecc" returned: 0 in 0.943s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:44 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-6a2f989f-c105-4dc9-b669-21618d554b19 tempest-VolumesSnapshotListTestJSON-495348509 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.8eb88da1-a7c1-420b-a6ce-ad2193943ecc is being set with open permissions: ugo+rw Jun 24 05:06:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6a2f989f-c105-4dc9-b669-21618d554b19 tempest-VolumesSnapshotListTestJSON-495348509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.8eb88da1-a7c1-420b-a6ce-ad2193943ecc {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:44 devstack sudo[104223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-924df8e5-dbd1-4d45-9500-ec00f276eb9e Jun 24 05:06:44 devstack sudo[104223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:44 devstack sudo[104227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.8eb88da1-a7c1-420b-a6ce-ad2193943ecc Jun 24 05:06:44 devstack sudo[104227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:44 devstack sudo[104223]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dd07b18c-b936-4565-a2db-bf21d2e76970 tempest-VolumesTransfersV355Test-732464465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-924df8e5-dbd1-4d45-9500-ec00f276eb9e" returned: 0 in 0.779s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dd07b18c-b936-4565-a2db-bf21d2e76970 tempest-VolumesTransfersV355Test-732464465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-924df8e5-dbd1-4d45-9500-ec00f276eb9e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:44 devstack sudo[104227]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6a2f989f-c105-4dc9-b669-21618d554b19 tempest-VolumesSnapshotListTestJSON-495348509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.8eb88da1-a7c1-420b-a6ce-ad2193943ecc" returned: 0 in 0.690s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:45 devstack sudo[104237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-924df8e5-dbd1-4d45-9500-ec00f276eb9e Jun 24 05:06:45 devstack sudo[104237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-6a2f989f-c105-4dc9-b669-21618d554b19 tempest-VolumesSnapshotListTestJSON-495348509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.932s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:06:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a2cf7c68-cff9-4681-911a-7459c34fad13 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.018s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:06:45 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a2cf7c68-cff9-4681-911a-7459c34fad13 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-661460633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cde2d8f-065b-4c2c-b76b-d3f75e3c7969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1d4b362c544563986aa42e280ac43e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:06:43Z,use_quota=True,user_id='cd5a5153b855404fbcf1c2753f4bb242',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:06:45 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-a2cf7c68-cff9-4681-911a-7459c34fad13 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Creating volume 6cde2d8f-065b-4c2c-b76b-d3f75e3c7969 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:06:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a2cf7c68-cff9-4681-911a-7459c34fad13 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:06:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a2cf7c68-cff9-4681-911a-7459c34fad13 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:06:45 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a2cf7c68-cff9-4681-911a-7459c34fad13 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:06:45 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a2cf7c68-cff9-4681-911a-7459c34fad13 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:06:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a2cf7c68-cff9-4681-911a-7459c34fad13 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:06:45 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a2cf7c68-cff9-4681-911a-7459c34fad13 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:06:45 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-a2cf7c68-cff9-4681-911a-7459c34fad13 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:06:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a2cf7c68-cff9-4681-911a-7459c34fad13 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6cde2d8f-065b-4c2c-b76b-d3f75e3c7969 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:45 devstack sudo[104239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6cde2d8f-065b-4c2c-b76b-d3f75e3c7969 1073741824 Jun 24 05:06:45 devstack sudo[104239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:45 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-6a2f989f-c105-4dc9-b669-21618d554b19 tempest-VolumesSnapshotListTestJSON-495348509 None] Create snapshot completed successfully Jun 24 05:06:45 devstack sudo[104237]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dd07b18c-b936-4565-a2db-bf21d2e76970 tempest-VolumesTransfersV355Test-732464465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-924df8e5-dbd1-4d45-9500-ec00f276eb9e" returned: 0 in 0.690s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:45 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-dd07b18c-b936-4565-a2db-bf21d2e76970 tempest-VolumesTransfersV355Test-732464465 None] Lock "cinder-quobyte-924df8e5-dbd1-4d45-9500-ec00f276eb9e" released by "delete_volume" :: held 1.517s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:06:45 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-dd07b18c-b936-4565-a2db-bf21d2e76970 tempest-VolumesTransfersV355Test-732464465 None] Created reservations ['1566ce29-5c0e-4ef3-9cf7-74a4b1126bc8', 'b7abdfd0-a459-4626-92a6-56141a9bed35', '8f15d47f-8458-46d7-8def-17fd6c175294', 'bb47bb4b-6eb3-4f0d-8c4e-27ab871122ee'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:06:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-dd07b18c-b936-4565-a2db-bf21d2e76970 tempest-VolumesTransfersV355Test-732464465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:06:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-dd07b18c-b936-4565-a2db-bf21d2e76970 tempest-VolumesTransfersV355Test-732464465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:06:45 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-dd07b18c-b936-4565-a2db-bf21d2e76970 tempest-VolumesTransfersV355Test-732464465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:06:45 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-dd07b18c-b936-4565-a2db-bf21d2e76970 tempest-VolumesTransfersV355Test-732464465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:06:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-dd07b18c-b936-4565-a2db-bf21d2e76970 tempest-VolumesTransfersV355Test-732464465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:06:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dd07b18c-b936-4565-a2db-bf21d2e76970 tempest-VolumesTransfersV355Test-732464465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:45 devstack sudo[104245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:06:45 devstack sudo[104245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:46 devstack sudo[104239]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a2cf7c68-cff9-4681-911a-7459c34fad13 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6cde2d8f-065b-4c2c-b76b-d3f75e3c7969 1073741824" returned: 0 in 1.016s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a2cf7c68-cff9-4681-911a-7459c34fad13 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6cde2d8f-065b-4c2c-b76b-d3f75e3c7969 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:46 devstack sudo[104247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6cde2d8f-065b-4c2c-b76b-d3f75e3c7969 Jun 24 05:06:46 devstack sudo[104247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:46 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-dc2c0bd7-0fc8-4eb6-a80d-28aee70778f4 tempest-VolumesSnapshotListTestJSON-495348509 None] Acquiring lock "cinder-8eb88da1-a7c1-420b-a6ce-ad2193943ecc-delete_snapshot" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:06:46 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-dc2c0bd7-0fc8-4eb6-a80d-28aee70778f4 tempest-VolumesSnapshotListTestJSON-495348509 None] Lock "cinder-8eb88da1-a7c1-420b-a6ce-ad2193943ecc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:06:46 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-dc2c0bd7-0fc8-4eb6-a80d-28aee70778f4 tempest-VolumesSnapshotListTestJSON-495348509 None] Acquiring lock "cinder-quobyte-036704a1-68c7-4408-95b5-7b3e4a2f7b66" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:06:46 devstack sudo[104245]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:46 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-dc2c0bd7-0fc8-4eb6-a80d-28aee70778f4 tempest-VolumesSnapshotListTestJSON-495348509 None] Lock "cinder-quobyte-036704a1-68c7-4408-95b5-7b3e4a2f7b66" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:06:46 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-dc2c0bd7-0fc8-4eb6-a80d-28aee70778f4 tempest-VolumesSnapshotListTestJSON-495348509 None] Acquiring lock "cinder-quobyte-8eb88da1-a7c1-420b-a6ce-ad2193943ecc" by "_delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:06:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dd07b18c-b936-4565-a2db-bf21d2e76970 tempest-VolumesTransfersV355Test-732464465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.809s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:46 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-dd07b18c-b936-4565-a2db-bf21d2e76970 tempest-VolumesTransfersV355Test-732464465 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:06:46 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-dd07b18c-b936-4565-a2db-bf21d2e76970 tempest-VolumesTransfersV355Test-732464465 None] Deleted volume successfully. Jun 24 05:06:46 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-dc2c0bd7-0fc8-4eb6-a80d-28aee70778f4 tempest-VolumesSnapshotListTestJSON-495348509 None] Lock "cinder-quobyte-8eb88da1-a7c1-420b-a6ce-ad2193943ecc" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:06:46 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-dc2c0bd7-0fc8-4eb6-a80d-28aee70778f4 tempest-VolumesSnapshotListTestJSON-495348509 None] Deleting offline snapshot 8eb88da1-a7c1-420b-a6ce-ad2193943ecc of volume 036704a1-68c7-4408-95b5-7b3e4a2f7b66 {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 05:06:46 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-dc2c0bd7-0fc8-4eb6-a80d-28aee70778f4 tempest-VolumesSnapshotListTestJSON-495348509 None] snapshot_file for this snap is: volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.8eb88da1-a7c1-420b-a6ce-ad2193943ecc {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 05:06:46 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-dd07b18c-b936-4565-a2db-bf21d2e76970 tempest-VolumesTransfersV355Test-732464465 None] Lock "cinder-924df8e5-dbd1-4d45-9500-ec00f276eb9e-delete_volume" released by "delete_volume" :: held 2.685s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:06:46 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[223e4a99-3c46-4a7a-8891-668c9b2d2c0f]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:06:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dc2c0bd7-0fc8-4eb6-a80d-28aee70778f4 tempest-VolumesSnapshotListTestJSON-495348509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.8eb88da1-a7c1-420b-a6ce-ad2193943ecc {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:46 devstack sudo[104250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.8eb88da1-a7c1-420b-a6ce-ad2193943ecc Jun 24 05:06:46 devstack sudo[104250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:47 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-6564f6ad-42de-4eb4-98cf-7e47490cf410 tempest-VolumesTransfersV355Test-91951047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:06:47 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-6564f6ad-42de-4eb4-98cf-7e47490cf410 tempest-VolumesTransfersV355Test-91951047 None] Flow 'volume_create_manager' (6d624c82-620d-4a3f-858d-3f2f2f9b1619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:06:47 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-6564f6ad-42de-4eb4-98cf-7e47490cf410 tempest-VolumesTransfersV355Test-91951047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff4900d9-e40d-4628-b80a-c7ac469cd5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:47 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-6564f6ad-42de-4eb4-98cf-7e47490cf410 tempest-VolumesTransfersV355Test-91951047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff4900d9-e40d-4628-b80a-c7ac469cd5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:06:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1814575578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75ccbb02-b338-44c6-b3a8-8641638aecf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='393d9bcdc9d24c4bb28d6182602927a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:06:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:06:47Z,use_quota=True,user_id='87f104326a144147b4046f10170e9ff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:47 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-6564f6ad-42de-4eb4-98cf-7e47490cf410 tempest-VolumesTransfersV355Test-91951047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48cedad7-8235-4758-a1b4-3fe964d672ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:47 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-6564f6ad-42de-4eb4-98cf-7e47490cf410 tempest-VolumesTransfersV355Test-91951047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48cedad7-8235-4758-a1b4-3fe964d672ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:47 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-6564f6ad-42de-4eb4-98cf-7e47490cf410 tempest-VolumesTransfersV355Test-91951047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49743cdf-7bef-428d-bf48-2f93bdcf6978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:47 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-6564f6ad-42de-4eb4-98cf-7e47490cf410 tempest-VolumesTransfersV355Test-91951047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49743cdf-7bef-428d-bf48-2f93bdcf6978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75ccbb02-b338-44c6-b3a8-8641638aecf5', 'volume_name': 'volume-75ccbb02-b338-44c6-b3a8-8641638aecf5', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:47 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-6564f6ad-42de-4eb4-98cf-7e47490cf410 tempest-VolumesTransfersV355Test-91951047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17636821-32e7-44ca-b141-968a19baa6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:47 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-6564f6ad-42de-4eb4-98cf-7e47490cf410 tempest-VolumesTransfersV355Test-91951047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17636821-32e7-44ca-b141-968a19baa6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:47 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-6564f6ad-42de-4eb4-98cf-7e47490cf410 tempest-VolumesTransfersV355Test-91951047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b55e2de-8cb8-4607-be53-57d5418f7094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:47 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-6564f6ad-42de-4eb4-98cf-7e47490cf410 tempest-VolumesTransfersV355Test-91951047 None] Volume 75ccbb02-b338-44c6-b3a8-8641638aecf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75ccbb02-b338-44c6-b3a8-8641638aecf5', 'volume_size': 1} Jun 24 05:06:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-6564f6ad-42de-4eb4-98cf-7e47490cf410 tempest-VolumesTransfersV355Test-91951047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:06:47 devstack sudo[104247]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a2cf7c68-cff9-4681-911a-7459c34fad13 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6cde2d8f-065b-4c2c-b76b-d3f75e3c7969" returned: 0 in 0.991s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:47 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a2cf7c68-cff9-4681-911a-7459c34fad13 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] <== create_volume: return (2072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:06:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a2cf7c68-cff9-4681-911a-7459c34fad13 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.075s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:06:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-6564f6ad-42de-4eb4-98cf-7e47490cf410 tempest-VolumesTransfersV355Test-91951047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:06:47 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-6564f6ad-42de-4eb4-98cf-7e47490cf410 tempest-VolumesTransfersV355Test-91951047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:06:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1814575578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75ccbb02-b338-44c6-b3a8-8641638aecf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='393d9bcdc9d24c4bb28d6182602927a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:06:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:06:47Z,use_quota=True,user_id='87f104326a144147b4046f10170e9ff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:06:47 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-6564f6ad-42de-4eb4-98cf-7e47490cf410 tempest-VolumesTransfersV355Test-91951047 None] Creating volume 75ccbb02-b338-44c6-b3a8-8641638aecf5 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:06:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-6564f6ad-42de-4eb4-98cf-7e47490cf410 tempest-VolumesTransfersV355Test-91951047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:06:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-6564f6ad-42de-4eb4-98cf-7e47490cf410 tempest-VolumesTransfersV355Test-91951047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:06:47 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-6564f6ad-42de-4eb4-98cf-7e47490cf410 tempest-VolumesTransfersV355Test-91951047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:06:47 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-6564f6ad-42de-4eb4-98cf-7e47490cf410 tempest-VolumesTransfersV355Test-91951047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:06:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-6564f6ad-42de-4eb4-98cf-7e47490cf410 tempest-VolumesTransfersV355Test-91951047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:06:47 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-6564f6ad-42de-4eb4-98cf-7e47490cf410 tempest-VolumesTransfersV355Test-91951047 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:06:47 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-6564f6ad-42de-4eb4-98cf-7e47490cf410 tempest-VolumesTransfersV355Test-91951047 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:06:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6564f6ad-42de-4eb4-98cf-7e47490cf410 tempest-VolumesTransfersV355Test-91951047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-75ccbb02-b338-44c6-b3a8-8641638aecf5 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:47 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a2cf7c68-cff9-4681-911a-7459c34fad13 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a823dd10-833c-446b-97d5-394aa2ccad2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cde2d8f-065b-4c2c-b76b-d3f75e3c7969', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:47 devstack sudo[104253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-75ccbb02-b338-44c6-b3a8-8641638aecf5 1073741824 Jun 24 05:06:47 devstack sudo[104253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:47 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a2cf7c68-cff9-4681-911a-7459c34fad13 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05c44d67-ecf3-4181-aabb-f164308205d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:47 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-a2cf7c68-cff9-4681-911a-7459c34fad13 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Volume volume-6cde2d8f-065b-4c2c-b76b-d3f75e3c7969 (6cde2d8f-065b-4c2c-b76b-d3f75e3c7969): created successfully Jun 24 05:06:47 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a2cf7c68-cff9-4681-911a-7459c34fad13 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05c44d67-ecf3-4181-aabb-f164308205d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:47 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a2cf7c68-cff9-4681-911a-7459c34fad13 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Flow 'volume_create_manager' (da938e22-f72d-4103-9177-48318d608a19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:06:47 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-a2cf7c68-cff9-4681-911a-7459c34fad13 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Created volume successfully. Jun 24 05:06:47 devstack sudo[104250]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dc2c0bd7-0fc8-4eb6-a80d-28aee70778f4 tempest-VolumesSnapshotListTestJSON-495348509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.8eb88da1-a7c1-420b-a6ce-ad2193943ecc" returned: 0 in 0.833s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:47 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-dc2c0bd7-0fc8-4eb6-a80d-28aee70778f4 tempest-VolumesSnapshotListTestJSON-495348509 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:06:47 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[90030e82-c7a7-4b01-af35-1fce7038dd5b]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:06:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dc2c0bd7-0fc8-4eb6-a80d-28aee70778f4 tempest-VolumesSnapshotListTestJSON-495348509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.08648313-6d9f-49df-a50f-9e6d280fb1b2 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:47 devstack sudo[104261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.08648313-6d9f-49df-a50f-9e6d280fb1b2 Jun 24 05:06:47 devstack sudo[104261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:47 devstack sudo[104253]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6564f6ad-42de-4eb4-98cf-7e47490cf410 tempest-VolumesTransfersV355Test-91951047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-75ccbb02-b338-44c6-b3a8-8641638aecf5 1073741824" returned: 0 in 0.874s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6564f6ad-42de-4eb4-98cf-7e47490cf410 tempest-VolumesTransfersV355Test-91951047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-75ccbb02-b338-44c6-b3a8-8641638aecf5 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:48 devstack sudo[104266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-75ccbb02-b338-44c6-b3a8-8641638aecf5 Jun 24 05:06:48 devstack sudo[104266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:48 devstack sudo[104261]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dc2c0bd7-0fc8-4eb6-a80d-28aee70778f4 tempest-VolumesSnapshotListTestJSON-495348509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.08648313-6d9f-49df-a50f-9e6d280fb1b2" returned: 0 in 0.820s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:48 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-dc2c0bd7-0fc8-4eb6-a80d-28aee70778f4 tempest-VolumesSnapshotListTestJSON-495348509 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:06:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dc2c0bd7-0fc8-4eb6-a80d-28aee70778f4 tempest-VolumesSnapshotListTestJSON-495348509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.8eb88da1-a7c1-420b-a6ce-ad2193943ecc {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:48 devstack sudo[104271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.8eb88da1-a7c1-420b-a6ce-ad2193943ecc Jun 24 05:06:48 devstack sudo[104271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:48 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-b54b72ce-b3fc-4db4-964f-495e9e60de0d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:06:48 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b54b72ce-b3fc-4db4-964f-495e9e60de0d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Flow 'volume_create_manager' (aa7e3752-286e-4f90-8fe7-151a84027c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:06:48 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b54b72ce-b3fc-4db4-964f-495e9e60de0d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b85c040-97fb-4584-97dd-bb2d4e0fdb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:48 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b54b72ce-b3fc-4db4-964f-495e9e60de0d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b85c040-97fb-4584-97dd-bb2d4e0fdb68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:06:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1702746288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=003e7bb7-6466-4359-b882-9665132e4c2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1d4b362c544563986aa42e280ac43e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:06:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:06:49Z,use_quota=True,user_id='cd5a5153b855404fbcf1c2753f4bb242',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:48 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b54b72ce-b3fc-4db4-964f-495e9e60de0d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fb2a1ff-4e91-4bfb-9728-100660727166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:48 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b54b72ce-b3fc-4db4-964f-495e9e60de0d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fb2a1ff-4e91-4bfb-9728-100660727166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:48 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b54b72ce-b3fc-4db4-964f-495e9e60de0d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9abce08-8e7d-4016-8d66-cbee141b90f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:48 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b54b72ce-b3fc-4db4-964f-495e9e60de0d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9abce08-8e7d-4016-8d66-cbee141b90f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '003e7bb7-6466-4359-b882-9665132e4c2e', 'volume_name': 'volume-003e7bb7-6466-4359-b882-9665132e4c2e', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:48 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b54b72ce-b3fc-4db4-964f-495e9e60de0d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5e23a1c-d72c-4ddd-8a17-444bd48a7b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:48 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b54b72ce-b3fc-4db4-964f-495e9e60de0d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5e23a1c-d72c-4ddd-8a17-444bd48a7b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:48 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b54b72ce-b3fc-4db4-964f-495e9e60de0d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (925ed903-5dcd-4cda-b671-524e84817dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:48 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-b54b72ce-b3fc-4db4-964f-495e9e60de0d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Volume 003e7bb7-6466-4359-b882-9665132e4c2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-003e7bb7-6466-4359-b882-9665132e4c2e', 'volume_size': 1} Jun 24 05:06:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-b54b72ce-b3fc-4db4-964f-495e9e60de0d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:06:48 devstack sudo[104266]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6564f6ad-42de-4eb4-98cf-7e47490cf410 tempest-VolumesTransfersV355Test-91951047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-75ccbb02-b338-44c6-b3a8-8641638aecf5" returned: 0 in 0.808s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:48 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-6564f6ad-42de-4eb4-98cf-7e47490cf410 tempest-VolumesTransfersV355Test-91951047 None] <== create_volume: return (1726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:06:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-6564f6ad-42de-4eb4-98cf-7e47490cf410 tempest-VolumesTransfersV355Test-91951047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:06:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-b54b72ce-b3fc-4db4-964f-495e9e60de0d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.050s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:06:48 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-b54b72ce-b3fc-4db4-964f-495e9e60de0d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:06:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1702746288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=003e7bb7-6466-4359-b882-9665132e4c2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1d4b362c544563986aa42e280ac43e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:06:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:06:49Z,use_quota=True,user_id='cd5a5153b855404fbcf1c2753f4bb242',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:06:48 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-b54b72ce-b3fc-4db4-964f-495e9e60de0d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Creating volume 003e7bb7-6466-4359-b882-9665132e4c2e {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:06:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-b54b72ce-b3fc-4db4-964f-495e9e60de0d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:06:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-b54b72ce-b3fc-4db4-964f-495e9e60de0d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:06:48 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-b54b72ce-b3fc-4db4-964f-495e9e60de0d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:06:48 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-b54b72ce-b3fc-4db4-964f-495e9e60de0d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:06:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-b54b72ce-b3fc-4db4-964f-495e9e60de0d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:06:48 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-b54b72ce-b3fc-4db4-964f-495e9e60de0d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:06:48 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-b54b72ce-b3fc-4db4-964f-495e9e60de0d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:06:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-b54b72ce-b3fc-4db4-964f-495e9e60de0d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-003e7bb7-6466-4359-b882-9665132e4c2e 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:48 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-6564f6ad-42de-4eb4-98cf-7e47490cf410 tempest-VolumesTransfersV355Test-91951047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b55e2de-8cb8-4607-be53-57d5418f7094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75ccbb02-b338-44c6-b3a8-8641638aecf5', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:48 devstack sudo[104274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-003e7bb7-6466-4359-b882-9665132e4c2e 1073741824 Jun 24 05:06:48 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-6564f6ad-42de-4eb4-98cf-7e47490cf410 tempest-VolumesTransfersV355Test-91951047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e89975f-c4e3-4581-89ac-60a0652acfe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:48 devstack sudo[104274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:48 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-6564f6ad-42de-4eb4-98cf-7e47490cf410 tempest-VolumesTransfersV355Test-91951047 None] Volume volume-75ccbb02-b338-44c6-b3a8-8641638aecf5 (75ccbb02-b338-44c6-b3a8-8641638aecf5): created successfully Jun 24 05:06:48 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-6564f6ad-42de-4eb4-98cf-7e47490cf410 tempest-VolumesTransfersV355Test-91951047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e89975f-c4e3-4581-89ac-60a0652acfe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:48 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-6564f6ad-42de-4eb4-98cf-7e47490cf410 tempest-VolumesTransfersV355Test-91951047 None] Flow 'volume_create_manager' (6d624c82-620d-4a3f-858d-3f2f2f9b1619) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:06:48 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-6564f6ad-42de-4eb4-98cf-7e47490cf410 tempest-VolumesTransfersV355Test-91951047 None] Created volume successfully. Jun 24 05:06:49 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-eff943e5-b5a9-4e67-9abf-5c80c4283eb2 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:06:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-eff943e5-b5a9-4e67-9abf-5c80c4283eb2 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Flow 'volume_create_manager' (743d1c49-df44-4be3-8d82-ed2ef75986de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:06:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-eff943e5-b5a9-4e67-9abf-5c80c4283eb2 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6b26c0b-93ec-4a9b-bcd2-5a302501582a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-eff943e5-b5a9-4e67-9abf-5c80c4283eb2 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6b26c0b-93ec-4a9b-bcd2-5a302501582a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-260055334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7588716-f8ea-4d76-81f0-1208d177ec48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1d4b362c544563986aa42e280ac43e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:06:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:06:49Z,use_quota=True,user_id='cd5a5153b855404fbcf1c2753f4bb242',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-eff943e5-b5a9-4e67-9abf-5c80c4283eb2 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b5bef8-7c1a-4dad-b1a1-fac0640a5fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-eff943e5-b5a9-4e67-9abf-5c80c4283eb2 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b5bef8-7c1a-4dad-b1a1-fac0640a5fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-eff943e5-b5a9-4e67-9abf-5c80c4283eb2 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c17a2b16-1ea4-41b7-a960-0938f7364f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-eff943e5-b5a9-4e67-9abf-5c80c4283eb2 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c17a2b16-1ea4-41b7-a960-0938f7364f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7588716-f8ea-4d76-81f0-1208d177ec48', 'volume_name': 'volume-a7588716-f8ea-4d76-81f0-1208d177ec48', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-eff943e5-b5a9-4e67-9abf-5c80c4283eb2 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (451312b5-0fa0-41ff-b9e2-ef1477ecd00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-eff943e5-b5a9-4e67-9abf-5c80c4283eb2 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (451312b5-0fa0-41ff-b9e2-ef1477ecd00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-eff943e5-b5a9-4e67-9abf-5c80c4283eb2 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c457369-80dd-44e2-9c51-fd699868b5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:49 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-eff943e5-b5a9-4e67-9abf-5c80c4283eb2 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Volume a7588716-f8ea-4d76-81f0-1208d177ec48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7588716-f8ea-4d76-81f0-1208d177ec48', 'volume_size': 1} Jun 24 05:06:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-eff943e5-b5a9-4e67-9abf-5c80c4283eb2 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:06:49 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-0bbd6c28-c41c-461f-8cd6-f0bde2dea7cc tempest-VolumesTransfersV355Test-732464465 None] Acquiring lock "cinder-75ccbb02-b338-44c6-b3a8-8641638aecf5-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:06:49 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-0bbd6c28-c41c-461f-8cd6-f0bde2dea7cc tempest-VolumesTransfersV355Test-732464465 None] Lock "cinder-75ccbb02-b338-44c6-b3a8-8641638aecf5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:06:49 devstack sudo[104271]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:49 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-0bbd6c28-c41c-461f-8cd6-f0bde2dea7cc tempest-VolumesTransfersV355Test-732464465 None] Acquiring lock "cinder-quobyte-75ccbb02-b338-44c6-b3a8-8641638aecf5" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:06:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dc2c0bd7-0fc8-4eb6-a80d-28aee70778f4 tempest-VolumesSnapshotListTestJSON-495348509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.8eb88da1-a7c1-420b-a6ce-ad2193943ecc" returned: 0 in 1.411s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dc2c0bd7-0fc8-4eb6-a80d-28aee70778f4 tempest-VolumesSnapshotListTestJSON-495348509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.8eb88da1-a7c1-420b-a6ce-ad2193943ecc {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:49 devstack sudo[104307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.8eb88da1-a7c1-420b-a6ce-ad2193943ecc Jun 24 05:06:49 devstack sudo[104307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:49 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-0bbd6c28-c41c-461f-8cd6-f0bde2dea7cc tempest-VolumesTransfersV355Test-732464465 None] Lock "cinder-quobyte-75ccbb02-b338-44c6-b3a8-8641638aecf5" acquired by "delete_volume" :: waited 0.130s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:06:50 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-df4348a2-e38a-44be-ad80-b1fa9ac2aa96 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:06:50 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-df4348a2-e38a-44be-ad80-b1fa9ac2aa96 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Flow 'volume_create_manager' (f48c1446-a1a3-4d01-8c27-d71954a160c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:06:50 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-df4348a2-e38a-44be-ad80-b1fa9ac2aa96 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e110fee-2428-4542-a028-5a3f36fcef78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:50 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbf6ab1-cad7-4584-8530-53e8c2d2c3c6]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:06:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0bbd6c28-c41c-461f-8cd6-f0bde2dea7cc tempest-VolumesTransfersV355Test-732464465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-75ccbb02-b338-44c6-b3a8-8641638aecf5 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:50 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-df4348a2-e38a-44be-ad80-b1fa9ac2aa96 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e110fee-2428-4542-a028-5a3f36fcef78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1468080841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b1e2fc3-3144-450f-970b-4342406a6b71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1d4b362c544563986aa42e280ac43e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:06:50Z,use_quota=True,user_id='cd5a5153b855404fbcf1c2753f4bb242',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:50 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-df4348a2-e38a-44be-ad80-b1fa9ac2aa96 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc2f5b7-a466-41b0-ad87-550d5e91c2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:50 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-df4348a2-e38a-44be-ad80-b1fa9ac2aa96 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc2f5b7-a466-41b0-ad87-550d5e91c2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:50 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-df4348a2-e38a-44be-ad80-b1fa9ac2aa96 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3188a1ee-52d0-426d-9821-c91889bcc717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:50 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-df4348a2-e38a-44be-ad80-b1fa9ac2aa96 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3188a1ee-52d0-426d-9821-c91889bcc717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b1e2fc3-3144-450f-970b-4342406a6b71', 'volume_name': 'volume-4b1e2fc3-3144-450f-970b-4342406a6b71', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:50 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-df4348a2-e38a-44be-ad80-b1fa9ac2aa96 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14f0433d-9b94-4f7b-ab55-665f5182e8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:50 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-df4348a2-e38a-44be-ad80-b1fa9ac2aa96 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14f0433d-9b94-4f7b-ab55-665f5182e8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:50 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-df4348a2-e38a-44be-ad80-b1fa9ac2aa96 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10f05e23-ff3c-4b40-ba15-3e77d7d245a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:50 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-df4348a2-e38a-44be-ad80-b1fa9ac2aa96 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Volume 4b1e2fc3-3144-450f-970b-4342406a6b71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b1e2fc3-3144-450f-970b-4342406a6b71', 'volume_size': 1} Jun 24 05:06:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-df4348a2-e38a-44be-ad80-b1fa9ac2aa96 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:06:50 devstack sudo[104320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-75ccbb02-b338-44c6-b3a8-8641638aecf5 Jun 24 05:06:50 devstack sudo[104320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:50 devstack sudo[104274]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-b54b72ce-b3fc-4db4-964f-495e9e60de0d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-003e7bb7-6466-4359-b882-9665132e4c2e 1073741824" returned: 0 in 1.731s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-b54b72ce-b3fc-4db4-964f-495e9e60de0d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-003e7bb7-6466-4359-b882-9665132e4c2e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:50 devstack sudo[104354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-003e7bb7-6466-4359-b882-9665132e4c2e Jun 24 05:06:50 devstack sudo[104354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:51 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-65a3dac2-669f-48fd-8762-b906553d625b tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:06:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-65a3dac2-669f-48fd-8762-b906553d625b tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Flow 'volume_create_manager' (677be6bf-5e7e-4e07-9924-a80124a25569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:06:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-65a3dac2-669f-48fd-8762-b906553d625b tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a288cc7-eef6-4f12-b867-9912bc6efbbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-65a3dac2-669f-48fd-8762-b906553d625b tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a288cc7-eef6-4f12-b867-9912bc6efbbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1239395352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3ee6760-d3b5-4777-98bc-fbaa3f838e14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1d4b362c544563986aa42e280ac43e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:06:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:06:51Z,use_quota=True,user_id='cd5a5153b855404fbcf1c2753f4bb242',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-65a3dac2-669f-48fd-8762-b906553d625b tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14892ec7-cdf6-4951-b4e7-1a57354260a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-65a3dac2-669f-48fd-8762-b906553d625b tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14892ec7-cdf6-4951-b4e7-1a57354260a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-65a3dac2-669f-48fd-8762-b906553d625b tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6d341cd-ecc2-48b2-9a3e-77e1c12ab648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-65a3dac2-669f-48fd-8762-b906553d625b tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6d341cd-ecc2-48b2-9a3e-77e1c12ab648) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3ee6760-d3b5-4777-98bc-fbaa3f838e14', 'volume_name': 'volume-d3ee6760-d3b5-4777-98bc-fbaa3f838e14', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-65a3dac2-669f-48fd-8762-b906553d625b tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9109f56-254f-4fe9-9c93-7c04b736e769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-65a3dac2-669f-48fd-8762-b906553d625b tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9109f56-254f-4fe9-9c93-7c04b736e769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-65a3dac2-669f-48fd-8762-b906553d625b tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97cd9576-b8ee-496f-89df-929f2dba4004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:51 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-65a3dac2-669f-48fd-8762-b906553d625b tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Volume d3ee6760-d3b5-4777-98bc-fbaa3f838e14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3ee6760-d3b5-4777-98bc-fbaa3f838e14', 'volume_size': 1} Jun 24 05:06:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-65a3dac2-669f-48fd-8762-b906553d625b tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:06:51 devstack sudo[104307]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dc2c0bd7-0fc8-4eb6-a80d-28aee70778f4 tempest-VolumesSnapshotListTestJSON-495348509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.8eb88da1-a7c1-420b-a6ce-ad2193943ecc" returned: 0 in 1.837s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:51 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-dc2c0bd7-0fc8-4eb6-a80d-28aee70778f4 tempest-VolumesSnapshotListTestJSON-495348509 None] Lock "cinder-quobyte-8eb88da1-a7c1-420b-a6ce-ad2193943ecc" released by "_delete_snapshot" :: held 5.036s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:06:51 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-dc2c0bd7-0fc8-4eb6-a80d-28aee70778f4 tempest-VolumesSnapshotListTestJSON-495348509 None] Lock "cinder-quobyte-036704a1-68c7-4408-95b5-7b3e4a2f7b66" released by "delete_snapshot" :: held 5.095s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:06:51 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-dc2c0bd7-0fc8-4eb6-a80d-28aee70778f4 tempest-VolumesSnapshotListTestJSON-495348509 None] Created reservations ['19c970e7-572d-4bbc-b7a3-6386f5a6d076', '1dbf0091-3747-4ec4-be73-9df4ef503406', 'd067a805-86be-4a38-a45c-166f44e54813', 'b4ecfc42-b885-4e44-a60b-a2f9d7efca08'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:06:52 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-dc2c0bd7-0fc8-4eb6-a80d-28aee70778f4 tempest-VolumesSnapshotListTestJSON-495348509 None] Delete snapshot completed successfully. Jun 24 05:06:52 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4e5fe74-7963-4b4d-8eed-16184a0d2050 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:06:52 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f4e5fe74-7963-4b4d-8eed-16184a0d2050 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Flow 'volume_create_manager' (513caf63-0f32-4de8-92b0-882db0182f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:06:52 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f4e5fe74-7963-4b4d-8eed-16184a0d2050 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f6a0d5a-b402-4ed1-932c-0c5e968da45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:52 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-dc2c0bd7-0fc8-4eb6-a80d-28aee70778f4 tempest-VolumesSnapshotListTestJSON-495348509 None] Lock "cinder-8eb88da1-a7c1-420b-a6ce-ad2193943ecc-delete_snapshot" released by "delete_snapshot" :: held 5.581s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:06:52 devstack sudo[104320]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0bbd6c28-c41c-461f-8cd6-f0bde2dea7cc tempest-VolumesTransfersV355Test-732464465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-75ccbb02-b338-44c6-b3a8-8641638aecf5" returned: 0 in 2.151s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0bbd6c28-c41c-461f-8cd6-f0bde2dea7cc tempest-VolumesTransfersV355Test-732464465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-75ccbb02-b338-44c6-b3a8-8641638aecf5 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:52 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f4e5fe74-7963-4b4d-8eed-16184a0d2050 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f6a0d5a-b402-4ed1-932c-0c5e968da45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1531967980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc303758-7618-4b99-8bc0-fe7c926f7882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1d4b362c544563986aa42e280ac43e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:06:52Z,use_quota=True,user_id='cd5a5153b855404fbcf1c2753f4bb242',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:52 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f4e5fe74-7963-4b4d-8eed-16184a0d2050 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (185435bb-c79b-4c14-b0b3-1e0bea19d018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:52 devstack sudo[104379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-75ccbb02-b338-44c6-b3a8-8641638aecf5 Jun 24 05:06:52 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:52 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f4e5fe74-7963-4b4d-8eed-16184a0d2050 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (185435bb-c79b-4c14-b0b3-1e0bea19d018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:52 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f4e5fe74-7963-4b4d-8eed-16184a0d2050 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03a3ba3d-b427-48d7-89c0-3093aad5c0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:52 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f4e5fe74-7963-4b4d-8eed-16184a0d2050 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03a3ba3d-b427-48d7-89c0-3093aad5c0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc303758-7618-4b99-8bc0-fe7c926f7882', 'volume_name': 'volume-cc303758-7618-4b99-8bc0-fe7c926f7882', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:52 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f4e5fe74-7963-4b4d-8eed-16184a0d2050 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1441d8d7-e52c-41d0-a059-78f5ec5b1f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:52 devstack sudo[104354]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:52 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f4e5fe74-7963-4b4d-8eed-16184a0d2050 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1441d8d7-e52c-41d0-a059-78f5ec5b1f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:52 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f4e5fe74-7963-4b4d-8eed-16184a0d2050 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (831b3a1b-392c-474e-8231-255fc4e4400d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:52 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-f4e5fe74-7963-4b4d-8eed-16184a0d2050 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Volume cc303758-7618-4b99-8bc0-fe7c926f7882: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc303758-7618-4b99-8bc0-fe7c926f7882', 'volume_size': 1} Jun 24 05:06:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f4e5fe74-7963-4b4d-8eed-16184a0d2050 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:06:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-b54b72ce-b3fc-4db4-964f-495e9e60de0d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-003e7bb7-6466-4359-b882-9665132e4c2e" returned: 0 in 1.606s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:52 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-b54b72ce-b3fc-4db4-964f-495e9e60de0d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] <== create_volume: return (3452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:06:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-b54b72ce-b3fc-4db4-964f-495e9e60de0d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.456s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:06:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-eff943e5-b5a9-4e67-9abf-5c80c4283eb2 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.035s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:06:52 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-eff943e5-b5a9-4e67-9abf-5c80c4283eb2 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-260055334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7588716-f8ea-4d76-81f0-1208d177ec48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1d4b362c544563986aa42e280ac43e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:06:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:06:49Z,use_quota=True,user_id='cd5a5153b855404fbcf1c2753f4bb242',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:06:52 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-eff943e5-b5a9-4e67-9abf-5c80c4283eb2 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Creating volume a7588716-f8ea-4d76-81f0-1208d177ec48 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:06:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-eff943e5-b5a9-4e67-9abf-5c80c4283eb2 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:06:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-eff943e5-b5a9-4e67-9abf-5c80c4283eb2 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:06:52 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-eff943e5-b5a9-4e67-9abf-5c80c4283eb2 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:06:52 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-eff943e5-b5a9-4e67-9abf-5c80c4283eb2 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:06:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-eff943e5-b5a9-4e67-9abf-5c80c4283eb2 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:06:52 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-eff943e5-b5a9-4e67-9abf-5c80c4283eb2 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:06:52 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-eff943e5-b5a9-4e67-9abf-5c80c4283eb2 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:06:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-eff943e5-b5a9-4e67-9abf-5c80c4283eb2 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a7588716-f8ea-4d76-81f0-1208d177ec48 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:52 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b54b72ce-b3fc-4db4-964f-495e9e60de0d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (925ed903-5dcd-4cda-b671-524e84817dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-003e7bb7-6466-4359-b882-9665132e4c2e', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:52 devstack sudo[104381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a7588716-f8ea-4d76-81f0-1208d177ec48 1073741824 Jun 24 05:06:52 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b54b72ce-b3fc-4db4-964f-495e9e60de0d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f5999a2-6d01-46f6-a9d4-7a92b4113bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:52 devstack sudo[104381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:52 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-b54b72ce-b3fc-4db4-964f-495e9e60de0d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Volume volume-003e7bb7-6466-4359-b882-9665132e4c2e (003e7bb7-6466-4359-b882-9665132e4c2e): created successfully Jun 24 05:06:52 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b54b72ce-b3fc-4db4-964f-495e9e60de0d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f5999a2-6d01-46f6-a9d4-7a92b4113bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:52 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b54b72ce-b3fc-4db4-964f-495e9e60de0d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Flow 'volume_create_manager' (aa7e3752-286e-4f90-8fe7-151a84027c7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:06:52 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-b54b72ce-b3fc-4db4-964f-495e9e60de0d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Created volume successfully. Jun 24 05:06:53 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-20785157-3820-4955-8532-1382b4e7b68b tempest-VolumesSnapshotListTestJSON-495348509 None] Acquiring lock "cinder-08648313-6d9f-49df-a50f-9e6d280fb1b2-delete_snapshot" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:06:53 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-20785157-3820-4955-8532-1382b4e7b68b tempest-VolumesSnapshotListTestJSON-495348509 None] Lock "cinder-08648313-6d9f-49df-a50f-9e6d280fb1b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:06:53 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-20785157-3820-4955-8532-1382b4e7b68b tempest-VolumesSnapshotListTestJSON-495348509 None] Acquiring lock "cinder-quobyte-036704a1-68c7-4408-95b5-7b3e4a2f7b66" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:06:53 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-20785157-3820-4955-8532-1382b4e7b68b tempest-VolumesSnapshotListTestJSON-495348509 None] Lock "cinder-quobyte-036704a1-68c7-4408-95b5-7b3e4a2f7b66" acquired by "delete_snapshot" :: waited 0.034s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:06:53 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-20785157-3820-4955-8532-1382b4e7b68b tempest-VolumesSnapshotListTestJSON-495348509 None] Acquiring lock "cinder-quobyte-08648313-6d9f-49df-a50f-9e6d280fb1b2" by "_delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:06:53 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-20785157-3820-4955-8532-1382b4e7b68b tempest-VolumesSnapshotListTestJSON-495348509 None] Lock "cinder-quobyte-08648313-6d9f-49df-a50f-9e6d280fb1b2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:06:53 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-20785157-3820-4955-8532-1382b4e7b68b tempest-VolumesSnapshotListTestJSON-495348509 None] Deleting offline snapshot 08648313-6d9f-49df-a50f-9e6d280fb1b2 of volume 036704a1-68c7-4408-95b5-7b3e4a2f7b66 {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 05:06:53 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-20785157-3820-4955-8532-1382b4e7b68b tempest-VolumesSnapshotListTestJSON-495348509 None] snapshot_file for this snap is: volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.08648313-6d9f-49df-a50f-9e6d280fb1b2 {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 05:06:53 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6954cec-e60f-4312-88f4-0bc441c7792a]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:06:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-20785157-3820-4955-8532-1382b4e7b68b tempest-VolumesSnapshotListTestJSON-495348509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.08648313-6d9f-49df-a50f-9e6d280fb1b2 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:53 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0bbd6c28-c41c-461f-8cd6-f0bde2dea7cc tempest-VolumesTransfersV355Test-732464465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-75ccbb02-b338-44c6-b3a8-8641638aecf5" returned: 0 in 1.094s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:53 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-0bbd6c28-c41c-461f-8cd6-f0bde2dea7cc tempest-VolumesTransfersV355Test-732464465 None] Lock "cinder-quobyte-75ccbb02-b338-44c6-b3a8-8641638aecf5" released by "delete_volume" :: held 3.358s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:06:53 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-0bbd6c28-c41c-461f-8cd6-f0bde2dea7cc tempest-VolumesTransfersV355Test-732464465 None] Created reservations ['b8a7912a-e0b3-4f0f-9bc0-aa00e631e419', 'adac944a-0fb1-4a15-b85b-99ad84c4ed05', 'ffe14fa7-a2e8-4db1-be79-b5bfc8b4fe43', '8ff2ab02-51ed-456b-92fc-2f7ef1a49555'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:06:53 devstack sudo[104381]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-eff943e5-b5a9-4e67-9abf-5c80c4283eb2 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a7588716-f8ea-4d76-81f0-1208d177ec48 1073741824" returned: 0 in 1.164s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:53 devstack sudo[104388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.08648313-6d9f-49df-a50f-9e6d280fb1b2 Jun 24 05:06:53 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-0bbd6c28-c41c-461f-8cd6-f0bde2dea7cc tempest-VolumesTransfersV355Test-732464465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:06:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-0bbd6c28-c41c-461f-8cd6-f0bde2dea7cc tempest-VolumesTransfersV355Test-732464465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:06:53 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-0bbd6c28-c41c-461f-8cd6-f0bde2dea7cc tempest-VolumesTransfersV355Test-732464465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:06:53 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-0bbd6c28-c41c-461f-8cd6-f0bde2dea7cc tempest-VolumesTransfersV355Test-732464465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:06:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-0bbd6c28-c41c-461f-8cd6-f0bde2dea7cc tempest-VolumesTransfersV355Test-732464465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:06:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0bbd6c28-c41c-461f-8cd6-f0bde2dea7cc tempest-VolumesTransfersV355Test-732464465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-eff943e5-b5a9-4e67-9abf-5c80c4283eb2 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a7588716-f8ea-4d76-81f0-1208d177ec48 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:53 devstack sudo[104390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:06:53 devstack sudo[104390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:53 devstack sudo[104391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a7588716-f8ea-4d76-81f0-1208d177ec48 Jun 24 05:06:53 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:54 devstack sudo[104390]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0bbd6c28-c41c-461f-8cd6-f0bde2dea7cc tempest-VolumesTransfersV355Test-732464465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.809s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:54 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-0bbd6c28-c41c-461f-8cd6-f0bde2dea7cc tempest-VolumesTransfersV355Test-732464465 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:06:54 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-0bbd6c28-c41c-461f-8cd6-f0bde2dea7cc tempest-VolumesTransfersV355Test-732464465 None] Deleted volume successfully. Jun 24 05:06:54 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-eff943e5-b5a9-4e67-9abf-5c80c4283eb2 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a7588716-f8ea-4d76-81f0-1208d177ec48" returned: 0 in 0.822s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:54 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-eff943e5-b5a9-4e67-9abf-5c80c4283eb2 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] <== create_volume: return (2078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:06:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-eff943e5-b5a9-4e67-9abf-5c80c4283eb2 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.084s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:06:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-df4348a2-e38a-44be-ad80-b1fa9ac2aa96 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.109s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:06:54 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-df4348a2-e38a-44be-ad80-b1fa9ac2aa96 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1468080841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b1e2fc3-3144-450f-970b-4342406a6b71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1d4b362c544563986aa42e280ac43e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:06:50Z,use_quota=True,user_id='cd5a5153b855404fbcf1c2753f4bb242',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:06:54 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-df4348a2-e38a-44be-ad80-b1fa9ac2aa96 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Creating volume 4b1e2fc3-3144-450f-970b-4342406a6b71 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:06:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-df4348a2-e38a-44be-ad80-b1fa9ac2aa96 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:06:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-df4348a2-e38a-44be-ad80-b1fa9ac2aa96 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:06:54 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-df4348a2-e38a-44be-ad80-b1fa9ac2aa96 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:06:54 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-df4348a2-e38a-44be-ad80-b1fa9ac2aa96 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:06:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-df4348a2-e38a-44be-ad80-b1fa9ac2aa96 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:06:54 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-df4348a2-e38a-44be-ad80-b1fa9ac2aa96 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:06:54 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-df4348a2-e38a-44be-ad80-b1fa9ac2aa96 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:06:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-df4348a2-e38a-44be-ad80-b1fa9ac2aa96 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4b1e2fc3-3144-450f-970b-4342406a6b71 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:54 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-20785157-3820-4955-8532-1382b4e7b68b tempest-VolumesSnapshotListTestJSON-495348509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.08648313-6d9f-49df-a50f-9e6d280fb1b2" returned: 0 in 1.163s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:54 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-20785157-3820-4955-8532-1382b4e7b68b tempest-VolumesSnapshotListTestJSON-495348509 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:06:54 devstack sudo[104400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4b1e2fc3-3144-450f-970b-4342406a6b71 1073741824 Jun 24 05:06:54 devstack sudo[104400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:54 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-eff943e5-b5a9-4e67-9abf-5c80c4283eb2 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c457369-80dd-44e2-9c51-fd699868b5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7588716-f8ea-4d76-81f0-1208d177ec48', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:54 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-eff943e5-b5a9-4e67-9abf-5c80c4283eb2 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a08f20f-06ad-4f5b-b2e5-983a18ab38bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:54 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5198ba-53aa-4c0f-b8cc-d0d9b6554e4d]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:06:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-20785157-3820-4955-8532-1382b4e7b68b tempest-VolumesSnapshotListTestJSON-495348509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.6bede0a7-39bc-451b-b457-080547a822ee {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:54 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-0bbd6c28-c41c-461f-8cd6-f0bde2dea7cc tempest-VolumesTransfersV355Test-732464465 None] Lock "cinder-75ccbb02-b338-44c6-b3a8-8641638aecf5-delete_volume" released by "delete_volume" :: held 4.796s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:06:54 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-eff943e5-b5a9-4e67-9abf-5c80c4283eb2 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Volume volume-a7588716-f8ea-4d76-81f0-1208d177ec48 (a7588716-f8ea-4d76-81f0-1208d177ec48): created successfully Jun 24 05:06:54 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-eff943e5-b5a9-4e67-9abf-5c80c4283eb2 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a08f20f-06ad-4f5b-b2e5-983a18ab38bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:54 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-eff943e5-b5a9-4e67-9abf-5c80c4283eb2 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Flow 'volume_create_manager' (743d1c49-df44-4be3-8d82-ed2ef75986de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:06:54 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-eff943e5-b5a9-4e67-9abf-5c80c4283eb2 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Created volume successfully. Jun 24 05:06:54 devstack sudo[104402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.6bede0a7-39bc-451b-b457-080547a822ee Jun 24 05:06:54 devstack sudo[104402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:55 devstack sudo[104402]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-20785157-3820-4955-8532-1382b4e7b68b tempest-VolumesSnapshotListTestJSON-495348509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.6bede0a7-39bc-451b-b457-080547a822ee" returned: 0 in 1.176s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:55 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-20785157-3820-4955-8532-1382b4e7b68b tempest-VolumesSnapshotListTestJSON-495348509 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:06:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-20785157-3820-4955-8532-1382b4e7b68b tempest-VolumesSnapshotListTestJSON-495348509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.08648313-6d9f-49df-a50f-9e6d280fb1b2 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:55 devstack sudo[104400]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-df4348a2-e38a-44be-ad80-b1fa9ac2aa96 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4b1e2fc3-3144-450f-970b-4342406a6b71 1073741824" returned: 0 in 1.364s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:55 devstack sudo[104411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.08648313-6d9f-49df-a50f-9e6d280fb1b2 Jun 24 05:06:55 devstack sudo[104411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-df4348a2-e38a-44be-ad80-b1fa9ac2aa96 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4b1e2fc3-3144-450f-970b-4342406a6b71 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:55 devstack sudo[104413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4b1e2fc3-3144-450f-970b-4342406a6b71 Jun 24 05:06:55 devstack sudo[104413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:57 devstack sudo[104411]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-20785157-3820-4955-8532-1382b4e7b68b tempest-VolumesSnapshotListTestJSON-495348509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.08648313-6d9f-49df-a50f-9e6d280fb1b2" returned: 0 in 1.487s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-20785157-3820-4955-8532-1382b4e7b68b tempest-VolumesSnapshotListTestJSON-495348509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.08648313-6d9f-49df-a50f-9e6d280fb1b2 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:57 devstack sudo[104413]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-df4348a2-e38a-44be-ad80-b1fa9ac2aa96 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4b1e2fc3-3144-450f-970b-4342406a6b71" returned: 0 in 1.360s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:57 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-df4348a2-e38a-44be-ad80-b1fa9ac2aa96 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] <== create_volume: return (2810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:06:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-df4348a2-e38a-44be-ad80-b1fa9ac2aa96 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.817s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:06:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-65a3dac2-669f-48fd-8762-b906553d625b tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.809s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:06:57 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-65a3dac2-669f-48fd-8762-b906553d625b tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1239395352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3ee6760-d3b5-4777-98bc-fbaa3f838e14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1d4b362c544563986aa42e280ac43e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:06:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:06:51Z,use_quota=True,user_id='cd5a5153b855404fbcf1c2753f4bb242',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:06:57 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-65a3dac2-669f-48fd-8762-b906553d625b tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Creating volume d3ee6760-d3b5-4777-98bc-fbaa3f838e14 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:06:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-65a3dac2-669f-48fd-8762-b906553d625b tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:06:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-65a3dac2-669f-48fd-8762-b906553d625b tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:06:57 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-65a3dac2-669f-48fd-8762-b906553d625b tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:06:57 devstack sudo[104422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.08648313-6d9f-49df-a50f-9e6d280fb1b2 Jun 24 05:06:57 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-65a3dac2-669f-48fd-8762-b906553d625b tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:06:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-65a3dac2-669f-48fd-8762-b906553d625b tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:06:57 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-65a3dac2-669f-48fd-8762-b906553d625b tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:06:57 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-65a3dac2-669f-48fd-8762-b906553d625b tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:06:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-65a3dac2-669f-48fd-8762-b906553d625b tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d3ee6760-d3b5-4777-98bc-fbaa3f838e14 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:57 devstack sudo[104422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:57 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-df4348a2-e38a-44be-ad80-b1fa9ac2aa96 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10f05e23-ff3c-4b40-ba15-3e77d7d245a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b1e2fc3-3144-450f-970b-4342406a6b71', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:57 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-df4348a2-e38a-44be-ad80-b1fa9ac2aa96 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e422b66-c447-4a35-8fa7-d045b4520697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:57 devstack sudo[104424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d3ee6760-d3b5-4777-98bc-fbaa3f838e14 1073741824 Jun 24 05:06:57 devstack sudo[104424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:57 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-df4348a2-e38a-44be-ad80-b1fa9ac2aa96 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Volume volume-4b1e2fc3-3144-450f-970b-4342406a6b71 (4b1e2fc3-3144-450f-970b-4342406a6b71): created successfully Jun 24 05:06:57 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-df4348a2-e38a-44be-ad80-b1fa9ac2aa96 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e422b66-c447-4a35-8fa7-d045b4520697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:57 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-df4348a2-e38a-44be-ad80-b1fa9ac2aa96 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Flow 'volume_create_manager' (f48c1446-a1a3-4d01-8c27-d71954a160c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:06:57 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:SELECT=91,cinder:UPDATE=92,cinder:DELETE=13,cinder:INSERT=27 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:06:57 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-df4348a2-e38a-44be-ad80-b1fa9ac2aa96 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Created volume successfully. Jun 24 05:06:58 devstack sudo[104422]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-20785157-3820-4955-8532-1382b4e7b68b tempest-VolumesSnapshotListTestJSON-495348509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.08648313-6d9f-49df-a50f-9e6d280fb1b2" returned: 0 in 1.015s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:58 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-20785157-3820-4955-8532-1382b4e7b68b tempest-VolumesSnapshotListTestJSON-495348509 None] Lock "cinder-quobyte-08648313-6d9f-49df-a50f-9e6d280fb1b2" released by "_delete_snapshot" :: held 5.038s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:06:58 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-20785157-3820-4955-8532-1382b4e7b68b tempest-VolumesSnapshotListTestJSON-495348509 None] Lock "cinder-quobyte-036704a1-68c7-4408-95b5-7b3e4a2f7b66" released by "delete_snapshot" :: held 5.067s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:06:58 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-20785157-3820-4955-8532-1382b4e7b68b tempest-VolumesSnapshotListTestJSON-495348509 None] Created reservations ['e80955a0-357d-4c95-a813-5a44e92f6f53', 'f0a01965-1500-4276-9010-67be46c8e50f', '8099519f-50fd-4919-98a8-0e0b3ace09cf', '97edf237-49cb-42e1-b408-db73012451b6'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:06:58 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-20785157-3820-4955-8532-1382b4e7b68b tempest-VolumesSnapshotListTestJSON-495348509 None] Delete snapshot completed successfully. Jun 24 05:06:58 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-20785157-3820-4955-8532-1382b4e7b68b tempest-VolumesSnapshotListTestJSON-495348509 None] Lock "cinder-08648313-6d9f-49df-a50f-9e6d280fb1b2-delete_snapshot" released by "delete_snapshot" :: held 5.335s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:06:58 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-da2a0037-f82b-4d56-8529-04610a4af009 tempest-VolumesSnapshotListTestJSON-495348509 None] Acquiring lock "cinder-6bede0a7-39bc-451b-b457-080547a822ee-delete_snapshot" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:06:58 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-da2a0037-f82b-4d56-8529-04610a4af009 tempest-VolumesSnapshotListTestJSON-495348509 None] Lock "cinder-6bede0a7-39bc-451b-b457-080547a822ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:06:58 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-da2a0037-f82b-4d56-8529-04610a4af009 tempest-VolumesSnapshotListTestJSON-495348509 None] Acquiring lock "cinder-quobyte-036704a1-68c7-4408-95b5-7b3e4a2f7b66" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:06:58 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-da2a0037-f82b-4d56-8529-04610a4af009 tempest-VolumesSnapshotListTestJSON-495348509 None] Lock "cinder-quobyte-036704a1-68c7-4408-95b5-7b3e4a2f7b66" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:06:58 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-da2a0037-f82b-4d56-8529-04610a4af009 tempest-VolumesSnapshotListTestJSON-495348509 None] Acquiring lock "cinder-quobyte-6bede0a7-39bc-451b-b457-080547a822ee" by "_delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:06:58 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-da2a0037-f82b-4d56-8529-04610a4af009 tempest-VolumesSnapshotListTestJSON-495348509 None] Lock "cinder-quobyte-6bede0a7-39bc-451b-b457-080547a822ee" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:06:58 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-da2a0037-f82b-4d56-8529-04610a4af009 tempest-VolumesSnapshotListTestJSON-495348509 None] Deleting offline snapshot 6bede0a7-39bc-451b-b457-080547a822ee of volume 036704a1-68c7-4408-95b5-7b3e4a2f7b66 {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 05:06:58 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-da2a0037-f82b-4d56-8529-04610a4af009 tempest-VolumesSnapshotListTestJSON-495348509 None] snapshot_file for this snap is: volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.6bede0a7-39bc-451b-b457-080547a822ee {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 05:06:58 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbada43d-f728-4e78-a6f4-9aa8baff1c3d]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:06:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-da2a0037-f82b-4d56-8529-04610a4af009 tempest-VolumesSnapshotListTestJSON-495348509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.6bede0a7-39bc-451b-b457-080547a822ee {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:58 devstack sudo[104431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.6bede0a7-39bc-451b-b457-080547a822ee Jun 24 05:06:58 devstack sudo[104431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:58 devstack sudo[104424]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-65a3dac2-669f-48fd-8762-b906553d625b tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d3ee6760-d3b5-4777-98bc-fbaa3f838e14 1073741824" returned: 0 in 1.713s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-65a3dac2-669f-48fd-8762-b906553d625b tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d3ee6760-d3b5-4777-98bc-fbaa3f838e14 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:59 devstack sudo[104433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d3ee6760-d3b5-4777-98bc-fbaa3f838e14 Jun 24 05:06:59 devstack sudo[104433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:59 devstack sudo[104431]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-da2a0037-f82b-4d56-8529-04610a4af009 tempest-VolumesSnapshotListTestJSON-495348509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.6bede0a7-39bc-451b-b457-080547a822ee" returned: 0 in 1.012s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:59 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-da2a0037-f82b-4d56-8529-04610a4af009 tempest-VolumesSnapshotListTestJSON-495348509 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:06:59 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e14b4f2-c08a-4104-bd45-a170f8ace4ed]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:06:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-da2a0037-f82b-4d56-8529-04610a4af009 tempest-VolumesSnapshotListTestJSON-495348509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:59 devstack sudo[104433]: pam_unix(sudo:session): session closed for user root Jun 24 05:06:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-65a3dac2-669f-48fd-8762-b906553d625b tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d3ee6760-d3b5-4777-98bc-fbaa3f838e14" returned: 0 in 0.851s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:06:59 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-65a3dac2-669f-48fd-8762-b906553d625b tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] <== create_volume: return (2624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:06:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-65a3dac2-669f-48fd-8762-b906553d625b tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.631s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:06:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f4e5fe74-7963-4b4d-8eed-16184a0d2050 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.558s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:06:59 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f4e5fe74-7963-4b4d-8eed-16184a0d2050 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1531967980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc303758-7618-4b99-8bc0-fe7c926f7882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1d4b362c544563986aa42e280ac43e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:06:52Z,use_quota=True,user_id='cd5a5153b855404fbcf1c2753f4bb242',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:06:59 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-f4e5fe74-7963-4b4d-8eed-16184a0d2050 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Creating volume cc303758-7618-4b99-8bc0-fe7c926f7882 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:06:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f4e5fe74-7963-4b4d-8eed-16184a0d2050 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:06:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f4e5fe74-7963-4b4d-8eed-16184a0d2050 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:06:59 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f4e5fe74-7963-4b4d-8eed-16184a0d2050 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:06:59 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f4e5fe74-7963-4b4d-8eed-16184a0d2050 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:06:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f4e5fe74-7963-4b4d-8eed-16184a0d2050 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:06:59 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f4e5fe74-7963-4b4d-8eed-16184a0d2050 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:06:59 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-f4e5fe74-7963-4b4d-8eed-16184a0d2050 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:06:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f4e5fe74-7963-4b4d-8eed-16184a0d2050 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cc303758-7618-4b99-8bc0-fe7c926f7882 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:06:59 devstack sudo[104439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66 Jun 24 05:06:59 devstack sudo[104439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:59 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-65a3dac2-669f-48fd-8762-b906553d625b tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97cd9576-b8ee-496f-89df-929f2dba4004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3ee6760-d3b5-4777-98bc-fbaa3f838e14', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:59 devstack sudo[104440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cc303758-7618-4b99-8bc0-fe7c926f7882 1073741824 Jun 24 05:06:59 devstack sudo[104440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:06:59 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-65a3dac2-669f-48fd-8762-b906553d625b tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d11daa60-6036-4b53-babc-def4b767fdc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:06:59 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-65a3dac2-669f-48fd-8762-b906553d625b tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Volume volume-d3ee6760-d3b5-4777-98bc-fbaa3f838e14 (d3ee6760-d3b5-4777-98bc-fbaa3f838e14): created successfully Jun 24 05:06:59 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-65a3dac2-669f-48fd-8762-b906553d625b tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d11daa60-6036-4b53-babc-def4b767fdc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:06:59 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-65a3dac2-669f-48fd-8762-b906553d625b tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Flow 'volume_create_manager' (677be6bf-5e7e-4e07-9924-a80124a25569) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:06:59 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-65a3dac2-669f-48fd-8762-b906553d625b tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Created volume successfully. Jun 24 05:07:00 devstack sudo[104439]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-da2a0037-f82b-4d56-8529-04610a4af009 tempest-VolumesSnapshotListTestJSON-495348509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66" returned: 0 in 1.061s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-da2a0037-f82b-4d56-8529-04610a4af009 tempest-VolumesSnapshotListTestJSON-495348509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.6bede0a7-39bc-451b-b457-080547a822ee {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:00 devstack sudo[104452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.6bede0a7-39bc-451b-b457-080547a822ee Jun 24 05:07:00 devstack sudo[104452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:00 devstack sudo[104440]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f4e5fe74-7963-4b4d-8eed-16184a0d2050 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cc303758-7618-4b99-8bc0-fe7c926f7882 1073741824" returned: 0 in 1.054s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f4e5fe74-7963-4b4d-8eed-16184a0d2050 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cc303758-7618-4b99-8bc0-fe7c926f7882 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:01 devstack sudo[104454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cc303758-7618-4b99-8bc0-fe7c926f7882 Jun 24 05:07:01 devstack sudo[104454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:01 devstack sudo[104452]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-da2a0037-f82b-4d56-8529-04610a4af009 tempest-VolumesSnapshotListTestJSON-495348509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.6bede0a7-39bc-451b-b457-080547a822ee" returned: 0 in 0.969s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-da2a0037-f82b-4d56-8529-04610a4af009 tempest-VolumesSnapshotListTestJSON-495348509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.6bede0a7-39bc-451b-b457-080547a822ee {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:01 devstack sudo[104461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.6bede0a7-39bc-451b-b457-080547a822ee Jun 24 05:07:01 devstack sudo[104461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:01 devstack sudo[104454]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f4e5fe74-7963-4b4d-8eed-16184a0d2050 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cc303758-7618-4b99-8bc0-fe7c926f7882" returned: 0 in 0.843s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:01 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f4e5fe74-7963-4b4d-8eed-16184a0d2050 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] <== create_volume: return (1962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:07:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f4e5fe74-7963-4b4d-8eed-16184a0d2050 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.966s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:07:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f4e5fe74-7963-4b4d-8eed-16184a0d2050 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (831b3a1b-392c-474e-8231-255fc4e4400d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc303758-7618-4b99-8bc0-fe7c926f7882', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:07:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f4e5fe74-7963-4b4d-8eed-16184a0d2050 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f30eb9-018f-4ad5-9d9a-f463e8237159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:07:01 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-f4e5fe74-7963-4b4d-8eed-16184a0d2050 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Volume volume-cc303758-7618-4b99-8bc0-fe7c926f7882 (cc303758-7618-4b99-8bc0-fe7c926f7882): created successfully Jun 24 05:07:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f4e5fe74-7963-4b4d-8eed-16184a0d2050 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f30eb9-018f-4ad5-9d9a-f463e8237159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:07:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f4e5fe74-7963-4b4d-8eed-16184a0d2050 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Flow 'volume_create_manager' (513caf63-0f32-4de8-92b0-882db0182f26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:07:01 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-f4e5fe74-7963-4b4d-8eed-16184a0d2050 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Created volume successfully. Jun 24 05:07:02 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-05085553-5346-49b2-808c-55813c404cbe tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Acquiring lock "cinder-cc303758-7618-4b99-8bc0-fe7c926f7882-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:07:02 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-05085553-5346-49b2-808c-55813c404cbe tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "cinder-cc303758-7618-4b99-8bc0-fe7c926f7882-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:07:02 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-05085553-5346-49b2-808c-55813c404cbe tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Acquiring lock "cinder-quobyte-cc303758-7618-4b99-8bc0-fe7c926f7882" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:07:02 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-05085553-5346-49b2-808c-55813c404cbe tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "cinder-quobyte-cc303758-7618-4b99-8bc0-fe7c926f7882" acquired by "delete_volume" :: waited 0.025s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:07:02 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[119ca041-282c-4161-a57b-6c55168a69fd]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:07:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-05085553-5346-49b2-808c-55813c404cbe tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cc303758-7618-4b99-8bc0-fe7c926f7882 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:02 devstack sudo[104463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cc303758-7618-4b99-8bc0-fe7c926f7882 Jun 24 05:07:02 devstack sudo[104463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:02 devstack sudo[104461]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-da2a0037-f82b-4d56-8529-04610a4af009 tempest-VolumesSnapshotListTestJSON-495348509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66.6bede0a7-39bc-451b-b457-080547a822ee" returned: 0 in 1.002s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:02 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-da2a0037-f82b-4d56-8529-04610a4af009 tempest-VolumesSnapshotListTestJSON-495348509 None] Lock "cinder-quobyte-6bede0a7-39bc-451b-b457-080547a822ee" released by "_delete_snapshot" :: held 4.184s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:07:02 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-da2a0037-f82b-4d56-8529-04610a4af009 tempest-VolumesSnapshotListTestJSON-495348509 None] Lock "cinder-quobyte-036704a1-68c7-4408-95b5-7b3e4a2f7b66" released by "delete_snapshot" :: held 4.223s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:07:02 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-da2a0037-f82b-4d56-8529-04610a4af009 tempest-VolumesSnapshotListTestJSON-495348509 None] Created reservations ['f0e18eb9-0037-4f9d-8c01-135238d59e0d', 'fe95be8b-0da0-4a44-9b9e-39d3eae6bdad', '250241c7-5dd0-402f-9957-2113415ff648', 'f4998f25-6ade-44ae-8dad-26467a325dfa'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:07:02 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-da2a0037-f82b-4d56-8529-04610a4af009 tempest-VolumesSnapshotListTestJSON-495348509 None] Delete snapshot completed successfully. Jun 24 05:07:03 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-da2a0037-f82b-4d56-8529-04610a4af009 tempest-VolumesSnapshotListTestJSON-495348509 None] Lock "cinder-6bede0a7-39bc-451b-b457-080547a822ee-delete_snapshot" released by "delete_snapshot" :: held 4.426s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:07:03 devstack sudo[104463]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-05085553-5346-49b2-808c-55813c404cbe tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cc303758-7618-4b99-8bc0-fe7c926f7882" returned: 0 in 0.961s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-05085553-5346-49b2-808c-55813c404cbe tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cc303758-7618-4b99-8bc0-fe7c926f7882 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:03 devstack sudo[104469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cc303758-7618-4b99-8bc0-fe7c926f7882 Jun 24 05:07:03 devstack sudo[104469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:03 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:07:03 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Flow 'volume_create_manager' (d5147e40-5f73-4902-8bf8-a7b2efde8223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:07:03 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f87e7bc0-57d5-441c-90b1-f39c4c0b4ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:07:03 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f87e7bc0-57d5-441c-90b1-f39c4c0b4ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-748684676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fca5f2ee-00f4-4bb9-ab85-f888506b7f86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a68e799adbe240b584fa379bdd27e0fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:07:04Z,use_quota=True,user_id='b32680ffb07844f480e3e45f47cd74d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:07:03 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f0602cf-3a6b-499b-b3bc-f632bc99efd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:07:03 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f0602cf-3a6b-499b-b3bc-f632bc99efd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:07:03 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebe1d199-f093-4d8a-9561-b7fca92fd855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:07:03 devstack cinder-volume[93830]: DEBUG cinder.image.glance [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Creating Keystone auth plugin from conf {{(pid=93830) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 24 05:07:04 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a54238cd-c081-4168-83e8-790cd90a5763 tempest-VolumesSnapshotListTestJSON-495348509 None] Acquiring lock "cinder-036704a1-68c7-4408-95b5-7b3e4a2f7b66-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:07:04 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a54238cd-c081-4168-83e8-790cd90a5763 tempest-VolumesSnapshotListTestJSON-495348509 None] Lock "cinder-036704a1-68c7-4408-95b5-7b3e4a2f7b66-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:07:04 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebe1d199-f093-4d8a-9561-b7fca92fd855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fca5f2ee-00f4-4bb9-ab85-f888506b7f86', 'volume_name': 'volume-fca5f2ee-00f4-4bb9-ab85-f888506b7f86', 'volume_size': 1, 'image_id': 'f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f7b9466e67614ef6a2783f0123a80489', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'created_at': datetime.datetime(2026, 6, 24, 2, 51, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 51, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:07:04 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe64763a-7c4f-4ef1-bcad-03d733eb4d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:07:04 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe64763a-7c4f-4ef1-bcad-03d733eb4d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:07:04 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c1f3529-efa6-4fe1-96e8-21fdeea4af39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:07:04 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Volume fca5f2ee-00f4-4bb9-ab85-f888506b7f86: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fca5f2ee-00f4-4bb9-ab85-f888506b7f86', 'volume_size': 1, 'image_id': 'f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f7b9466e67614ef6a2783f0123a80489', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'created_at': datetime.datetime(2026, 6, 24, 2, 51, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 51, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 24 05:07:04 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Trying to clone fca5f2ee-00f4-4bb9-ab85-f888506b7f86 from image f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'metadata': {}}]). {{(pid=93830) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 24 05:07:04 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a54238cd-c081-4168-83e8-790cd90a5763 tempest-VolumesSnapshotListTestJSON-495348509 None] Acquiring lock "cinder-quobyte-036704a1-68c7-4408-95b5-7b3e4a2f7b66" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:07:04 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a54238cd-c081-4168-83e8-790cd90a5763 tempest-VolumesSnapshotListTestJSON-495348509 None] Lock "cinder-quobyte-036704a1-68c7-4408-95b5-7b3e4a2f7b66" acquired by "delete_volume" :: waited 0.017s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:07:04 devstack sudo[104469]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-05085553-5346-49b2-808c-55813c404cbe tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cc303758-7618-4b99-8bc0-fe7c926f7882" returned: 0 in 0.883s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:04 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd7b042-6575-4b13-8db5-b49853ee8e06]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:07:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a54238cd-c081-4168-83e8-790cd90a5763 tempest-VolumesSnapshotListTestJSON-495348509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:04 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-05085553-5346-49b2-808c-55813c404cbe tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "cinder-quobyte-cc303758-7618-4b99-8bc0-fe7c926f7882" released by "delete_volume" :: held 1.913s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:07:04 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-05085553-5346-49b2-808c-55813c404cbe tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Created reservations ['7fbc7bb4-e746-49a7-be88-4ecf8b4f6610', 'b365f889-c6f4-4a7e-8dac-7b8da069ed63', '83084603-0ea7-4f7d-b3d0-f461a3bf37d2', 'df69d083-ef4d-4845-a673-93725f3e30da'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:07:04 devstack sudo[104501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66 Jun 24 05:07:04 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-05085553-5346-49b2-808c-55813c404cbe tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:07:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-05085553-5346-49b2-808c-55813c404cbe tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:07:04 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-05085553-5346-49b2-808c-55813c404cbe tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:07:04 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-05085553-5346-49b2-808c-55813c404cbe tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:07:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-05085553-5346-49b2-808c-55813c404cbe tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:07:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-05085553-5346-49b2-808c-55813c404cbe tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:04 devstack sudo[104503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:07:04 devstack sudo[104503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:04 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-68ff9b83-d70f-4be8-9122-da943832e47d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Acquiring lock "cinder-d3ee6760-d3b5-4777-98bc-fbaa3f838e14-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:07:04 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_o3sf35l2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93830) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 24 05:07:04 devstack cinder-volume[93830]: INFO cinder.image.image_utils [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Image download 20.69 MB at 20.69 MB/s Jun 24 05:07:04 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-68ff9b83-d70f-4be8-9122-da943832e47d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "cinder-d3ee6760-d3b5-4777-98bc-fbaa3f838e14-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:07:04 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-68ff9b83-d70f-4be8-9122-da943832e47d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Acquiring lock "cinder-quobyte-d3ee6760-d3b5-4777-98bc-fbaa3f838e14" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:07:04 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-68ff9b83-d70f-4be8-9122-da943832e47d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "cinder-quobyte-d3ee6760-d3b5-4777-98bc-fbaa3f838e14" acquired by "delete_volume" :: waited 0.024s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:07:04 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[55352bd3-19c2-4b44-a7d6-5e554591a902]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:07:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_o3sf35l2devstack@QuobyteHD {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:04 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[c016f4e8-8a28-4de0-8949-f246ae67924b]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:07:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-68ff9b83-d70f-4be8-9122-da943832e47d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d3ee6760-d3b5-4777-98bc-fbaa3f838e14 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:04 devstack sudo[104507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_o3sf35l2devstack@QuobyteHD Jun 24 05:07:04 devstack sudo[104507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:04 devstack sudo[104508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d3ee6760-d3b5-4777-98bc-fbaa3f838e14 Jun 24 05:07:04 devstack sudo[104508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:05 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a54238cd-c081-4168-83e8-790cd90a5763 tempest-VolumesSnapshotListTestJSON-495348509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66" returned: 0 in 1.060s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a54238cd-c081-4168-83e8-790cd90a5763 tempest-VolumesSnapshotListTestJSON-495348509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:05 devstack sudo[104503]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-05085553-5346-49b2-808c-55813c404cbe tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.794s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:05 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-05085553-5346-49b2-808c-55813c404cbe tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:07:05 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-05085553-5346-49b2-808c-55813c404cbe tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Deleted volume successfully. Jun 24 05:07:05 devstack sudo[104516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66 Jun 24 05:07:05 devstack sudo[104516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:05 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-05085553-5346-49b2-808c-55813c404cbe tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "cinder-cc303758-7618-4b99-8bc0-fe7c926f7882-delete_volume" released by "delete_volume" :: held 3.124s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:07:05 devstack sudo[104507]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_o3sf35l2devstack@QuobyteHD" returned: 0 in 0.824s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:05 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Temporary image f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1 is fetched for user b32680ffb07844f480e3e45f47cd74d7. {{(pid=93830) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 24 05:07:05 devstack sudo[104508]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-68ff9b83-d70f-4be8-9122-da943832e47d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d3ee6760-d3b5-4777-98bc-fbaa3f838e14" returned: 0 in 0.824s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-68ff9b83-d70f-4be8-9122-da943832e47d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d3ee6760-d3b5-4777-98bc-fbaa3f838e14 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:05 devstack sudo[104524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d3ee6760-d3b5-4777-98bc-fbaa3f838e14 Jun 24 05:07:05 devstack sudo[104524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:05 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c0f8c8-37a0-4e5b-a193-3afb72299723]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:07:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_o3sf35l2devstack@QuobyteHD {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:05 devstack sudo[104526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_o3sf35l2devstack@QuobyteHD Jun 24 05:07:05 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:06 devstack sudo[104516]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a54238cd-c081-4168-83e8-790cd90a5763 tempest-VolumesSnapshotListTestJSON-495348509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-036704a1-68c7-4408-95b5-7b3e4a2f7b66" returned: 0 in 0.694s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:06 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a54238cd-c081-4168-83e8-790cd90a5763 tempest-VolumesSnapshotListTestJSON-495348509 None] Lock "cinder-quobyte-036704a1-68c7-4408-95b5-7b3e4a2f7b66" released by "delete_volume" :: held 1.832s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:07:06 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-a54238cd-c081-4168-83e8-790cd90a5763 tempest-VolumesSnapshotListTestJSON-495348509 None] Created reservations ['5fde6abf-4b1b-4567-b54f-c77961b6f175', 'df1564c6-6915-4532-ac55-0a44ebee53e9', 'd0b2e4f2-d9a2-4c8d-ac0e-145c74621bf3', '0b6d9350-1ed7-40d0-8174-152817551ecc'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:07:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a54238cd-c081-4168-83e8-790cd90a5763 tempest-VolumesSnapshotListTestJSON-495348509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:07:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a54238cd-c081-4168-83e8-790cd90a5763 tempest-VolumesSnapshotListTestJSON-495348509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:07:06 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a54238cd-c081-4168-83e8-790cd90a5763 tempest-VolumesSnapshotListTestJSON-495348509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:07:06 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a54238cd-c081-4168-83e8-790cd90a5763 tempest-VolumesSnapshotListTestJSON-495348509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:07:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a54238cd-c081-4168-83e8-790cd90a5763 tempest-VolumesSnapshotListTestJSON-495348509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:07:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a54238cd-c081-4168-83e8-790cd90a5763 tempest-VolumesSnapshotListTestJSON-495348509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:06 devstack sudo[104529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:07:06 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:06 devstack sudo[104524]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-68ff9b83-d70f-4be8-9122-da943832e47d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d3ee6760-d3b5-4777-98bc-fbaa3f838e14" returned: 0 in 0.702s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:06 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-68ff9b83-d70f-4be8-9122-da943832e47d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "cinder-quobyte-d3ee6760-d3b5-4777-98bc-fbaa3f838e14" released by "delete_volume" :: held 1.584s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:07:06 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-68ff9b83-d70f-4be8-9122-da943832e47d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Created reservations ['43d4cea1-e1ee-43d7-bcc7-dcce30c4edf2', '2bd43964-43fe-44f6-a783-f111fa67e1e2', 'e7243225-1c6f-4b8a-ad3e-175b160a32d6', '4c376dd0-8784-4fe1-a215-ebceff126e73'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:07:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-68ff9b83-d70f-4be8-9122-da943832e47d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:07:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-68ff9b83-d70f-4be8-9122-da943832e47d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:07:06 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-68ff9b83-d70f-4be8-9122-da943832e47d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:07:06 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-68ff9b83-d70f-4be8-9122-da943832e47d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:07:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-68ff9b83-d70f-4be8-9122-da943832e47d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:07:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-68ff9b83-d70f-4be8-9122-da943832e47d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:06 devstack sudo[104536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:07:06 devstack sudo[104536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:06 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_o3sf35l2devstack@QuobyteHD" returned: 0 in 0.839s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:07:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:07:06 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-748684676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fca5f2ee-00f4-4bb9-ab85-f888506b7f86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a68e799adbe240b584fa379bdd27e0fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:07:04Z,use_quota=True,user_id='b32680ffb07844f480e3e45f47cd74d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:07:06 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Creating volume fca5f2ee-00f4-4bb9-ab85-f888506b7f86 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:07:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:07:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:07:06 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:07:06 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:07:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:07:06 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:07:06 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:07:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-fca5f2ee-00f4-4bb9-ab85-f888506b7f86 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:06 devstack sudo[104538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-fca5f2ee-00f4-4bb9-ab85-f888506b7f86 1073741824 Jun 24 05:07:06 devstack sudo[104538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:06 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a54238cd-c081-4168-83e8-790cd90a5763 tempest-VolumesSnapshotListTestJSON-495348509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.773s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:06 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-a54238cd-c081-4168-83e8-790cd90a5763 tempest-VolumesSnapshotListTestJSON-495348509 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:07:06 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-a54238cd-c081-4168-83e8-790cd90a5763 tempest-VolumesSnapshotListTestJSON-495348509 None] Deleted volume successfully. Jun 24 05:07:06 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a54238cd-c081-4168-83e8-790cd90a5763 tempest-VolumesSnapshotListTestJSON-495348509 None] Lock "cinder-036704a1-68c7-4408-95b5-7b3e4a2f7b66-delete_volume" released by "delete_volume" :: held 2.888s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:07:07 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-efe4f969-9c11-4fc2-b198-0ea7eb9413da tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Acquiring lock "cinder-4b1e2fc3-3144-450f-970b-4342406a6b71-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:07:07 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-efe4f969-9c11-4fc2-b198-0ea7eb9413da tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "cinder-4b1e2fc3-3144-450f-970b-4342406a6b71-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:07:07 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-efe4f969-9c11-4fc2-b198-0ea7eb9413da tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Acquiring lock "cinder-quobyte-4b1e2fc3-3144-450f-970b-4342406a6b71" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:07:07 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-efe4f969-9c11-4fc2-b198-0ea7eb9413da tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "cinder-quobyte-4b1e2fc3-3144-450f-970b-4342406a6b71" acquired by "delete_volume" :: waited 0.025s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:07:07 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[478f424a-dab9-415c-a0de-930beb411e51]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:07:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-efe4f969-9c11-4fc2-b198-0ea7eb9413da tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4b1e2fc3-3144-450f-970b-4342406a6b71 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:07 devstack sudo[104541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4b1e2fc3-3144-450f-970b-4342406a6b71 Jun 24 05:07:07 devstack sudo[104541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:07 devstack sudo[104536]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-68ff9b83-d70f-4be8-9122-da943832e47d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.870s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:07 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-68ff9b83-d70f-4be8-9122-da943832e47d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:07:07 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-68ff9b83-d70f-4be8-9122-da943832e47d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Deleted volume successfully. Jun 24 05:07:07 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-68ff9b83-d70f-4be8-9122-da943832e47d tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "cinder-d3ee6760-d3b5-4777-98bc-fbaa3f838e14-delete_volume" released by "delete_volume" :: held 2.730s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:07:07 devstack sudo[104538]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-fca5f2ee-00f4-4bb9-ab85-f888506b7f86 1073741824" returned: 0 in 1.104s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-fca5f2ee-00f4-4bb9-ab85-f888506b7f86 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:07 devstack sudo[104548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-fca5f2ee-00f4-4bb9-ab85-f888506b7f86 Jun 24 05:07:07 devstack sudo[104548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:08 devstack sudo[104541]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-efe4f969-9c11-4fc2-b198-0ea7eb9413da tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4b1e2fc3-3144-450f-970b-4342406a6b71" returned: 0 in 0.903s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-efe4f969-9c11-4fc2-b198-0ea7eb9413da tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4b1e2fc3-3144-450f-970b-4342406a6b71 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:08 devstack sudo[104553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4b1e2fc3-3144-450f-970b-4342406a6b71 Jun 24 05:07:08 devstack sudo[104553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:08 devstack sudo[104548]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-fca5f2ee-00f4-4bb9-ab85-f888506b7f86" returned: 0 in 0.679s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:08 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] <== create_volume: return (1837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:07:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.842s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:07:08 devstack cinder-volume[93830]: DEBUG cinder.volume.volume_utils [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Attempting download of f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1 ((None, [{'url': 'file:///opt/stack/data/glance/images/f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'metadata': {}}])) to volume fca5f2ee-00f4-4bb9-ab85-f888506b7f86. {{(pid=93830) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 24 05:07:08 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[b287c2f9-9c4a-44ce-9aca-f11a4cf57dc2]: (4, 'raw') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:07:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_q3h7z8cj {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:08 devstack sudo[104556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_q3h7z8cj Jun 24 05:07:08 devstack sudo[104556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:08 devstack sudo[104553]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-efe4f969-9c11-4fc2-b198-0ea7eb9413da tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4b1e2fc3-3144-450f-970b-4342406a6b71" returned: 0 in 0.682s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:08 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-efe4f969-9c11-4fc2-b198-0ea7eb9413da tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "cinder-quobyte-4b1e2fc3-3144-450f-970b-4342406a6b71" released by "delete_volume" :: held 1.643s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:07:08 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-efe4f969-9c11-4fc2-b198-0ea7eb9413da tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Created reservations ['aec6c692-5fed-403f-a134-ab0fe7eca8cc', '7c04d09b-9a48-4a7e-b709-29c6ef665ca4', '35b54991-914d-4a97-acd1-d1f9f25f5850', '6c827bcc-c41f-447a-8f85-62fb0285027f'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:07:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-efe4f969-9c11-4fc2-b198-0ea7eb9413da tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:07:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-efe4f969-9c11-4fc2-b198-0ea7eb9413da tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:07:08 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-efe4f969-9c11-4fc2-b198-0ea7eb9413da tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:07:08 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-efe4f969-9c11-4fc2-b198-0ea7eb9413da tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:07:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-efe4f969-9c11-4fc2-b198-0ea7eb9413da tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:07:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-efe4f969-9c11-4fc2-b198-0ea7eb9413da tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:08 devstack sudo[104559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:07:08 devstack sudo[104559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:09 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-1d76a63d-0ecd-4d7b-a7bc-7278436255f1 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Acquiring lock "cinder-a7588716-f8ea-4d76-81f0-1208d177ec48-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:07:09 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-1d76a63d-0ecd-4d7b-a7bc-7278436255f1 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "cinder-a7588716-f8ea-4d76-81f0-1208d177ec48-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:07:09 devstack sudo[104556]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_q3h7z8cj" returned: 0 in 0.821s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_q3h7z8cj {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:09 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-1d76a63d-0ecd-4d7b-a7bc-7278436255f1 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Acquiring lock "cinder-quobyte-a7588716-f8ea-4d76-81f0-1208d177ec48" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:07:09 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-1d76a63d-0ecd-4d7b-a7bc-7278436255f1 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "cinder-quobyte-a7588716-f8ea-4d76-81f0-1208d177ec48" acquired by "delete_volume" :: waited 0.025s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:07:09 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc19bf0-10c8-4196-bf46-b360459c9fdb]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:07:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1d76a63d-0ecd-4d7b-a7bc-7278436255f1 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a7588716-f8ea-4d76-81f0-1208d177ec48 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:09 devstack sudo[104563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_q3h7z8cj Jun 24 05:07:09 devstack sudo[104563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:09 devstack sudo[104559]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-efe4f969-9c11-4fc2-b198-0ea7eb9413da tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.710s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:09 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-efe4f969-9c11-4fc2-b198-0ea7eb9413da tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:07:09 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-efe4f969-9c11-4fc2-b198-0ea7eb9413da tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Deleted volume successfully. Jun 24 05:07:09 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a7588716-f8ea-4d76-81f0-1208d177ec48 Jun 24 05:07:09 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:09 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-efe4f969-9c11-4fc2-b198-0ea7eb9413da tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "cinder-4b1e2fc3-3144-450f-970b-4342406a6b71-delete_volume" released by "delete_volume" :: held 2.615s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:07:09 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 05:07:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:07:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:07:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:07:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:07:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:07:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:09 devstack sudo[104568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:07:09 devstack sudo[104568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:09 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc3441b2-174d-44f5-b82f-859de666e379 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:07:09 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fc3441b2-174d-44f5-b82f-859de666e379 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Flow 'volume_create_manager' (fc6364f4-8976-45d5-b77c-b02d85358e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:07:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fc3441b2-174d-44f5-b82f-859de666e379 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd77b69a-dd33-40be-a8a2-31787342f951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:07:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fc3441b2-174d-44f5-b82f-859de666e379 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd77b69a-dd33-40be-a8a2-31787342f951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-370584442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1ca3540-d275-4fd2-9c5b-be71dd8be9f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2d09de206c8423f9b75f2c3ff802a83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:07:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:07:10Z,use_quota=True,user_id='3fbc8b8e5f2340fd88982b81f3b02fd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:07:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fc3441b2-174d-44f5-b82f-859de666e379 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f10161-30d9-42c8-ba6e-c7edec376ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:07:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fc3441b2-174d-44f5-b82f-859de666e379 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f10161-30d9-42c8-ba6e-c7edec376ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:07:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fc3441b2-174d-44f5-b82f-859de666e379 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f64719d4-31bf-4a8f-9a54-f83d8901d468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:07:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fc3441b2-174d-44f5-b82f-859de666e379 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f64719d4-31bf-4a8f-9a54-f83d8901d468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1ca3540-d275-4fd2-9c5b-be71dd8be9f7', 'volume_name': 'volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7', 'volume_size': 2}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:07:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fc3441b2-174d-44f5-b82f-859de666e379 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1be7824-d028-46d7-8696-dbfcf4f634e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:07:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fc3441b2-174d-44f5-b82f-859de666e379 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1be7824-d028-46d7-8696-dbfcf4f634e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:07:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fc3441b2-174d-44f5-b82f-859de666e379 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d9b11e2-0fc3-47e5-a5f9-98df6c87a5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:07:10 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-fc3441b2-174d-44f5-b82f-859de666e379 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Volume a1ca3540-d275-4fd2-9c5b-be71dd8be9f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7', 'volume_size': 2} Jun 24 05:07:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fc3441b2-174d-44f5-b82f-859de666e379 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:07:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fc3441b2-174d-44f5-b82f-859de666e379 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:07:10 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-fc3441b2-174d-44f5-b82f-859de666e379 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-370584442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1ca3540-d275-4fd2-9c5b-be71dd8be9f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2d09de206c8423f9b75f2c3ff802a83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:07:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:07:10Z,use_quota=True,user_id='3fbc8b8e5f2340fd88982b81f3b02fd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:07:10 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-fc3441b2-174d-44f5-b82f-859de666e379 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Creating volume a1ca3540-d275-4fd2-9c5b-be71dd8be9f7 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:07:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fc3441b2-174d-44f5-b82f-859de666e379 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:07:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fc3441b2-174d-44f5-b82f-859de666e379 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:07:10 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-fc3441b2-174d-44f5-b82f-859de666e379 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:07:10 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-fc3441b2-174d-44f5-b82f-859de666e379 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:07:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fc3441b2-174d-44f5-b82f-859de666e379 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:07:10 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-fc3441b2-174d-44f5-b82f-859de666e379 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:07:10 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-fc3441b2-174d-44f5-b82f-859de666e379 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:07:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fc3441b2-174d-44f5-b82f-859de666e379 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7 2147483648 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:10 devstack sudo[104571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7 2147483648 Jun 24 05:07:10 devstack sudo[104571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:10 devstack sudo[104563]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_q3h7z8cj" returned: 1 in 0.909s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_q3h7z8cj' failed. Not Retrying. {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 05:07:10 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e722464-7fad-4ac9-a3b6-67758a8522a9]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:07:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_o3sf35l2devstack@QuobyteHD {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:10 devstack sudo[104577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_o3sf35l2devstack@QuobyteHD Jun 24 05:07:10 devstack sudo[104577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:10 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1d76a63d-0ecd-4d7b-a7bc-7278436255f1 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a7588716-f8ea-4d76-81f0-1208d177ec48" returned: 0 in 1.043s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1d76a63d-0ecd-4d7b-a7bc-7278436255f1 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a7588716-f8ea-4d76-81f0-1208d177ec48 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:10 devstack sudo[104568]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.820s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:10 devstack sudo[104581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a7588716-f8ea-4d76-81f0-1208d177ec48 Jun 24 05:07:10 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:07:10 devstack sudo[104581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:10 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager._thread_info {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 05:07:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread count: 29 {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 05:07:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread info: [<_MainThread(MainThread, started 130211312517248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 05:07:11 devstack sudo[104571]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fc3441b2-174d-44f5-b82f-859de666e379 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7 2147483648" returned: 0 in 1.060s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fc3441b2-174d-44f5-b82f-859de666e379 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:11 devstack sudo[104577]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_o3sf35l2devstack@QuobyteHD" returned: 0 in 0.931s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:11 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1 was qcow2, converting to raw {{(pid=93830) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 24 05:07:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_o3sf35l2devstack@QuobyteHD /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-fca5f2ee-00f4-4bb9-ab85-f888506b7f86 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:11 devstack sudo[104591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7 Jun 24 05:07:11 devstack sudo[104591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:11 devstack sudo[104592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_o3sf35l2devstack@QuobyteHD /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-fca5f2ee-00f4-4bb9-ab85-f888506b7f86 Jun 24 05:07:11 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:11 devstack sudo[104581]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1d76a63d-0ecd-4d7b-a7bc-7278436255f1 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a7588716-f8ea-4d76-81f0-1208d177ec48" returned: 0 in 0.865s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:11 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-1d76a63d-0ecd-4d7b-a7bc-7278436255f1 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "cinder-quobyte-a7588716-f8ea-4d76-81f0-1208d177ec48" released by "delete_volume" :: held 1.975s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:07:11 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-1d76a63d-0ecd-4d7b-a7bc-7278436255f1 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Created reservations ['8498ea40-30c0-4ad2-a815-beb2fb567b6b', 'b728cbc6-7dd5-4ee5-be51-b084244a2e39', 'd573d02b-8bb3-40d6-afe2-11d75468a081', '6aad44a5-2d2c-431b-a9c1-8e9f2501360a'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:07:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1d76a63d-0ecd-4d7b-a7bc-7278436255f1 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:07:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1d76a63d-0ecd-4d7b-a7bc-7278436255f1 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:07:11 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-1d76a63d-0ecd-4d7b-a7bc-7278436255f1 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:07:11 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-1d76a63d-0ecd-4d7b-a7bc-7278436255f1 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:07:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1d76a63d-0ecd-4d7b-a7bc-7278436255f1 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:07:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1d76a63d-0ecd-4d7b-a7bc-7278436255f1 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:11 devstack sudo[104595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:07:11 devstack sudo[104595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:12 devstack sudo[104591]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fc3441b2-174d-44f5-b82f-859de666e379 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7" returned: 0 in 0.853s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:12 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-fc3441b2-174d-44f5-b82f-859de666e379 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] <== create_volume: return (1976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:07:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fc3441b2-174d-44f5-b82f-859de666e379 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.979s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:07:12 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fc3441b2-174d-44f5-b82f-859de666e379 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d9b11e2-0fc3-47e5-a5f9-98df6c87a5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7', 'volume_size': 2}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:07:12 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fc3441b2-174d-44f5-b82f-859de666e379 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ee1d4a3-414e-45fd-a603-db5437498cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:07:12 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-fc3441b2-174d-44f5-b82f-859de666e379 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Volume volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7 (a1ca3540-d275-4fd2-9c5b-be71dd8be9f7): created successfully Jun 24 05:07:12 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fc3441b2-174d-44f5-b82f-859de666e379 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ee1d4a3-414e-45fd-a603-db5437498cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:07:12 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fc3441b2-174d-44f5-b82f-859de666e379 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Flow 'volume_create_manager' (fc6364f4-8976-45d5-b77c-b02d85358e71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:07:12 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-fc3441b2-174d-44f5-b82f-859de666e379 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Created volume successfully. Jun 24 05:07:12 devstack sudo[104595]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1d76a63d-0ecd-4d7b-a7bc-7278436255f1 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.769s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:12 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-1d76a63d-0ecd-4d7b-a7bc-7278436255f1 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:07:12 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-1d76a63d-0ecd-4d7b-a7bc-7278436255f1 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Deleted volume successfully. Jun 24 05:07:12 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-1d76a63d-0ecd-4d7b-a7bc-7278436255f1 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "cinder-a7588716-f8ea-4d76-81f0-1208d177ec48-delete_volume" released by "delete_volume" :: held 3.098s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:07:12 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e21af0d1-a13c-42c7-b5f6-632ad881f978 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Acquiring lock "cinder-003e7bb7-6466-4359-b882-9665132e4c2e-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:07:12 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e21af0d1-a13c-42c7-b5f6-632ad881f978 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "cinder-003e7bb7-6466-4359-b882-9665132e4c2e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:07:12 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e21af0d1-a13c-42c7-b5f6-632ad881f978 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Acquiring lock "cinder-quobyte-003e7bb7-6466-4359-b882-9665132e4c2e" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:07:12 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e21af0d1-a13c-42c7-b5f6-632ad881f978 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "cinder-quobyte-003e7bb7-6466-4359-b882-9665132e4c2e" acquired by "delete_volume" :: waited 0.018s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:07:12 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b96b7dc-0086-4323-a8cd-1b71e619f645]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:07:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e21af0d1-a13c-42c7-b5f6-632ad881f978 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-003e7bb7-6466-4359-b882-9665132e4c2e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:12 devstack sudo[104613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-003e7bb7-6466-4359-b882-9665132e4c2e Jun 24 05:07:12 devstack sudo[104613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:13 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_o3sf35l2devstack@QuobyteHD /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-fca5f2ee-00f4-4bb9-ab85-f888506b7f86" returned: 0 in 2.143s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:13 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_o3sf35l2devstack@QuobyteHD, size 112.00 MB, duration 2.14 sec, destination /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-fca5f2ee-00f4-4bb9-ab85-f888506b7f86 {{(pid=93830) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 05:07:13 devstack cinder-volume[93830]: INFO cinder.image.image_utils [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Converted 112.00 MB image at 52.24 MB/s Jun 24 05:07:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-fca5f2ee-00f4-4bb9-ab85-f888506b7f86 1G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:13 devstack sudo[104615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-fca5f2ee-00f4-4bb9-ab85-f888506b7f86 1G Jun 24 05:07:13 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f463d49e-0503-4140-8aec-18f7967ffaa9 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:07:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f463d49e-0503-4140-8aec-18f7967ffaa9 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:07:13 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-f463d49e-0503-4140-8aec-18f7967ffaa9 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Creating offline snapshot 998c1305-98d0-4581-9ee6-aae08a6a0dc0 of volume a1ca3540-d275-4fd2-9c5b-be71dd8be9f7 {{(pid=93830) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 05:07:13 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[33632a0a-02ee-4339-a65f-b00766a1a081]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:07:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f463d49e-0503-4140-8aec-18f7967ffaa9 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:13 devstack sudo[104617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7 Jun 24 05:07:13 devstack sudo[104617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:13 devstack sudo[104613]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e21af0d1-a13c-42c7-b5f6-632ad881f978 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-003e7bb7-6466-4359-b882-9665132e4c2e" returned: 0 in 0.979s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e21af0d1-a13c-42c7-b5f6-632ad881f978 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-003e7bb7-6466-4359-b882-9665132e4c2e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:13 devstack sudo[104622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-003e7bb7-6466-4359-b882-9665132e4c2e Jun 24 05:07:13 devstack sudo[104622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:14 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:14 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-fca5f2ee-00f4-4bb9-ab85-f888506b7f86 1G" returned: 0 in 0.862s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:14 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d1d502-aa1b-45e0-a82a-f190149a0c81]: (4, 'raw') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:07:14 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-fca5f2ee-00f4-4bb9-ab85-f888506b7f86 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:14 devstack sudo[104617]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:14 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f463d49e-0503-4140-8aec-18f7967ffaa9 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7" returned: 0 in 0.877s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:14 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f463d49e-0503-4140-8aec-18f7967ffaa9 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7.998c1305-98d0-4581-9ee6-aae08a6a0dc0 2G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:14 devstack sudo[104630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-fca5f2ee-00f4-4bb9-ab85-f888506b7f86 Jun 24 05:07:14 devstack sudo[104630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:14 devstack sudo[104632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7.998c1305-98d0-4581-9ee6-aae08a6a0dc0 2G Jun 24 05:07:14 devstack sudo[104632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:14 devstack sudo[104622]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:14 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e21af0d1-a13c-42c7-b5f6-632ad881f978 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-003e7bb7-6466-4359-b882-9665132e4c2e" returned: 0 in 0.678s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:14 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e21af0d1-a13c-42c7-b5f6-632ad881f978 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "cinder-quobyte-003e7bb7-6466-4359-b882-9665132e4c2e" released by "delete_volume" :: held 1.721s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:07:14 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-e21af0d1-a13c-42c7-b5f6-632ad881f978 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Created reservations ['c8d8f1c5-414c-4131-b31a-6529f2aa2545', '7b6c7dc2-39ff-4700-90d3-36c1bff93bd0', 'b4771796-e4e2-44a2-bb1e-b9baf9df26e0', '82afacef-df90-4a4c-bf72-fcc10970db4b'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:07:14 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e21af0d1-a13c-42c7-b5f6-632ad881f978 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:07:14 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e21af0d1-a13c-42c7-b5f6-632ad881f978 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:07:14 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e21af0d1-a13c-42c7-b5f6-632ad881f978 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:07:14 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e21af0d1-a13c-42c7-b5f6-632ad881f978 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:07:14 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e21af0d1-a13c-42c7-b5f6-632ad881f978 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:07:14 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e21af0d1-a13c-42c7-b5f6-632ad881f978 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:14 devstack sudo[104635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:07:14 devstack sudo[104635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:14 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-28e89f71-7890-4ec1-84ea-e53c5a560e0f tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Acquiring lock "cinder-6cde2d8f-065b-4c2c-b76b-d3f75e3c7969-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:07:15 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-28e89f71-7890-4ec1-84ea-e53c5a560e0f tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "cinder-6cde2d8f-065b-4c2c-b76b-d3f75e3c7969-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:07:15 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-28e89f71-7890-4ec1-84ea-e53c5a560e0f tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Acquiring lock "cinder-quobyte-6cde2d8f-065b-4c2c-b76b-d3f75e3c7969" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:07:15 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-28e89f71-7890-4ec1-84ea-e53c5a560e0f tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "cinder-quobyte-6cde2d8f-065b-4c2c-b76b-d3f75e3c7969" acquired by "delete_volume" :: waited 0.021s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:07:15 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa9214f-4538-4c8f-947c-09b9befd4f34]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:07:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-28e89f71-7890-4ec1-84ea-e53c5a560e0f tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6cde2d8f-065b-4c2c-b76b-d3f75e3c7969 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:15 devstack sudo[104630]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-fca5f2ee-00f4-4bb9-ab85-f888506b7f86" returned: 0 in 0.909s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-fca5f2ee-00f4-4bb9-ab85-f888506b7f86 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:15 devstack sudo[104643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6cde2d8f-065b-4c2c-b76b-d3f75e3c7969 Jun 24 05:07:15 devstack sudo[104643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:15 devstack sudo[104632]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f463d49e-0503-4140-8aec-18f7967ffaa9 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7.998c1305-98d0-4581-9ee6-aae08a6a0dc0 2G" returned: 0 in 0.909s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f463d49e-0503-4140-8aec-18f7967ffaa9 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7.998c1305-98d0-4581-9ee6-aae08a6a0dc0 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:15 devstack sudo[104635]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e21af0d1-a13c-42c7-b5f6-632ad881f978 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.673s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:15 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-e21af0d1-a13c-42c7-b5f6-632ad881f978 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:07:15 devstack sudo[104647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7.998c1305-98d0-4581-9ee6-aae08a6a0dc0 Jun 24 05:07:15 devstack sudo[104647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:15 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-e21af0d1-a13c-42c7-b5f6-632ad881f978 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Deleted volume successfully. Jun 24 05:07:15 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e21af0d1-a13c-42c7-b5f6-632ad881f978 tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "cinder-003e7bb7-6466-4359-b882-9665132e4c2e-delete_volume" released by "delete_volume" :: held 2.621s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:07:15 devstack sudo[104645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-fca5f2ee-00f4-4bb9-ab85-f888506b7f86 Jun 24 05:07:15 devstack sudo[104645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:15 devstack sudo[104643]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-28e89f71-7890-4ec1-84ea-e53c5a560e0f tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6cde2d8f-065b-4c2c-b76b-d3f75e3c7969" returned: 0 in 0.839s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-28e89f71-7890-4ec1-84ea-e53c5a560e0f tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6cde2d8f-065b-4c2c-b76b-d3f75e3c7969 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:15 devstack sudo[104647]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:15 devstack sudo[104645]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f463d49e-0503-4140-8aec-18f7967ffaa9 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7.998c1305-98d0-4581-9ee6-aae08a6a0dc0" returned: 0 in 0.712s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:15 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-f463d49e-0503-4140-8aec-18f7967ffaa9 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7.998c1305-98d0-4581-9ee6-aae08a6a0dc0 is being set with open permissions: ugo+rw Jun 24 05:07:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f463d49e-0503-4140-8aec-18f7967ffaa9 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7.998c1305-98d0-4581-9ee6-aae08a6a0dc0 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-fca5f2ee-00f4-4bb9-ab85-f888506b7f86" returned: 1 in 0.814s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:16 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6cde2d8f-065b-4c2c-b76b-d3f75e3c7969 Jun 24 05:07:16 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-fca5f2ee-00f4-4bb9-ab85-f888506b7f86' failed. Not Retrying. {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 05:07:16 devstack cinder-volume[93830]: DEBUG cinder.volume.volume_utils [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Downloaded image f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1 ((None, [{'url': 'file:///opt/stack/data/glance/images/f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'metadata': {}}])) to volume fca5f2ee-00f4-4bb9-ab85-f888506b7f86 successfully. {{(pid=93830) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 24 05:07:16 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Temporary image f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1 for user b32680ffb07844f480e3e45f47cd74d7 is deleted. {{(pid=93830) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 24 05:07:16 devstack cinder-volume[93830]: DEBUG cinder.volume.volume_utils [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Marking volume fca5f2ee-00f4-4bb9-ab85-f888506b7f86 as bootable. {{(pid=93830) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 24 05:07:16 devstack sudo[104661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7.998c1305-98d0-4581-9ee6-aae08a6a0dc0 Jun 24 05:07:16 devstack sudo[104661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:16 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Copying metadata from image f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1 to fca5f2ee-00f4-4bb9-ab85-f888506b7f86. {{(pid=93830) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 24 05:07:16 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Creating volume glance metadata for volume fca5f2ee-00f4-4bb9-ab85-f888506b7f86 backed by image f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93830) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 24 05:07:16 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c1f3529-efa6-4fe1-96e8-21fdeea4af39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fca5f2ee-00f4-4bb9-ab85-f888506b7f86', 'volume_size': 1, 'image_id': 'f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f7b9466e67614ef6a2783f0123a80489', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'created_at': datetime.datetime(2026, 6, 24, 2, 51, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 51, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:07:16 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (524c5526-fb37-42d3-a834-0e43a11d1598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:07:16 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Volume volume-fca5f2ee-00f4-4bb9-ab85-f888506b7f86 (fca5f2ee-00f4-4bb9-ab85-f888506b7f86): created successfully Jun 24 05:07:16 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (524c5526-fb37-42d3-a834-0e43a11d1598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:07:16 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Flow 'volume_create_manager' (d5147e40-5f73-4902-8bf8-a7b2efde8223) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:07:16 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-44e53fc3-4bf8-4f99-8ad4-422156a64b0f tempest-VolumesExtendTest-1644951533 None] Created volume successfully. Jun 24 05:07:16 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-28e89f71-7890-4ec1-84ea-e53c5a560e0f tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6cde2d8f-065b-4c2c-b76b-d3f75e3c7969" returned: 0 in 0.706s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:16 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-28e89f71-7890-4ec1-84ea-e53c5a560e0f tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "cinder-quobyte-6cde2d8f-065b-4c2c-b76b-d3f75e3c7969" released by "delete_volume" :: held 1.598s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:07:16 devstack sudo[104661]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f463d49e-0503-4140-8aec-18f7967ffaa9 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7.998c1305-98d0-4581-9ee6-aae08a6a0dc0" returned: 0 in 0.724s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f463d49e-0503-4140-8aec-18f7967ffaa9 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:16 devstack sudo[104668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7.info Jun 24 05:07:16 devstack sudo[104668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:16 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-28e89f71-7890-4ec1-84ea-e53c5a560e0f tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Created reservations ['ca57d852-96e9-49e8-96f7-cb4899db54ee', 'adfb4595-1582-4552-9565-705bc9faae0f', '7262bbae-6fc3-409c-bca9-66e3c8425cbf', '24322cd9-aa92-4854-bef2-30ebf3e34a8f'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:07:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-6fc1d1c1-88c8-4b29-af5e-9f675ca68eb7 tempest-VolumesExtendTest-1644951533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:07:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-28e89f71-7890-4ec1-84ea-e53c5a560e0f tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:07:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-28e89f71-7890-4ec1-84ea-e53c5a560e0f tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:07:16 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-28e89f71-7890-4ec1-84ea-e53c5a560e0f tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:07:16 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-28e89f71-7890-4ec1-84ea-e53c5a560e0f tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:07:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-28e89f71-7890-4ec1-84ea-e53c5a560e0f tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:07:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-28e89f71-7890-4ec1-84ea-e53c5a560e0f tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:16 devstack sudo[104670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:07:16 devstack sudo[104670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:17 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-76c3ddc2-3500-4dd3-82f3-db0e6ce8da2f tempest-AttachVolumeNegativeTest-111486486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:07:17 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-76c3ddc2-3500-4dd3-82f3-db0e6ce8da2f tempest-AttachVolumeNegativeTest-111486486 None] Flow 'volume_create_manager' (4e32cf4f-d47f-4884-ad0e-2ac75b7d4ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:07:17 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-76c3ddc2-3500-4dd3-82f3-db0e6ce8da2f tempest-AttachVolumeNegativeTest-111486486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39801a26-d6ed-4c9c-85cb-7b6f08fcaa9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:07:17 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-76c3ddc2-3500-4dd3-82f3-db0e6ce8da2f tempest-AttachVolumeNegativeTest-111486486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39801a26-d6ed-4c9c-85cb-7b6f08fcaa9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-246380024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=098558f2-a68d-49f2-b1c9-182efab3f15b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d469e3abf0c849f59a9e06ca7b031d96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:07:17Z,use_quota=True,user_id='cea5c21618c24cd2aded0d3bbef0fd8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:07:17 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-76c3ddc2-3500-4dd3-82f3-db0e6ce8da2f tempest-AttachVolumeNegativeTest-111486486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b776c39f-cb09-44e6-a62b-79ce434731ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:07:17 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-76c3ddc2-3500-4dd3-82f3-db0e6ce8da2f tempest-AttachVolumeNegativeTest-111486486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b776c39f-cb09-44e6-a62b-79ce434731ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:07:17 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-76c3ddc2-3500-4dd3-82f3-db0e6ce8da2f tempest-AttachVolumeNegativeTest-111486486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4c9ce91-2727-4c36-860a-a9931c379d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:07:17 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-76c3ddc2-3500-4dd3-82f3-db0e6ce8da2f tempest-AttachVolumeNegativeTest-111486486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4c9ce91-2727-4c36-860a-a9931c379d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '098558f2-a68d-49f2-b1c9-182efab3f15b', 'volume_name': 'volume-098558f2-a68d-49f2-b1c9-182efab3f15b', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:07:17 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-76c3ddc2-3500-4dd3-82f3-db0e6ce8da2f tempest-AttachVolumeNegativeTest-111486486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d9a0f7-0b0b-4e9d-911d-6295ff0333d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:07:17 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-76c3ddc2-3500-4dd3-82f3-db0e6ce8da2f tempest-AttachVolumeNegativeTest-111486486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d9a0f7-0b0b-4e9d-911d-6295ff0333d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:07:17 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-76c3ddc2-3500-4dd3-82f3-db0e6ce8da2f tempest-AttachVolumeNegativeTest-111486486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a26f219-cfd1-4651-924f-cd6d24d0d7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:07:17 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-76c3ddc2-3500-4dd3-82f3-db0e6ce8da2f tempest-AttachVolumeNegativeTest-111486486 None] Volume 098558f2-a68d-49f2-b1c9-182efab3f15b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-098558f2-a68d-49f2-b1c9-182efab3f15b', 'volume_size': 1} Jun 24 05:07:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-76c3ddc2-3500-4dd3-82f3-db0e6ce8da2f tempest-AttachVolumeNegativeTest-111486486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:07:17 devstack sudo[104668]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f463d49e-0503-4140-8aec-18f7967ffaa9 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7.info" returned: 0 in 0.754s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:17 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-f463d49e-0503-4140-8aec-18f7967ffaa9 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7.info is being set with open permissions: ugo+rw Jun 24 05:07:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f463d49e-0503-4140-8aec-18f7967ffaa9 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:17 devstack sudo[104673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7.info Jun 24 05:07:17 devstack sudo[104673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:17 devstack sudo[104670]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-28e89f71-7890-4ec1-84ea-e53c5a560e0f tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.735s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:17 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-28e89f71-7890-4ec1-84ea-e53c5a560e0f tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:07:17 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-28e89f71-7890-4ec1-84ea-e53c5a560e0f tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Deleted volume successfully. Jun 24 05:07:17 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-28e89f71-7890-4ec1-84ea-e53c5a560e0f tempest-CreateVolumesFromSourceVolumeTest-2142669589 None] Lock "cinder-6cde2d8f-065b-4c2c-b76b-d3f75e3c7969-delete_volume" released by "delete_volume" :: held 2.662s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:07:18 devstack sudo[104673]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f463d49e-0503-4140-8aec-18f7967ffaa9 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7.info" returned: 0 in 0.721s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f463d49e-0503-4140-8aec-18f7967ffaa9 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.795s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:07:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-6fc1d1c1-88c8-4b29-af5e-9f675ca68eb7 tempest-VolumesExtendTest-1644951533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.380s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:07:18 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-f463d49e-0503-4140-8aec-18f7967ffaa9 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Create snapshot completed successfully Jun 24 05:07:18 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[21958494-c810-4f4b-b6cb-f2adf8afa150]: (4, 'raw') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:07:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6fc1d1c1-88c8-4b29-af5e-9f675ca68eb7 tempest-VolumesExtendTest-1644951533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-fca5f2ee-00f4-4bb9-ab85-f888506b7f86 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:18 devstack sudo[104677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-fca5f2ee-00f4-4bb9-ab85-f888506b7f86 Jun 24 05:07:18 devstack sudo[104677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:18 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-82a17206-fb5b-4e3b-88dc-e542b8d6c5f3 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Acquiring lock "cinder-998c1305-98d0-4581-9ee6-aae08a6a0dc0-delete_snapshot" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:07:18 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-82a17206-fb5b-4e3b-88dc-e542b8d6c5f3 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Lock "cinder-998c1305-98d0-4581-9ee6-aae08a6a0dc0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:07:18 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-82a17206-fb5b-4e3b-88dc-e542b8d6c5f3 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Acquiring lock "cinder-quobyte-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:07:18 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-82a17206-fb5b-4e3b-88dc-e542b8d6c5f3 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Lock "cinder-quobyte-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:07:18 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-82a17206-fb5b-4e3b-88dc-e542b8d6c5f3 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Acquiring lock "cinder-quobyte-998c1305-98d0-4581-9ee6-aae08a6a0dc0" by "_delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:07:18 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-82a17206-fb5b-4e3b-88dc-e542b8d6c5f3 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Lock "cinder-quobyte-998c1305-98d0-4581-9ee6-aae08a6a0dc0" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:07:18 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-82a17206-fb5b-4e3b-88dc-e542b8d6c5f3 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Deleting offline snapshot 998c1305-98d0-4581-9ee6-aae08a6a0dc0 of volume a1ca3540-d275-4fd2-9c5b-be71dd8be9f7 {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 05:07:18 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-82a17206-fb5b-4e3b-88dc-e542b8d6c5f3 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] snapshot_file for this snap is: volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7.998c1305-98d0-4581-9ee6-aae08a6a0dc0 {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 05:07:18 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d70a2c1-ad69-4a7f-a5db-df91979681dd]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:07:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-82a17206-fb5b-4e3b-88dc-e542b8d6c5f3 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7.998c1305-98d0-4581-9ee6-aae08a6a0dc0 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:19 devstack sudo[104679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7.998c1305-98d0-4581-9ee6-aae08a6a0dc0 Jun 24 05:07:19 devstack sudo[104679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:19 devstack sudo[104677]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6fc1d1c1-88c8-4b29-af5e-9f675ca68eb7 tempest-VolumesExtendTest-1644951533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-fca5f2ee-00f4-4bb9-ab85-f888506b7f86" returned: 0 in 0.894s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6fc1d1c1-88c8-4b29-af5e-9f675ca68eb7 tempest-VolumesExtendTest-1644951533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-fca5f2ee-00f4-4bb9-ab85-f888506b7f86 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:19 devstack sudo[104683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-fca5f2ee-00f4-4bb9-ab85-f888506b7f86 Jun 24 05:07:19 devstack sudo[104683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:19 devstack sudo[104679]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-82a17206-fb5b-4e3b-88dc-e542b8d6c5f3 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7.998c1305-98d0-4581-9ee6-aae08a6a0dc0" returned: 0 in 0.860s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:19 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-82a17206-fb5b-4e3b-88dc-e542b8d6c5f3 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:07:19 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7f36db-5450-45ec-aa48-1dc34dfa9176]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:07:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-82a17206-fb5b-4e3b-88dc-e542b8d6c5f3 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:19 devstack sudo[104688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7 Jun 24 05:07:19 devstack sudo[104688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:19 devstack sudo[104683]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6fc1d1c1-88c8-4b29-af5e-9f675ca68eb7 tempest-VolumesExtendTest-1644951533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-fca5f2ee-00f4-4bb9-ab85-f888506b7f86" returned: 1 in 0.816s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6fc1d1c1-88c8-4b29-af5e-9f675ca68eb7 tempest-VolumesExtendTest-1644951533 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-fca5f2ee-00f4-4bb9-ab85-f888506b7f86' failed. Not Retrying. {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 05:07:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6fc1d1c1-88c8-4b29-af5e-9f675ca68eb7 tempest-VolumesExtendTest-1644951533 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-fca5f2ee-00f4-4bb9-ab85-f888506b7f86 2G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6fc1d1c1-88c8-4b29-af5e-9f675ca68eb7 tempest-VolumesExtendTest-1644951533 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-fca5f2ee-00f4-4bb9-ab85-f888506b7f86 2G" returned: 0 in 0.078s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-6fc1d1c1-88c8-4b29-af5e-9f675ca68eb7 tempest-VolumesExtendTest-1644951533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.835s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:07:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-76c3ddc2-3500-4dd3-82f3-db0e6ce8da2f tempest-AttachVolumeNegativeTest-111486486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.770s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:07:20 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-76c3ddc2-3500-4dd3-82f3-db0e6ce8da2f tempest-AttachVolumeNegativeTest-111486486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-246380024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=098558f2-a68d-49f2-b1c9-182efab3f15b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d469e3abf0c849f59a9e06ca7b031d96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:07:17Z,use_quota=True,user_id='cea5c21618c24cd2aded0d3bbef0fd8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:07:20 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-76c3ddc2-3500-4dd3-82f3-db0e6ce8da2f tempest-AttachVolumeNegativeTest-111486486 None] Creating volume 098558f2-a68d-49f2-b1c9-182efab3f15b {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:07:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-76c3ddc2-3500-4dd3-82f3-db0e6ce8da2f tempest-AttachVolumeNegativeTest-111486486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:07:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-76c3ddc2-3500-4dd3-82f3-db0e6ce8da2f tempest-AttachVolumeNegativeTest-111486486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:07:20 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-76c3ddc2-3500-4dd3-82f3-db0e6ce8da2f tempest-AttachVolumeNegativeTest-111486486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:07:20 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-76c3ddc2-3500-4dd3-82f3-db0e6ce8da2f tempest-AttachVolumeNegativeTest-111486486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:07:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-76c3ddc2-3500-4dd3-82f3-db0e6ce8da2f tempest-AttachVolumeNegativeTest-111486486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:07:20 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-76c3ddc2-3500-4dd3-82f3-db0e6ce8da2f tempest-AttachVolumeNegativeTest-111486486 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:07:20 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-76c3ddc2-3500-4dd3-82f3-db0e6ce8da2f tempest-AttachVolumeNegativeTest-111486486 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:07:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-76c3ddc2-3500-4dd3-82f3-db0e6ce8da2f tempest-AttachVolumeNegativeTest-111486486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-098558f2-a68d-49f2-b1c9-182efab3f15b 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:20 devstack sudo[104697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-098558f2-a68d-49f2-b1c9-182efab3f15b 1073741824 Jun 24 05:07:20 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:20 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-6fc1d1c1-88c8-4b29-af5e-9f675ca68eb7 tempest-VolumesExtendTest-1644951533 None] Extend volume completed successfully. Jun 24 05:07:20 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f1f6b04-4b5c-47b5-9dd8-87dd40d16d56 tempest-VolumeDependencyTests-74658642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:07:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7f1f6b04-4b5c-47b5-9dd8-87dd40d16d56 tempest-VolumeDependencyTests-74658642 None] Flow 'volume_create_manager' (231e924b-811a-4405-9017-3a3025c97b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:07:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7f1f6b04-4b5c-47b5-9dd8-87dd40d16d56 tempest-VolumeDependencyTests-74658642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (282003e7-1749-40d5-a69d-d492e9cdd7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:07:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7f1f6b04-4b5c-47b5-9dd8-87dd40d16d56 tempest-VolumeDependencyTests-74658642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (282003e7-1749-40d5-a69d-d492e9cdd7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-620190122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a82fe4e3-966a-4f95-bedc-4681b6dd1d3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfba6ce4e8184d7990445356269e9ea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:07:20Z,use_quota=True,user_id='051631f590cd40088811fca8282f2fb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:07:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7f1f6b04-4b5c-47b5-9dd8-87dd40d16d56 tempest-VolumeDependencyTests-74658642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89414efe-256d-4dc4-89bd-edd2714192ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:07:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7f1f6b04-4b5c-47b5-9dd8-87dd40d16d56 tempest-VolumeDependencyTests-74658642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89414efe-256d-4dc4-89bd-edd2714192ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:07:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7f1f6b04-4b5c-47b5-9dd8-87dd40d16d56 tempest-VolumeDependencyTests-74658642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fd6ba2f-8ea6-4dc7-b157-ae984e60239b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:07:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7f1f6b04-4b5c-47b5-9dd8-87dd40d16d56 tempest-VolumeDependencyTests-74658642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fd6ba2f-8ea6-4dc7-b157-ae984e60239b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a82fe4e3-966a-4f95-bedc-4681b6dd1d3c', 'volume_name': 'volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:07:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7f1f6b04-4b5c-47b5-9dd8-87dd40d16d56 tempest-VolumeDependencyTests-74658642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7d2f263-fb7d-4b09-b528-f7360b7a7b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:07:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7f1f6b04-4b5c-47b5-9dd8-87dd40d16d56 tempest-VolumeDependencyTests-74658642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7d2f263-fb7d-4b09-b528-f7360b7a7b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:07:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7f1f6b04-4b5c-47b5-9dd8-87dd40d16d56 tempest-VolumeDependencyTests-74658642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3219d583-356f-42ff-878c-b45635379343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:07:20 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-7f1f6b04-4b5c-47b5-9dd8-87dd40d16d56 tempest-VolumeDependencyTests-74658642 None] Volume a82fe4e3-966a-4f95-bedc-4681b6dd1d3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c', 'volume_size': 1} Jun 24 05:07:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7f1f6b04-4b5c-47b5-9dd8-87dd40d16d56 tempest-VolumeDependencyTests-74658642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:07:20 devstack sudo[104688]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-82a17206-fb5b-4e3b-88dc-e542b8d6c5f3 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7" returned: 0 in 0.846s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-82a17206-fb5b-4e3b-88dc-e542b8d6c5f3 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7.998c1305-98d0-4581-9ee6-aae08a6a0dc0 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:20 devstack sudo[104702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7.998c1305-98d0-4581-9ee6-aae08a6a0dc0 Jun 24 05:07:20 devstack sudo[104702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:21 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-76c3ddc2-3500-4dd3-82f3-db0e6ce8da2f tempest-AttachVolumeNegativeTest-111486486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-098558f2-a68d-49f2-b1c9-182efab3f15b 1073741824" returned: 0 in 0.914s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-76c3ddc2-3500-4dd3-82f3-db0e6ce8da2f tempest-AttachVolumeNegativeTest-111486486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-098558f2-a68d-49f2-b1c9-182efab3f15b {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:21 devstack sudo[104707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-098558f2-a68d-49f2-b1c9-182efab3f15b Jun 24 05:07:21 devstack sudo[104707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:21 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-174c6c36-df7d-44dc-aa28-f460ff2d568d tempest-VolumesExtendTest-1644951533 None] Acquiring lock "cinder-fca5f2ee-00f4-4bb9-ab85-f888506b7f86-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:07:21 devstack sudo[104702]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-82a17206-fb5b-4e3b-88dc-e542b8d6c5f3 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7.998c1305-98d0-4581-9ee6-aae08a6a0dc0" returned: 0 in 0.809s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-82a17206-fb5b-4e3b-88dc-e542b8d6c5f3 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7.998c1305-98d0-4581-9ee6-aae08a6a0dc0 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:21 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-174c6c36-df7d-44dc-aa28-f460ff2d568d tempest-VolumesExtendTest-1644951533 None] Lock "cinder-fca5f2ee-00f4-4bb9-ab85-f888506b7f86-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:07:21 devstack sudo[104712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7.998c1305-98d0-4581-9ee6-aae08a6a0dc0 Jun 24 05:07:21 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:21 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-174c6c36-df7d-44dc-aa28-f460ff2d568d tempest-VolumesExtendTest-1644951533 None] Acquiring lock "cinder-quobyte-fca5f2ee-00f4-4bb9-ab85-f888506b7f86" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:07:21 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-174c6c36-df7d-44dc-aa28-f460ff2d568d tempest-VolumesExtendTest-1644951533 None] Lock "cinder-quobyte-fca5f2ee-00f4-4bb9-ab85-f888506b7f86" acquired by "delete_volume" :: waited 0.019s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:07:21 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fdf5e9-bd5c-4eb5-ab7d-4b14a3a7991f]: (4, 'raw') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:07:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-174c6c36-df7d-44dc-aa28-f460ff2d568d tempest-VolumesExtendTest-1644951533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-fca5f2ee-00f4-4bb9-ab85-f888506b7f86 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:21 devstack sudo[104714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-fca5f2ee-00f4-4bb9-ab85-f888506b7f86 Jun 24 05:07:21 devstack sudo[104714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:21 devstack sudo[104707]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-76c3ddc2-3500-4dd3-82f3-db0e6ce8da2f tempest-AttachVolumeNegativeTest-111486486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-098558f2-a68d-49f2-b1c9-182efab3f15b" returned: 0 in 0.676s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:21 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-76c3ddc2-3500-4dd3-82f3-db0e6ce8da2f tempest-AttachVolumeNegativeTest-111486486 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:07:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-76c3ddc2-3500-4dd3-82f3-db0e6ce8da2f tempest-AttachVolumeNegativeTest-111486486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:07:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7f1f6b04-4b5c-47b5-9dd8-87dd40d16d56 tempest-VolumeDependencyTests-74658642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.255s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:07:21 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7f1f6b04-4b5c-47b5-9dd8-87dd40d16d56 tempest-VolumeDependencyTests-74658642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-620190122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a82fe4e3-966a-4f95-bedc-4681b6dd1d3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfba6ce4e8184d7990445356269e9ea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:07:20Z,use_quota=True,user_id='051631f590cd40088811fca8282f2fb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:07:21 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-7f1f6b04-4b5c-47b5-9dd8-87dd40d16d56 tempest-VolumeDependencyTests-74658642 None] Creating volume a82fe4e3-966a-4f95-bedc-4681b6dd1d3c {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:07:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7f1f6b04-4b5c-47b5-9dd8-87dd40d16d56 tempest-VolumeDependencyTests-74658642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:07:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7f1f6b04-4b5c-47b5-9dd8-87dd40d16d56 tempest-VolumeDependencyTests-74658642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:07:21 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7f1f6b04-4b5c-47b5-9dd8-87dd40d16d56 tempest-VolumeDependencyTests-74658642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:07:21 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7f1f6b04-4b5c-47b5-9dd8-87dd40d16d56 tempest-VolumeDependencyTests-74658642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:07:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7f1f6b04-4b5c-47b5-9dd8-87dd40d16d56 tempest-VolumeDependencyTests-74658642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:07:21 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7f1f6b04-4b5c-47b5-9dd8-87dd40d16d56 tempest-VolumeDependencyTests-74658642 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:07:21 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-7f1f6b04-4b5c-47b5-9dd8-87dd40d16d56 tempest-VolumeDependencyTests-74658642 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:07:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7f1f6b04-4b5c-47b5-9dd8-87dd40d16d56 tempest-VolumeDependencyTests-74658642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:21 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-76c3ddc2-3500-4dd3-82f3-db0e6ce8da2f tempest-AttachVolumeNegativeTest-111486486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a26f219-cfd1-4651-924f-cd6d24d0d7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-098558f2-a68d-49f2-b1c9-182efab3f15b', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:07:21 devstack sudo[104717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c 1073741824 Jun 24 05:07:21 devstack sudo[104717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:21 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-76c3ddc2-3500-4dd3-82f3-db0e6ce8da2f tempest-AttachVolumeNegativeTest-111486486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b659f9f-4941-4721-ad30-e625abd81684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:07:21 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-76c3ddc2-3500-4dd3-82f3-db0e6ce8da2f tempest-AttachVolumeNegativeTest-111486486 None] Volume volume-098558f2-a68d-49f2-b1c9-182efab3f15b (098558f2-a68d-49f2-b1c9-182efab3f15b): created successfully Jun 24 05:07:21 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-76c3ddc2-3500-4dd3-82f3-db0e6ce8da2f tempest-AttachVolumeNegativeTest-111486486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b659f9f-4941-4721-ad30-e625abd81684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:07:21 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-76c3ddc2-3500-4dd3-82f3-db0e6ce8da2f tempest-AttachVolumeNegativeTest-111486486 None] Flow 'volume_create_manager' (4e32cf4f-d47f-4884-ad0e-2ac75b7d4ab9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:07:21 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-76c3ddc2-3500-4dd3-82f3-db0e6ce8da2f tempest-AttachVolumeNegativeTest-111486486 None] Created volume successfully. Jun 24 05:07:22 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-82a17206-fb5b-4e3b-88dc-e542b8d6c5f3 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7.998c1305-98d0-4581-9ee6-aae08a6a0dc0" returned: 0 in 0.696s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:22 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-82a17206-fb5b-4e3b-88dc-e542b8d6c5f3 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Lock "cinder-quobyte-998c1305-98d0-4581-9ee6-aae08a6a0dc0" released by "_delete_snapshot" :: held 3.341s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:07:22 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-82a17206-fb5b-4e3b-88dc-e542b8d6c5f3 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Lock "cinder-quobyte-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7" released by "delete_snapshot" :: held 3.371s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:07:22 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-82a17206-fb5b-4e3b-88dc-e542b8d6c5f3 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Created reservations ['bb2eba2a-4409-4041-bcad-98cfd14f090d', '926e6329-2c6d-45c8-bf2f-488f70ee90a1', 'de7afd9a-69e6-439b-8820-4ef2060e6e92', '8419a434-1939-4bec-bf7e-3aa07eaf51d2'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:07:22 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-82a17206-fb5b-4e3b-88dc-e542b8d6c5f3 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Delete snapshot completed successfully. Jun 24 05:07:22 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-82a17206-fb5b-4e3b-88dc-e542b8d6c5f3 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Lock "cinder-998c1305-98d0-4581-9ee6-aae08a6a0dc0-delete_snapshot" released by "delete_snapshot" :: held 3.525s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:07:22 devstack sudo[104714]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-174c6c36-df7d-44dc-aa28-f460ff2d568d tempest-VolumesExtendTest-1644951533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-fca5f2ee-00f4-4bb9-ab85-f888506b7f86" returned: 0 in 0.874s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-174c6c36-df7d-44dc-aa28-f460ff2d568d tempest-VolumesExtendTest-1644951533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-fca5f2ee-00f4-4bb9-ab85-f888506b7f86 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:22 devstack sudo[104725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-fca5f2ee-00f4-4bb9-ab85-f888506b7f86 Jun 24 05:07:22 devstack sudo[104725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:22 devstack sudo[104717]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7f1f6b04-4b5c-47b5-9dd8-87dd40d16d56 tempest-VolumeDependencyTests-74658642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c 1073741824" returned: 0 in 0.942s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7f1f6b04-4b5c-47b5-9dd8-87dd40d16d56 tempest-VolumeDependencyTests-74658642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:22 devstack sudo[104729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c Jun 24 05:07:22 devstack sudo[104729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:23 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-fe77f716-450e-4325-8a2a-02acb7f856c0 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Acquiring lock "cinder-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:07:23 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-fe77f716-450e-4325-8a2a-02acb7f856c0 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Lock "cinder-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:07:23 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-fe77f716-450e-4325-8a2a-02acb7f856c0 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Acquiring lock "cinder-quobyte-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:07:23 devstack sudo[104725]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:23 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-fe77f716-450e-4325-8a2a-02acb7f856c0 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Lock "cinder-quobyte-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7" acquired by "delete_volume" :: waited 0.021s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:07:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-174c6c36-df7d-44dc-aa28-f460ff2d568d tempest-VolumesExtendTest-1644951533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-fca5f2ee-00f4-4bb9-ab85-f888506b7f86" returned: 1 in 0.853s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-174c6c36-df7d-44dc-aa28-f460ff2d568d tempest-VolumesExtendTest-1644951533 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-fca5f2ee-00f4-4bb9-ab85-f888506b7f86' failed. Not Retrying. {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 05:07:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-174c6c36-df7d-44dc-aa28-f460ff2d568d tempest-VolumesExtendTest-1644951533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-fca5f2ee-00f4-4bb9-ab85-f888506b7f86 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:23 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1dcc4b0-aa79-4525-ae0f-fe295c4380ad]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:07:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fe77f716-450e-4325-8a2a-02acb7f856c0 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:23 devstack sudo[104737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-fca5f2ee-00f4-4bb9-ab85-f888506b7f86 Jun 24 05:07:23 devstack sudo[104737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:23 devstack sudo[104739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7 Jun 24 05:07:23 devstack sudo[104739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:23 devstack sudo[104729]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7f1f6b04-4b5c-47b5-9dd8-87dd40d16d56 tempest-VolumeDependencyTests-74658642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c" returned: 0 in 0.767s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:23 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7f1f6b04-4b5c-47b5-9dd8-87dd40d16d56 tempest-VolumeDependencyTests-74658642 None] <== create_volume: return (1760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:07:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7f1f6b04-4b5c-47b5-9dd8-87dd40d16d56 tempest-VolumeDependencyTests-74658642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.764s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:07:23 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7f1f6b04-4b5c-47b5-9dd8-87dd40d16d56 tempest-VolumeDependencyTests-74658642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3219d583-356f-42ff-878c-b45635379343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:07:23 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7f1f6b04-4b5c-47b5-9dd8-87dd40d16d56 tempest-VolumeDependencyTests-74658642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61fa2135-28a9-4718-9a53-bd29126135c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:07:23 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-7f1f6b04-4b5c-47b5-9dd8-87dd40d16d56 tempest-VolumeDependencyTests-74658642 None] Volume volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c (a82fe4e3-966a-4f95-bedc-4681b6dd1d3c): created successfully Jun 24 05:07:23 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7f1f6b04-4b5c-47b5-9dd8-87dd40d16d56 tempest-VolumeDependencyTests-74658642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61fa2135-28a9-4718-9a53-bd29126135c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:07:23 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7f1f6b04-4b5c-47b5-9dd8-87dd40d16d56 tempest-VolumeDependencyTests-74658642 None] Flow 'volume_create_manager' (231e924b-811a-4405-9017-3a3025c97b98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:07:23 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-7f1f6b04-4b5c-47b5-9dd8-87dd40d16d56 tempest-VolumeDependencyTests-74658642 None] Created volume successfully. Jun 24 05:07:23 devstack sudo[104737]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-174c6c36-df7d-44dc-aa28-f460ff2d568d tempest-VolumesExtendTest-1644951533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-fca5f2ee-00f4-4bb9-ab85-f888506b7f86" returned: 0 in 0.667s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:24 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-174c6c36-df7d-44dc-aa28-f460ff2d568d tempest-VolumesExtendTest-1644951533 None] Lock "cinder-quobyte-fca5f2ee-00f4-4bb9-ab85-f888506b7f86" released by "delete_volume" :: held 2.470s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:07:24 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-174c6c36-df7d-44dc-aa28-f460ff2d568d tempest-VolumesExtendTest-1644951533 None] Created reservations ['2583581b-a4db-48ce-8054-74bbc9afc709', '74455728-8187-452a-a9ef-b48812dc87e1', '09db167d-6420-4443-9469-b9a3806edb55', 'b8029036-879e-4337-9ae5-a89691811a0e'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:07:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-174c6c36-df7d-44dc-aa28-f460ff2d568d tempest-VolumesExtendTest-1644951533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:07:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-174c6c36-df7d-44dc-aa28-f460ff2d568d tempest-VolumesExtendTest-1644951533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:07:24 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-174c6c36-df7d-44dc-aa28-f460ff2d568d tempest-VolumesExtendTest-1644951533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:07:24 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-174c6c36-df7d-44dc-aa28-f460ff2d568d tempest-VolumesExtendTest-1644951533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:07:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-174c6c36-df7d-44dc-aa28-f460ff2d568d tempest-VolumesExtendTest-1644951533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:07:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-174c6c36-df7d-44dc-aa28-f460ff2d568d tempest-VolumesExtendTest-1644951533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:24 devstack sudo[104739]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:24 devstack sudo[104746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:07:24 devstack sudo[104746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fe77f716-450e-4325-8a2a-02acb7f856c0 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7" returned: 0 in 0.810s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fe77f716-450e-4325-8a2a-02acb7f856c0 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:24 devstack sudo[104748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7 Jun 24 05:07:24 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-93d1711b-bc42-4baa-9226-1d753420a5df tempest-VolumeDependencyTests-74658642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:07:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-93d1711b-bc42-4baa-9226-1d753420a5df tempest-VolumeDependencyTests-74658642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:07:24 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-93d1711b-bc42-4baa-9226-1d753420a5df tempest-VolumeDependencyTests-74658642 None] Creating offline snapshot 0d5815d7-09a0-4e9a-be76-577024a7dc53 of volume a82fe4e3-966a-4f95-bedc-4681b6dd1d3c {{(pid=93830) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 05:07:24 devstack sudo[104746]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-174c6c36-df7d-44dc-aa28-f460ff2d568d tempest-VolumesExtendTest-1644951533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.737s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:24 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-174c6c36-df7d-44dc-aa28-f460ff2d568d tempest-VolumesExtendTest-1644951533 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:07:24 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-174c6c36-df7d-44dc-aa28-f460ff2d568d tempest-VolumesExtendTest-1644951533 None] Deleted volume successfully. Jun 24 05:07:24 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83b185e-5c1b-4f2d-a879-419cc9180280]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:07:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-93d1711b-bc42-4baa-9226-1d753420a5df tempest-VolumeDependencyTests-74658642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:24 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-174c6c36-df7d-44dc-aa28-f460ff2d568d tempest-VolumesExtendTest-1644951533 None] Lock "cinder-fca5f2ee-00f4-4bb9-ab85-f888506b7f86-delete_volume" released by "delete_volume" :: held 3.437s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:07:24 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fe77f716-450e-4325-8a2a-02acb7f856c0 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7" returned: 0 in 0.769s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:24 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-fe77f716-450e-4325-8a2a-02acb7f856c0 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Lock "cinder-quobyte-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7" released by "delete_volume" :: held 1.666s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:07:25 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-fe77f716-450e-4325-8a2a-02acb7f856c0 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Created reservations ['02fb048b-5a84-4c02-bc7e-bd9a42c6a7a9', 'f448a4dc-e05b-4506-adee-30da47caff45', 'f21a0873-1db3-4d13-8b87-4b3c17d85842', '69d00f8e-83f9-4ae4-89fb-a8aa13b2563c'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:07:25 devstack sudo[104752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c Jun 24 05:07:25 devstack sudo[104752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fe77f716-450e-4325-8a2a-02acb7f856c0 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:07:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fe77f716-450e-4325-8a2a-02acb7f856c0 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:07:25 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-fe77f716-450e-4325-8a2a-02acb7f856c0 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:07:25 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-fe77f716-450e-4325-8a2a-02acb7f856c0 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:07:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fe77f716-450e-4325-8a2a-02acb7f856c0 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:07:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fe77f716-450e-4325-8a2a-02acb7f856c0 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:25 devstack sudo[104754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:07:25 devstack sudo[104754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:25 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-fae382bc-fc04-4cff-8f02-b0ed51eff9ea tempest-VolumesExtendTest-1644951533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:07:25 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fae382bc-fc04-4cff-8f02-b0ed51eff9ea tempest-VolumesExtendTest-1644951533 None] Flow 'volume_create_manager' (48568775-5591-48c8-ba30-858ec9b52c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:07:25 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fae382bc-fc04-4cff-8f02-b0ed51eff9ea tempest-VolumesExtendTest-1644951533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b964273c-a71d-449c-9cd4-7ae7d04bc840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:07:25 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fae382bc-fc04-4cff-8f02-b0ed51eff9ea tempest-VolumesExtendTest-1644951533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b964273c-a71d-449c-9cd4-7ae7d04bc840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:07:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-825498292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31243660-b6d8-4708-ba3f-1791b117f147,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a68e799adbe240b584fa379bdd27e0fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:07:25Z,use_quota=True,user_id='b32680ffb07844f480e3e45f47cd74d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:07:25 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fae382bc-fc04-4cff-8f02-b0ed51eff9ea tempest-VolumesExtendTest-1644951533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a9ce4ed-429b-41a3-b877-d08572ffb3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:07:25 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fae382bc-fc04-4cff-8f02-b0ed51eff9ea tempest-VolumesExtendTest-1644951533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a9ce4ed-429b-41a3-b877-d08572ffb3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:07:25 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fae382bc-fc04-4cff-8f02-b0ed51eff9ea tempest-VolumesExtendTest-1644951533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6edf59e9-5492-4989-bc96-3bb96b5ffafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:07:25 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fae382bc-fc04-4cff-8f02-b0ed51eff9ea tempest-VolumesExtendTest-1644951533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6edf59e9-5492-4989-bc96-3bb96b5ffafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31243660-b6d8-4708-ba3f-1791b117f147', 'volume_name': 'volume-31243660-b6d8-4708-ba3f-1791b117f147', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:07:25 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fae382bc-fc04-4cff-8f02-b0ed51eff9ea tempest-VolumesExtendTest-1644951533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2df6729-e01e-44d5-b411-b7bb5c949ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:07:25 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fae382bc-fc04-4cff-8f02-b0ed51eff9ea tempest-VolumesExtendTest-1644951533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2df6729-e01e-44d5-b411-b7bb5c949ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:07:25 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fae382bc-fc04-4cff-8f02-b0ed51eff9ea tempest-VolumesExtendTest-1644951533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f31977d-0a25-452f-af83-fc4213e00056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:07:25 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-fae382bc-fc04-4cff-8f02-b0ed51eff9ea tempest-VolumesExtendTest-1644951533 None] Volume 31243660-b6d8-4708-ba3f-1791b117f147: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31243660-b6d8-4708-ba3f-1791b117f147', 'volume_size': 1} Jun 24 05:07:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fae382bc-fc04-4cff-8f02-b0ed51eff9ea tempest-VolumesExtendTest-1644951533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:07:25 devstack sudo[104752]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-93d1711b-bc42-4baa-9226-1d753420a5df tempest-VolumeDependencyTests-74658642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c" returned: 0 in 1.012s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-93d1711b-bc42-4baa-9226-1d753420a5df tempest-VolumeDependencyTests-74658642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c.0d5815d7-09a0-4e9a-be76-577024a7dc53 1G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:25 devstack sudo[104770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c.0d5815d7-09a0-4e9a-be76-577024a7dc53 1G Jun 24 05:07:25 devstack sudo[104770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:25 devstack sudo[104754]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fe77f716-450e-4325-8a2a-02acb7f856c0 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.860s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:25 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-fe77f716-450e-4325-8a2a-02acb7f856c0 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:07:25 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-fe77f716-450e-4325-8a2a-02acb7f856c0 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Deleted volume successfully. Jun 24 05:07:26 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-fe77f716-450e-4325-8a2a-02acb7f856c0 tempest-VolumesSnapshotNegativeTestJSON-688097604 None] Lock "cinder-a1ca3540-d275-4fd2-9c5b-be71dd8be9f7-delete_volume" released by "delete_volume" :: held 2.790s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:07:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-0b555225-2ee3-434f-9b5e-a92e4c1ffef7 req-4c534c52-11f2-4456-85ad-1a41767bd51e tempest-AttachVolumeNegativeTest-111486486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:07:26 devstack sudo[104770]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-93d1711b-bc42-4baa-9226-1d753420a5df tempest-VolumeDependencyTests-74658642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c.0d5815d7-09a0-4e9a-be76-577024a7dc53 1G" returned: 0 in 0.936s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-93d1711b-bc42-4baa-9226-1d753420a5df tempest-VolumeDependencyTests-74658642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c.0d5815d7-09a0-4e9a-be76-577024a7dc53 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:26 devstack sudo[104777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c.0d5815d7-09a0-4e9a-be76-577024a7dc53 Jun 24 05:07:26 devstack sudo[104777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:27 devstack sudo[104777]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-93d1711b-bc42-4baa-9226-1d753420a5df tempest-VolumeDependencyTests-74658642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c.0d5815d7-09a0-4e9a-be76-577024a7dc53" returned: 0 in 0.766s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:27 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-93d1711b-bc42-4baa-9226-1d753420a5df tempest-VolumeDependencyTests-74658642 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c.0d5815d7-09a0-4e9a-be76-577024a7dc53 is being set with open permissions: ugo+rw Jun 24 05:07:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-93d1711b-bc42-4baa-9226-1d753420a5df tempest-VolumeDependencyTests-74658642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c.0d5815d7-09a0-4e9a-be76-577024a7dc53 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:27 devstack sudo[104786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c.0d5815d7-09a0-4e9a-be76-577024a7dc53 Jun 24 05:07:27 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:28 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-93d1711b-bc42-4baa-9226-1d753420a5df tempest-VolumeDependencyTests-74658642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c.0d5815d7-09a0-4e9a-be76-577024a7dc53" returned: 0 in 0.775s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-93d1711b-bc42-4baa-9226-1d753420a5df tempest-VolumeDependencyTests-74658642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:28 devstack sudo[104826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c.info Jun 24 05:07:28 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:29 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-93d1711b-bc42-4baa-9226-1d753420a5df tempest-VolumeDependencyTests-74658642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c.info" returned: 0 in 0.783s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:29 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-93d1711b-bc42-4baa-9226-1d753420a5df tempest-VolumeDependencyTests-74658642 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c.info is being set with open permissions: ugo+rw Jun 24 05:07:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-93d1711b-bc42-4baa-9226-1d753420a5df tempest-VolumeDependencyTests-74658642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:29 devstack sudo[104831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c.info Jun 24 05:07:29 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:29 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-93d1711b-bc42-4baa-9226-1d753420a5df tempest-VolumeDependencyTests-74658642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c.info" returned: 0 in 0.734s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-93d1711b-bc42-4baa-9226-1d753420a5df tempest-VolumeDependencyTests-74658642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.136s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:07:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fae382bc-fc04-4cff-8f02-b0ed51eff9ea tempest-VolumesExtendTest-1644951533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.394s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:07:29 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-fae382bc-fc04-4cff-8f02-b0ed51eff9ea tempest-VolumesExtendTest-1644951533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:07:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-825498292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31243660-b6d8-4708-ba3f-1791b117f147,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a68e799adbe240b584fa379bdd27e0fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:07:25Z,use_quota=True,user_id='b32680ffb07844f480e3e45f47cd74d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:07:29 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-fae382bc-fc04-4cff-8f02-b0ed51eff9ea tempest-VolumesExtendTest-1644951533 None] Creating volume 31243660-b6d8-4708-ba3f-1791b117f147 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:07:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fae382bc-fc04-4cff-8f02-b0ed51eff9ea tempest-VolumesExtendTest-1644951533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:07:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fae382bc-fc04-4cff-8f02-b0ed51eff9ea tempest-VolumesExtendTest-1644951533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:07:29 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-fae382bc-fc04-4cff-8f02-b0ed51eff9ea tempest-VolumesExtendTest-1644951533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:07:29 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-fae382bc-fc04-4cff-8f02-b0ed51eff9ea tempest-VolumesExtendTest-1644951533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:07:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fae382bc-fc04-4cff-8f02-b0ed51eff9ea tempest-VolumesExtendTest-1644951533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:07:29 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-fae382bc-fc04-4cff-8f02-b0ed51eff9ea tempest-VolumesExtendTest-1644951533 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:07:29 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-fae382bc-fc04-4cff-8f02-b0ed51eff9ea tempest-VolumesExtendTest-1644951533 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:07:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fae382bc-fc04-4cff-8f02-b0ed51eff9ea tempest-VolumesExtendTest-1644951533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:30 devstack sudo[104834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147 1073741824 Jun 24 05:07:30 devstack sudo[104834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:30 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-93d1711b-bc42-4baa-9226-1d753420a5df tempest-VolumeDependencyTests-74658642 None] Create snapshot completed successfully Jun 24 05:07:30 devstack sudo[104834]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fae382bc-fc04-4cff-8f02-b0ed51eff9ea tempest-VolumesExtendTest-1644951533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147 1073741824" returned: 0 in 0.905s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fae382bc-fc04-4cff-8f02-b0ed51eff9ea tempest-VolumesExtendTest-1644951533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:30 devstack sudo[104840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147 Jun 24 05:07:30 devstack sudo[104840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:31 devstack sudo[104840]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fae382bc-fc04-4cff-8f02-b0ed51eff9ea tempest-VolumesExtendTest-1644951533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147" returned: 0 in 0.724s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:31 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-fae382bc-fc04-4cff-8f02-b0ed51eff9ea tempest-VolumesExtendTest-1644951533 None] <== create_volume: return (1665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:07:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fae382bc-fc04-4cff-8f02-b0ed51eff9ea tempest-VolumesExtendTest-1644951533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.668s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:07:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-0b555225-2ee3-434f-9b5e-a92e4c1ffef7 req-4c534c52-11f2-4456-85ad-1a41767bd51e tempest-AttachVolumeNegativeTest-111486486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.593s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:07:31 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:07:31 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ed549b-a8c6-4d73-8a7d-7bea0bd6d4dd]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:07:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-0b555225-2ee3-434f-9b5e-a92e4c1ffef7 req-4c534c52-11f2-4456-85ad-1a41767bd51e tempest-AttachVolumeNegativeTest-111486486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-098558f2-a68d-49f2-b1c9-182efab3f15b {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:31 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fae382bc-fc04-4cff-8f02-b0ed51eff9ea tempest-VolumesExtendTest-1644951533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f31977d-0a25-452f-af83-fc4213e00056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31243660-b6d8-4708-ba3f-1791b117f147', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:07:31 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fae382bc-fc04-4cff-8f02-b0ed51eff9ea tempest-VolumesExtendTest-1644951533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ea5bfda-99a1-4d65-9234-370bf4cf24be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:07:31 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Flow 'volume_create_manager' (350954fe-62bd-4b45-85e3-b62c639db260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:07:31 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36d722d7-0c18-44bf-aa88-e68eabe9ed41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:07:31 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-fae382bc-fc04-4cff-8f02-b0ed51eff9ea tempest-VolumesExtendTest-1644951533 None] Volume volume-31243660-b6d8-4708-ba3f-1791b117f147 (31243660-b6d8-4708-ba3f-1791b117f147): created successfully Jun 24 05:07:31 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fae382bc-fc04-4cff-8f02-b0ed51eff9ea tempest-VolumesExtendTest-1644951533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ea5bfda-99a1-4d65-9234-370bf4cf24be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:07:31 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fae382bc-fc04-4cff-8f02-b0ed51eff9ea tempest-VolumesExtendTest-1644951533 None] Flow 'volume_create_manager' (48568775-5591-48c8-ba30-858ec9b52c66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:07:31 devstack sudo[104843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-098558f2-a68d-49f2-b1c9-182efab3f15b Jun 24 05:07:31 devstack sudo[104843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:31 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36d722d7-0c18-44bf-aa88-e68eabe9ed41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-300377969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea24770c-b326-4217-bd6e-c2fd13fc35d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfba6ce4e8184d7990445356269e9ea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0d5815d7-09a0-4e9a-be76-577024a7dc53,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:07:32Z,use_quota=True,user_id='051631f590cd40088811fca8282f2fb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:07:31 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc0c8f9f-08d6-44cc-a5f5-e4659a1953e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:07:31 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc0c8f9f-08d6-44cc-a5f5-e4659a1953e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:07:31 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20e37453-c216-47b2-8818-6dcb5bd72110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:07:31 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20e37453-c216-47b2-8818-6dcb5bd72110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ea24770c-b326-4217-bd6e-c2fd13fc35d8', 'volume_name': 'volume-ea24770c-b326-4217-bd6e-c2fd13fc35d8', 'volume_size': 1, 'snapshot_id': '0d5815d7-09a0-4e9a-be76-577024a7dc53'}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:07:31 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8695648e-1520-4247-8ca9-8e603be35ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:07:31 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8695648e-1520-4247-8ca9-8e603be35ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:07:31 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2439686-4232-45a5-955f-97502a518616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:07:31 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Volume ea24770c-b326-4217-bd6e-c2fd13fc35d8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ea24770c-b326-4217-bd6e-c2fd13fc35d8', 'volume_size': 1, 'snapshot_id': '0d5815d7-09a0-4e9a-be76-577024a7dc53'} Jun 24 05:07:31 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-fae382bc-fc04-4cff-8f02-b0ed51eff9ea tempest-VolumesExtendTest-1644951533 None] Created volume successfully. Jun 24 05:07:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:07:32 devstack sudo[104843]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-0b555225-2ee3-434f-9b5e-a92e4c1ffef7 req-4c534c52-11f2-4456-85ad-1a41767bd51e tempest-AttachVolumeNegativeTest-111486486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-098558f2-a68d-49f2-b1c9-182efab3f15b" returned: 0 in 0.836s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-0b555225-2ee3-434f-9b5e-a92e4c1ffef7 req-4c534c52-11f2-4456-85ad-1a41767bd51e tempest-AttachVolumeNegativeTest-111486486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.883s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:07:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.651s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:07:32 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Acquiring lock "cinder-quobyte-0d5815d7-09a0-4e9a-be76-577024a7dc53-ea24770c-b326-4217-bd6e-c2fd13fc35d8" by "_create_volume_from_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:07:32 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Lock "cinder-quobyte-0d5815d7-09a0-4e9a-be76-577024a7dc53-ea24770c-b326-4217-bd6e-c2fd13fc35d8" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:07:32 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Creating volume ea24770c-b326-4217-bd6e-c2fd13fc35d8 from snapshot 0d5815d7-09a0-4e9a-be76-577024a7dc53 {{(pid=93830) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 24 05:07:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:07:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:07:32 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:07:32 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:07:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:07:32 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:07:32 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Acquiring lock "cinder-quobyte-ea24770c-b326-4217-bd6e-c2fd13fc35d8" by "_copy_volume_from_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:07:32 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-0b555225-2ee3-434f-9b5e-a92e4c1ffef7 req-4c534c52-11f2-4456-85ad-1a41767bd51e tempest-AttachVolumeNegativeTest-111486486 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05', 'name': 'volume-098558f2-a68d-49f2-b1c9-182efab3f15b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '148308b9-f9ea-42a5-8009-9b3a07556610', 'enforce_multipath': True} {{(pid=93830) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 05:07:32 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Lock "cinder-quobyte-ea24770c-b326-4217-bd6e-c2fd13fc35d8" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:07:32 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] snapshot: 0d5815d7-09a0-4e9a-be76-577024a7dc53, volume: ea24770c-b326-4217-bd6e-c2fd13fc35d8, {{(pid=93830) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 05:07:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:07:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:07:32 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:07:32 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:07:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:07:32 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7f0b32-7006-4095-97f9-3c52696f9962]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:07:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c.0d5815d7-09a0-4e9a-be76-577024a7dc53 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:32 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-0b555225-2ee3-434f-9b5e-a92e4c1ffef7 req-4c534c52-11f2-4456-85ad-1a41767bd51e tempest-AttachVolumeNegativeTest-111486486 None] attachment_update completed successfully. Jun 24 05:07:32 devstack sudo[104848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c.0d5815d7-09a0-4e9a-be76-577024a7dc53 Jun 24 05:07:32 devstack sudo[104848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7ed37e6d-46f3-4a5e-a652-18becb18bed0 tempest-VolumesExtendTest-1644951533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:07:33 devstack sudo[104848]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c.0d5815d7-09a0-4e9a-be76-577024a7dc53" returned: 0 in 1.114s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:33 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:07:33 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c {{(pid=93830) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 05:07:33 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Creating direct copy from snapshot {{(pid=93830) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 05:07:33 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d396505-d247-430d-873f-97f4a90f1b4f]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:07:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:33 devstack sudo[104921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c Jun 24 05:07:33 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:34 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c" returned: 0 in 0.913s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:34 devstack cinder-volume[93830]: DEBUG cinder.utils [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Path /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ea24770c-b326-4217-bd6e-c2fd13fc35d8 not found in is_blk_device check {{(pid=93830) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 05:07:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ea24770c-b326-4217-bd6e-c2fd13fc35d8 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:34 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ea24770c-b326-4217-bd6e-c2fd13fc35d8 Jun 24 05:07:34 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:40 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ea24770c-b326-4217-bd6e-c2fd13fc35d8" returned: 0 in 6.066s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:40 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[d844280c-0086-44ad-9cbb-a4e53c421b26]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:07:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:40 devstack sudo[105259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c Jun 24 05:07:40 devstack sudo[105259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:41 devstack sudo[105259]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c" returned: 0 in 1.158s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:41 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Image conversion details: src /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c, size 1024.00 MB, duration 6.07 sec, destination /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ea24770c-b326-4217-bd6e-c2fd13fc35d8 {{(pid=93830) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 05:07:41 devstack cinder-volume[93830]: INFO cinder.image.image_utils [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Converted 1024.00 MB image at 168.75 MB/s Jun 24 05:07:41 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ea24770c-b326-4217-bd6e-c2fd13fc35d8 is being set with open permissions: ugo+rw Jun 24 05:07:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ea24770c-b326-4217-bd6e-c2fd13fc35d8 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:42 devstack sudo[105268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ea24770c-b326-4217-bd6e-c2fd13fc35d8 Jun 24 05:07:42 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:42 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-a74ae9e2-aac7-4962-8925-8967cc6ca6c5 req-24f88bd3-4faf-4a53-8876-8a960f065a96 tempest-AttachVolumeNegativeTest-111486486 None] Terminate volume connection completed successfully. Jun 24 05:07:42 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-a74ae9e2-aac7-4962-8925-8967cc6ca6c5 req-24f88bd3-4faf-4a53-8876-8a960f065a96 tempest-AttachVolumeNegativeTest-111486486 None] Deleting attachment 148308b9-f9ea-42a5-8009-9b3a07556610. {{(pid=93830) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 05:07:42 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ea24770c-b326-4217-bd6e-c2fd13fc35d8" returned: 0 in 0.687s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:42 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Lock "cinder-quobyte-ea24770c-b326-4217-bd6e-c2fd13fc35d8" released by "_copy_volume_from_snapshot" :: held 10.074s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:07:42 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Lock "cinder-quobyte-0d5815d7-09a0-4e9a-be76-577024a7dc53-ea24770c-b326-4217-bd6e-c2fd13fc35d8" released by "_create_volume_from_snapshot" :: held 10.133s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:07:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.162s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:07:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7ed37e6d-46f3-4a5e-a652-18becb18bed0 tempest-VolumesExtendTest-1644951533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.554s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:07:42 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-7ed37e6d-46f3-4a5e-a652-18becb18bed0 tempest-VolumesExtendTest-1644951533 None] Creating offline snapshot cc274f7a-31a5-4f7d-a3a1-ab6c575924b8 of volume 31243660-b6d8-4708-ba3f-1791b117f147 {{(pid=93830) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 05:07:42 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2439686-4232-45a5-955f-97502a518616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea24770c-b326-4217-bd6e-c2fd13fc35d8', 'volume_size': 1, 'snapshot_id': '0d5815d7-09a0-4e9a-be76-577024a7dc53'}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:07:42 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ba856b7-431d-446e-a3dc-6a181120e85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:07:42 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f70783-ae24-4a9f-b747-100be35ffd68]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:07:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7ed37e6d-46f3-4a5e-a652-18becb18bed0 tempest-VolumesExtendTest-1644951533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:42 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Volume volume-ea24770c-b326-4217-bd6e-c2fd13fc35d8 (ea24770c-b326-4217-bd6e-c2fd13fc35d8): created successfully Jun 24 05:07:42 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ba856b7-431d-446e-a3dc-6a181120e85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:07:42 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Flow 'volume_create_manager' (350954fe-62bd-4b45-85e3-b62c639db260) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:07:42 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-66ac1d92-adcb-466b-a333-b040e370db72 tempest-VolumeDependencyTests-74658642 None] Created volume successfully. Jun 24 05:07:42 devstack sudo[105298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147 Jun 24 05:07:42 devstack sudo[105298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:43 devstack sudo[105298]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7ed37e6d-46f3-4a5e-a652-18becb18bed0 tempest-VolumesExtendTest-1644951533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147" returned: 0 in 0.912s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7ed37e6d-46f3-4a5e-a652-18becb18bed0 tempest-VolumesExtendTest-1644951533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147.cc274f7a-31a5-4f7d-a3a1-ab6c575924b8 1G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:43 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147.cc274f7a-31a5-4f7d-a3a1-ab6c575924b8 1G Jun 24 05:07:43 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:43 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-bc30bef5-c4d5-4c80-9975-05ee4d2eb7b5 tempest-VolumeDependencyTests-74658642 None] Acquiring lock "cinder-0d5815d7-09a0-4e9a-be76-577024a7dc53-delete_snapshot" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:07:44 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-bc30bef5-c4d5-4c80-9975-05ee4d2eb7b5 tempest-VolumeDependencyTests-74658642 None] Lock "cinder-0d5815d7-09a0-4e9a-be76-577024a7dc53-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:07:44 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-bc30bef5-c4d5-4c80-9975-05ee4d2eb7b5 tempest-VolumeDependencyTests-74658642 None] Acquiring lock "cinder-quobyte-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:07:44 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-bc30bef5-c4d5-4c80-9975-05ee4d2eb7b5 tempest-VolumeDependencyTests-74658642 None] Lock "cinder-quobyte-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:07:44 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-bc30bef5-c4d5-4c80-9975-05ee4d2eb7b5 tempest-VolumeDependencyTests-74658642 None] Acquiring lock "cinder-quobyte-0d5815d7-09a0-4e9a-be76-577024a7dc53" by "_delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:07:44 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-bc30bef5-c4d5-4c80-9975-05ee4d2eb7b5 tempest-VolumeDependencyTests-74658642 None] Lock "cinder-quobyte-0d5815d7-09a0-4e9a-be76-577024a7dc53" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:07:44 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-bc30bef5-c4d5-4c80-9975-05ee4d2eb7b5 tempest-VolumeDependencyTests-74658642 None] Deleting offline snapshot 0d5815d7-09a0-4e9a-be76-577024a7dc53 of volume a82fe4e3-966a-4f95-bedc-4681b6dd1d3c {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 05:07:44 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-bc30bef5-c4d5-4c80-9975-05ee4d2eb7b5 tempest-VolumeDependencyTests-74658642 None] snapshot_file for this snap is: volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c.0d5815d7-09a0-4e9a-be76-577024a7dc53 {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 05:07:44 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b01cbd8-c789-4325-a95e-3425bc1c2112]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:07:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-bc30bef5-c4d5-4c80-9975-05ee4d2eb7b5 tempest-VolumeDependencyTests-74658642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c.0d5815d7-09a0-4e9a-be76-577024a7dc53 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:44 devstack sudo[105305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c.0d5815d7-09a0-4e9a-be76-577024a7dc53 Jun 24 05:07:44 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:44 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7ed37e6d-46f3-4a5e-a652-18becb18bed0 tempest-VolumesExtendTest-1644951533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147.cc274f7a-31a5-4f7d-a3a1-ab6c575924b8 1G" returned: 0 in 1.049s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7ed37e6d-46f3-4a5e-a652-18becb18bed0 tempest-VolumesExtendTest-1644951533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31243660-b6d8-4708-ba3f-1791b117f147 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147.cc274f7a-31a5-4f7d-a3a1-ab6c575924b8 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:44 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31243660-b6d8-4708-ba3f-1791b117f147 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147.cc274f7a-31a5-4f7d-a3a1-ab6c575924b8 Jun 24 05:07:44 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:44 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-bc30bef5-c4d5-4c80-9975-05ee4d2eb7b5 tempest-VolumeDependencyTests-74658642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c.0d5815d7-09a0-4e9a-be76-577024a7dc53" returned: 0 in 0.893s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:44 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-bc30bef5-c4d5-4c80-9975-05ee4d2eb7b5 tempest-VolumeDependencyTests-74658642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:07:45 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e324dfc-58d1-4962-8320-bb6d14b9214d]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:07:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-bc30bef5-c4d5-4c80-9975-05ee4d2eb7b5 tempest-VolumeDependencyTests-74658642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:45 devstack sudo[105317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c Jun 24 05:07:45 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:45 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7ed37e6d-46f3-4a5e-a652-18becb18bed0 tempest-VolumesExtendTest-1644951533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31243660-b6d8-4708-ba3f-1791b117f147 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147.cc274f7a-31a5-4f7d-a3a1-ab6c575924b8" returned: 0 in 1.020s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:45 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-7ed37e6d-46f3-4a5e-a652-18becb18bed0 tempest-VolumesExtendTest-1644951533 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147.cc274f7a-31a5-4f7d-a3a1-ab6c575924b8 is being set with open permissions: ugo+rw Jun 24 05:07:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7ed37e6d-46f3-4a5e-a652-18becb18bed0 tempest-VolumesExtendTest-1644951533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147.cc274f7a-31a5-4f7d-a3a1-ab6c575924b8 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:45 devstack sudo[105364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147.cc274f7a-31a5-4f7d-a3a1-ab6c575924b8 Jun 24 05:07:45 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:46 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-bc30bef5-c4d5-4c80-9975-05ee4d2eb7b5 tempest-VolumeDependencyTests-74658642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c" returned: 0 in 1.345s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-bc30bef5-c4d5-4c80-9975-05ee4d2eb7b5 tempest-VolumeDependencyTests-74658642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c.0d5815d7-09a0-4e9a-be76-577024a7dc53 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:46 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c.0d5815d7-09a0-4e9a-be76-577024a7dc53 Jun 24 05:07:46 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:46 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7ed37e6d-46f3-4a5e-a652-18becb18bed0 tempest-VolumesExtendTest-1644951533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147.cc274f7a-31a5-4f7d-a3a1-ab6c575924b8" returned: 0 in 1.053s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:46 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:SELECT=135,cinder:UPDATE=166,cinder:DELETE=13,cinder:INSERT=45 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:07:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7ed37e6d-46f3-4a5e-a652-18becb18bed0 tempest-VolumesExtendTest-1644951533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:46 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147.info Jun 24 05:07:46 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-bc30bef5-c4d5-4c80-9975-05ee4d2eb7b5 tempest-VolumeDependencyTests-74658642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c.0d5815d7-09a0-4e9a-be76-577024a7dc53" returned: 0 in 0.981s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:47 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-bc30bef5-c4d5-4c80-9975-05ee4d2eb7b5 tempest-VolumeDependencyTests-74658642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c.0d5815d7-09a0-4e9a-be76-577024a7dc53 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:47 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c.0d5815d7-09a0-4e9a-be76-577024a7dc53 Jun 24 05:07:47 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:47 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7ed37e6d-46f3-4a5e-a652-18becb18bed0 tempest-VolumesExtendTest-1644951533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147.info" returned: 0 in 1.012s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:47 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-7ed37e6d-46f3-4a5e-a652-18becb18bed0 tempest-VolumesExtendTest-1644951533 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147.info is being set with open permissions: ugo+rw Jun 24 05:07:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7ed37e6d-46f3-4a5e-a652-18becb18bed0 tempest-VolumesExtendTest-1644951533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:47 devstack sudo[105385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147.info Jun 24 05:07:47 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:48 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-bc30bef5-c4d5-4c80-9975-05ee4d2eb7b5 tempest-VolumeDependencyTests-74658642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c.0d5815d7-09a0-4e9a-be76-577024a7dc53" returned: 0 in 0.885s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:48 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-bc30bef5-c4d5-4c80-9975-05ee4d2eb7b5 tempest-VolumeDependencyTests-74658642 None] Lock "cinder-quobyte-0d5815d7-09a0-4e9a-be76-577024a7dc53" released by "_delete_snapshot" :: held 4.259s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:07:48 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-bc30bef5-c4d5-4c80-9975-05ee4d2eb7b5 tempest-VolumeDependencyTests-74658642 None] Lock "cinder-quobyte-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c" released by "delete_snapshot" :: held 4.312s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:07:48 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-bc30bef5-c4d5-4c80-9975-05ee4d2eb7b5 tempest-VolumeDependencyTests-74658642 None] Created reservations ['29e41c9d-7b5f-4b87-aecf-195659c3d400', '2fd96583-79af-4d7d-a860-d0062b9cd81d', '2f4d3a4e-c69e-43a5-a156-aa2c48692e94', 'b1dd5396-a6ee-4ef0-9ed9-e1c20682c461'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:07:48 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-bc30bef5-c4d5-4c80-9975-05ee4d2eb7b5 tempest-VolumeDependencyTests-74658642 None] Delete snapshot completed successfully. Jun 24 05:07:48 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-bc30bef5-c4d5-4c80-9975-05ee4d2eb7b5 tempest-VolumeDependencyTests-74658642 None] Lock "cinder-0d5815d7-09a0-4e9a-be76-577024a7dc53-delete_snapshot" released by "delete_snapshot" :: held 4.628s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:07:48 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7ed37e6d-46f3-4a5e-a652-18becb18bed0 tempest-VolumesExtendTest-1644951533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147.info" returned: 0 in 0.828s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7ed37e6d-46f3-4a5e-a652-18becb18bed0 tempest-VolumesExtendTest-1644951533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.037s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:07:48 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-7ed37e6d-46f3-4a5e-a652-18becb18bed0 tempest-VolumesExtendTest-1644951533 None] Create snapshot completed successfully Jun 24 05:07:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7bc9fcf2-3dc9-491d-9e01-d6df5810b530 tempest-VolumesExtendTest-1644951533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:07:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7bc9fcf2-3dc9-491d-9e01-d6df5810b530 tempest-VolumesExtendTest-1644951533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:07:49 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa4f33e-fd45-47c2-92b3-3f79856e8741]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:07:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7bc9fcf2-3dc9-491d-9e01-d6df5810b530 tempest-VolumesExtendTest-1644951533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:49 devstack sudo[105390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147 Jun 24 05:07:49 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:49 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-c43d4572-29bd-43a2-b563-9918f184b268 tempest-VolumeDependencyTests-74658642 None] Acquiring lock "cinder-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:07:49 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-c43d4572-29bd-43a2-b563-9918f184b268 tempest-VolumeDependencyTests-74658642 None] Lock "cinder-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:07:49 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-c43d4572-29bd-43a2-b563-9918f184b268 tempest-VolumeDependencyTests-74658642 None] Acquiring lock "cinder-quobyte-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:07:49 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-c43d4572-29bd-43a2-b563-9918f184b268 tempest-VolumeDependencyTests-74658642 None] Lock "cinder-quobyte-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c" acquired by "delete_volume" :: waited 0.030s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:07:49 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9db7903-e470-4715-9d4c-3f393f524db6]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:07:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c43d4572-29bd-43a2-b563-9918f184b268 tempest-VolumeDependencyTests-74658642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:49 devstack sudo[105392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c Jun 24 05:07:49 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:50 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7bc9fcf2-3dc9-491d-9e01-d6df5810b530 tempest-VolumesExtendTest-1644951533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147" returned: 0 in 0.938s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7bc9fcf2-3dc9-491d-9e01-d6df5810b530 tempest-VolumesExtendTest-1644951533 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147.cc274f7a-31a5-4f7d-a3a1-ab6c575924b8 2G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7bc9fcf2-3dc9-491d-9e01-d6df5810b530 tempest-VolumesExtendTest-1644951533 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147.cc274f7a-31a5-4f7d-a3a1-ab6c575924b8 2G" returned: 0 in 0.192s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7bc9fcf2-3dc9-491d-9e01-d6df5810b530 tempest-VolumesExtendTest-1644951533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.182s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:07:50 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c43d4572-29bd-43a2-b563-9918f184b268 tempest-VolumeDependencyTests-74658642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c" returned: 0 in 0.903s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c43d4572-29bd-43a2-b563-9918f184b268 tempest-VolumeDependencyTests-74658642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:50 devstack sudo[105406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c Jun 24 05:07:50 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:50 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-7bc9fcf2-3dc9-491d-9e01-d6df5810b530 tempest-VolumesExtendTest-1644951533 None] Extend volume completed successfully. Jun 24 05:07:51 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c43d4572-29bd-43a2-b563-9918f184b268 tempest-VolumeDependencyTests-74658642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c" returned: 0 in 0.654s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:51 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-c43d4572-29bd-43a2-b563-9918f184b268 tempest-VolumeDependencyTests-74658642 None] Lock "cinder-quobyte-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c" released by "delete_volume" :: held 1.636s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:07:51 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-c43d4572-29bd-43a2-b563-9918f184b268 tempest-VolumeDependencyTests-74658642 None] Created reservations ['707d2084-7588-45ef-9740-fafaea0bdf72', 'cc2e8934-2716-4ba4-b0cf-7d8b849f0708', '4782608a-4876-4210-a37d-bf43347f26ad', 'e2b10989-31d2-447c-ba52-33d34314bb3e'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:07:51 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-09590776-a175-498d-9c01-057ab6b263e5 tempest-VolumesExtendTest-1644951533 None] Acquiring lock "cinder-cc274f7a-31a5-4f7d-a3a1-ab6c575924b8-delete_snapshot" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:07:51 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-09590776-a175-498d-9c01-057ab6b263e5 tempest-VolumesExtendTest-1644951533 None] Lock "cinder-cc274f7a-31a5-4f7d-a3a1-ab6c575924b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:07:51 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-09590776-a175-498d-9c01-057ab6b263e5 tempest-VolumesExtendTest-1644951533 None] Acquiring lock "cinder-quobyte-31243660-b6d8-4708-ba3f-1791b117f147" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:07:51 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-09590776-a175-498d-9c01-057ab6b263e5 tempest-VolumesExtendTest-1644951533 None] Lock "cinder-quobyte-31243660-b6d8-4708-ba3f-1791b117f147" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:07:51 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-09590776-a175-498d-9c01-057ab6b263e5 tempest-VolumesExtendTest-1644951533 None] Acquiring lock "cinder-quobyte-cc274f7a-31a5-4f7d-a3a1-ab6c575924b8" by "_delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:07:51 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-09590776-a175-498d-9c01-057ab6b263e5 tempest-VolumesExtendTest-1644951533 None] Lock "cinder-quobyte-cc274f7a-31a5-4f7d-a3a1-ab6c575924b8" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:07:51 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-09590776-a175-498d-9c01-057ab6b263e5 tempest-VolumesExtendTest-1644951533 None] Deleting offline snapshot cc274f7a-31a5-4f7d-a3a1-ab6c575924b8 of volume 31243660-b6d8-4708-ba3f-1791b117f147 {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 05:07:51 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-09590776-a175-498d-9c01-057ab6b263e5 tempest-VolumesExtendTest-1644951533 None] snapshot_file for this snap is: volume-31243660-b6d8-4708-ba3f-1791b117f147.cc274f7a-31a5-4f7d-a3a1-ab6c575924b8 {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 05:07:51 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea780d8-fd8a-4273-a991-d51babc63179]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:07:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-09590776-a175-498d-9c01-057ab6b263e5 tempest-VolumesExtendTest-1644951533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147.cc274f7a-31a5-4f7d-a3a1-ab6c575924b8 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:52 devstack sudo[105409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147.cc274f7a-31a5-4f7d-a3a1-ab6c575924b8 Jun 24 05:07:52 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-c43d4572-29bd-43a2-b563-9918f184b268 tempest-VolumeDependencyTests-74658642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:07:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-c43d4572-29bd-43a2-b563-9918f184b268 tempest-VolumeDependencyTests-74658642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:07:52 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-c43d4572-29bd-43a2-b563-9918f184b268 tempest-VolumeDependencyTests-74658642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:07:52 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-c43d4572-29bd-43a2-b563-9918f184b268 tempest-VolumeDependencyTests-74658642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:07:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-c43d4572-29bd-43a2-b563-9918f184b268 tempest-VolumeDependencyTests-74658642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:07:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c43d4572-29bd-43a2-b563-9918f184b268 tempest-VolumeDependencyTests-74658642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:52 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:07:52 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:52 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-09590776-a175-498d-9c01-057ab6b263e5 tempest-VolumesExtendTest-1644951533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147.cc274f7a-31a5-4f7d-a3a1-ab6c575924b8" returned: 0 in 0.848s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:52 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-09590776-a175-498d-9c01-057ab6b263e5 tempest-VolumesExtendTest-1644951533 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31243660-b6d8-4708-ba3f-1791b117f147(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:07:52 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b4d1eb-e727-42d8-ad12-54d23d30f22e]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:07:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-09590776-a175-498d-9c01-057ab6b263e5 tempest-VolumesExtendTest-1644951533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:52 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147 Jun 24 05:07:52 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:53 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c43d4572-29bd-43a2-b563-9918f184b268 tempest-VolumeDependencyTests-74658642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.741s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:53 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-c43d4572-29bd-43a2-b563-9918f184b268 tempest-VolumeDependencyTests-74658642 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:07:53 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-c43d4572-29bd-43a2-b563-9918f184b268 tempest-VolumeDependencyTests-74658642 None] Deleted volume successfully. Jun 24 05:07:53 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-c43d4572-29bd-43a2-b563-9918f184b268 tempest-VolumeDependencyTests-74658642 None] Lock "cinder-a82fe4e3-966a-4f95-bedc-4681b6dd1d3c-delete_volume" released by "delete_volume" :: held 3.859s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:07:53 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-ceb2be96-8ade-40b5-a044-fd2ad1474ce7 tempest-VolumeDependencyTests-74658642 None] Acquiring lock "cinder-ea24770c-b326-4217-bd6e-c2fd13fc35d8-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:07:53 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-ceb2be96-8ade-40b5-a044-fd2ad1474ce7 tempest-VolumeDependencyTests-74658642 None] Lock "cinder-ea24770c-b326-4217-bd6e-c2fd13fc35d8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:07:53 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-ceb2be96-8ade-40b5-a044-fd2ad1474ce7 tempest-VolumeDependencyTests-74658642 None] Acquiring lock "cinder-quobyte-ea24770c-b326-4217-bd6e-c2fd13fc35d8" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:07:53 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-ceb2be96-8ade-40b5-a044-fd2ad1474ce7 tempest-VolumeDependencyTests-74658642 None] Lock "cinder-quobyte-ea24770c-b326-4217-bd6e-c2fd13fc35d8" acquired by "delete_volume" :: waited 0.015s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:07:53 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a1e6d0-4509-4040-a2a8-b0c2d00544e1]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:07:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ceb2be96-8ade-40b5-a044-fd2ad1474ce7 tempest-VolumeDependencyTests-74658642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ea24770c-b326-4217-bd6e-c2fd13fc35d8 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:53 devstack sudo[105419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ea24770c-b326-4217-bd6e-c2fd13fc35d8 Jun 24 05:07:53 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:53 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-09590776-a175-498d-9c01-057ab6b263e5 tempest-VolumesExtendTest-1644951533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147" returned: 0 in 0.977s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-09590776-a175-498d-9c01-057ab6b263e5 tempest-VolumesExtendTest-1644951533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147.cc274f7a-31a5-4f7d-a3a1-ab6c575924b8 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:53 devstack sudo[105426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147.cc274f7a-31a5-4f7d-a3a1-ab6c575924b8 Jun 24 05:07:53 devstack sudo[105426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:54 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ceb2be96-8ade-40b5-a044-fd2ad1474ce7 tempest-VolumeDependencyTests-74658642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ea24770c-b326-4217-bd6e-c2fd13fc35d8" returned: 0 in 0.985s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ceb2be96-8ade-40b5-a044-fd2ad1474ce7 tempest-VolumeDependencyTests-74658642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ea24770c-b326-4217-bd6e-c2fd13fc35d8 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:54 devstack sudo[105431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ea24770c-b326-4217-bd6e-c2fd13fc35d8 Jun 24 05:07:54 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:54 devstack sudo[105426]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-09590776-a175-498d-9c01-057ab6b263e5 tempest-VolumesExtendTest-1644951533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147.cc274f7a-31a5-4f7d-a3a1-ab6c575924b8" returned: 0 in 0.994s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-09590776-a175-498d-9c01-057ab6b263e5 tempest-VolumesExtendTest-1644951533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147.cc274f7a-31a5-4f7d-a3a1-ab6c575924b8 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:54 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147.cc274f7a-31a5-4f7d-a3a1-ab6c575924b8 Jun 24 05:07:54 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:55 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ceb2be96-8ade-40b5-a044-fd2ad1474ce7 tempest-VolumeDependencyTests-74658642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ea24770c-b326-4217-bd6e-c2fd13fc35d8" returned: 0 in 0.796s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:55 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-ceb2be96-8ade-40b5-a044-fd2ad1474ce7 tempest-VolumeDependencyTests-74658642 None] Lock "cinder-quobyte-ea24770c-b326-4217-bd6e-c2fd13fc35d8" released by "delete_volume" :: held 1.846s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:07:55 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-09590776-a175-498d-9c01-057ab6b263e5 tempest-VolumesExtendTest-1644951533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147.cc274f7a-31a5-4f7d-a3a1-ab6c575924b8" returned: 0 in 0.768s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:55 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-ceb2be96-8ade-40b5-a044-fd2ad1474ce7 tempest-VolumeDependencyTests-74658642 None] Created reservations ['d9f6a54a-c8ea-4438-9e4d-f54aa79464c3', '1bd68533-5c8f-4961-91de-2f056dfc2bf5', '1fcc5829-9305-47a2-9876-23e425d14738', '93a4bddc-c7f8-4b82-9e6f-ba30e51f5d28'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:07:55 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-09590776-a175-498d-9c01-057ab6b263e5 tempest-VolumesExtendTest-1644951533 None] Lock "cinder-quobyte-cc274f7a-31a5-4f7d-a3a1-ab6c575924b8" released by "_delete_snapshot" :: held 3.846s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:07:55 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-09590776-a175-498d-9c01-057ab6b263e5 tempest-VolumesExtendTest-1644951533 None] Lock "cinder-quobyte-31243660-b6d8-4708-ba3f-1791b117f147" released by "delete_snapshot" :: held 3.873s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:07:56 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-09590776-a175-498d-9c01-057ab6b263e5 tempest-VolumesExtendTest-1644951533 None] Created reservations ['8cd97aff-1c9c-4f17-91dd-9104d8e56967', 'bd797ace-04b3-4256-91a8-33f3727ca222', '0d7d2ee4-3c08-4419-8ce6-22623e28d354', 'c2ce302b-bd35-4794-8676-456eb1c4dd9a'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:07:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-ceb2be96-8ade-40b5-a044-fd2ad1474ce7 tempest-VolumeDependencyTests-74658642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:07:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-ceb2be96-8ade-40b5-a044-fd2ad1474ce7 tempest-VolumeDependencyTests-74658642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:07:56 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-ceb2be96-8ade-40b5-a044-fd2ad1474ce7 tempest-VolumeDependencyTests-74658642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:07:56 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-ceb2be96-8ade-40b5-a044-fd2ad1474ce7 tempest-VolumeDependencyTests-74658642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:07:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-ceb2be96-8ade-40b5-a044-fd2ad1474ce7 tempest-VolumeDependencyTests-74658642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:07:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ceb2be96-8ade-40b5-a044-fd2ad1474ce7 tempest-VolumeDependencyTests-74658642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:56 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:07:56 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:56 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-09590776-a175-498d-9c01-057ab6b263e5 tempest-VolumesExtendTest-1644951533 None] Delete snapshot completed successfully. Jun 24 05:07:56 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-09590776-a175-498d-9c01-057ab6b263e5 tempest-VolumesExtendTest-1644951533 None] Lock "cinder-cc274f7a-31a5-4f7d-a3a1-ab6c575924b8-delete_snapshot" released by "delete_snapshot" :: held 4.924s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:07:57 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ceb2be96-8ade-40b5-a044-fd2ad1474ce7 tempest-VolumeDependencyTests-74658642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.848s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:57 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-ceb2be96-8ade-40b5-a044-fd2ad1474ce7 tempest-VolumeDependencyTests-74658642 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:07:57 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-ceb2be96-8ade-40b5-a044-fd2ad1474ce7 tempest-VolumeDependencyTests-74658642 None] Deleted volume successfully. Jun 24 05:07:57 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:SELECT=110,cinder:INSERT=43,cinder:UPDATE=146,cinder:DELETE=13 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:07:57 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-d3fbd703-798d-421a-9abf-bb6da562aad0 tempest-VolumesExtendTest-1644951533 None] Acquiring lock "cinder-31243660-b6d8-4708-ba3f-1791b117f147-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:07:57 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-ceb2be96-8ade-40b5-a044-fd2ad1474ce7 tempest-VolumeDependencyTests-74658642 None] Lock "cinder-ea24770c-b326-4217-bd6e-c2fd13fc35d8-delete_volume" released by "delete_volume" :: held 4.256s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:07:57 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-d3fbd703-798d-421a-9abf-bb6da562aad0 tempest-VolumesExtendTest-1644951533 None] Lock "cinder-31243660-b6d8-4708-ba3f-1791b117f147-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:07:57 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-d3fbd703-798d-421a-9abf-bb6da562aad0 tempest-VolumesExtendTest-1644951533 None] Acquiring lock "cinder-quobyte-31243660-b6d8-4708-ba3f-1791b117f147" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:07:57 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-d3fbd703-798d-421a-9abf-bb6da562aad0 tempest-VolumesExtendTest-1644951533 None] Lock "cinder-quobyte-31243660-b6d8-4708-ba3f-1791b117f147" acquired by "delete_volume" :: waited 0.019s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:07:57 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9fab84-c7fa-4fbf-826e-6006adea68ac]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:07:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d3fbd703-798d-421a-9abf-bb6da562aad0 tempest-VolumesExtendTest-1644951533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:57 devstack sudo[105444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147 Jun 24 05:07:57 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:58 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d3fbd703-798d-421a-9abf-bb6da562aad0 tempest-VolumesExtendTest-1644951533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147" returned: 0 in 0.902s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d3fbd703-798d-421a-9abf-bb6da562aad0 tempest-VolumesExtendTest-1644951533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:58 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147 Jun 24 05:07:58 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:07:59 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Jun 24 05:07:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d3fbd703-798d-421a-9abf-bb6da562aad0 tempest-VolumesExtendTest-1644951533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-31243660-b6d8-4708-ba3f-1791b117f147" returned: 0 in 0.806s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:07:59 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-d3fbd703-798d-421a-9abf-bb6da562aad0 tempest-VolumesExtendTest-1644951533 None] Lock "cinder-quobyte-31243660-b6d8-4708-ba3f-1791b117f147" released by "delete_volume" :: held 1.796s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:07:59 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-d3fbd703-798d-421a-9abf-bb6da562aad0 tempest-VolumesExtendTest-1644951533 None] Created reservations ['16246be8-6f4a-4879-a9fe-10abf694000c', '2a7ab7f3-1f2c-4d4f-a786-326cf5ebfb23', '1691651c-00bc-4784-8080-8d3a76800c7e', 'e71f2f13-041d-4999-945a-a014c70dc75b'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:07:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-d3fbd703-798d-421a-9abf-bb6da562aad0 tempest-VolumesExtendTest-1644951533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:07:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-d3fbd703-798d-421a-9abf-bb6da562aad0 tempest-VolumesExtendTest-1644951533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:07:59 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-d3fbd703-798d-421a-9abf-bb6da562aad0 tempest-VolumesExtendTest-1644951533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:07:59 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-d3fbd703-798d-421a-9abf-bb6da562aad0 tempest-VolumesExtendTest-1644951533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:07:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-d3fbd703-798d-421a-9abf-bb6da562aad0 tempest-VolumesExtendTest-1644951533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:07:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d3fbd703-798d-421a-9abf-bb6da562aad0 tempest-VolumesExtendTest-1644951533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:07:59 devstack sudo[105452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:07:59 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:08:00 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root Jun 24 05:08:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d3fbd703-798d-421a-9abf-bb6da562aad0 tempest-VolumesExtendTest-1644951533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 1.033s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:08:00 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-d3fbd703-798d-421a-9abf-bb6da562aad0 tempest-VolumesExtendTest-1644951533 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:08:00 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-d3fbd703-798d-421a-9abf-bb6da562aad0 tempest-VolumesExtendTest-1644951533 None] Deleted volume successfully. Jun 24 05:08:00 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-d3fbd703-798d-421a-9abf-bb6da562aad0 tempest-VolumesExtendTest-1644951533 None] Lock "cinder-31243660-b6d8-4708-ba3f-1791b117f147-delete_volume" released by "delete_volume" :: held 3.116s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:08:01 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-4645ebcc-df72-4eb3-8677-aa422facd93a tempest-TestStampPattern-152240646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:08:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4645ebcc-df72-4eb3-8677-aa422facd93a tempest-TestStampPattern-152240646 None] Flow 'volume_create_manager' (392963d1-c743-442d-9f85-9622eef49f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:08:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4645ebcc-df72-4eb3-8677-aa422facd93a tempest-TestStampPattern-152240646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38ba34f0-b97e-4066-8038-8c10e036f1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:08:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4645ebcc-df72-4eb3-8677-aa422facd93a tempest-TestStampPattern-152240646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38ba34f0-b97e-4066-8038-8c10e036f1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1316199339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20fcf990-b55f-4270-9b50-10eacc6473db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3edefa52f08d4edb9df68993f7c1478e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:08:02Z,use_quota=True,user_id='8b7e1d708db64b5fab370ae554d3eb7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:08:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4645ebcc-df72-4eb3-8677-aa422facd93a tempest-TestStampPattern-152240646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f377900-26dd-4ef1-a0a4-1dbb115b0951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:08:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4645ebcc-df72-4eb3-8677-aa422facd93a tempest-TestStampPattern-152240646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f377900-26dd-4ef1-a0a4-1dbb115b0951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:08:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4645ebcc-df72-4eb3-8677-aa422facd93a tempest-TestStampPattern-152240646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9eb083a-31df-42fc-a6aa-8a7575e90020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:08:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4645ebcc-df72-4eb3-8677-aa422facd93a tempest-TestStampPattern-152240646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9eb083a-31df-42fc-a6aa-8a7575e90020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20fcf990-b55f-4270-9b50-10eacc6473db', 'volume_name': 'volume-20fcf990-b55f-4270-9b50-10eacc6473db', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:08:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4645ebcc-df72-4eb3-8677-aa422facd93a tempest-TestStampPattern-152240646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eb13f6e-e9bf-4600-9264-235752cd7c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:08:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4645ebcc-df72-4eb3-8677-aa422facd93a tempest-TestStampPattern-152240646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eb13f6e-e9bf-4600-9264-235752cd7c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:08:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4645ebcc-df72-4eb3-8677-aa422facd93a tempest-TestStampPattern-152240646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04a0f7e0-4f8b-4875-b746-509e7f0c580c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:08:02 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-4645ebcc-df72-4eb3-8677-aa422facd93a tempest-TestStampPattern-152240646 None] Volume 20fcf990-b55f-4270-9b50-10eacc6473db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20fcf990-b55f-4270-9b50-10eacc6473db', 'volume_size': 1} Jun 24 05:08:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4645ebcc-df72-4eb3-8677-aa422facd93a tempest-TestStampPattern-152240646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:08:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4645ebcc-df72-4eb3-8677-aa422facd93a tempest-TestStampPattern-152240646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:08:02 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-4645ebcc-df72-4eb3-8677-aa422facd93a tempest-TestStampPattern-152240646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1316199339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20fcf990-b55f-4270-9b50-10eacc6473db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3edefa52f08d4edb9df68993f7c1478e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:08:02Z,use_quota=True,user_id='8b7e1d708db64b5fab370ae554d3eb7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:08:02 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-4645ebcc-df72-4eb3-8677-aa422facd93a tempest-TestStampPattern-152240646 None] Creating volume 20fcf990-b55f-4270-9b50-10eacc6473db {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:08:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4645ebcc-df72-4eb3-8677-aa422facd93a tempest-TestStampPattern-152240646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:08:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4645ebcc-df72-4eb3-8677-aa422facd93a tempest-TestStampPattern-152240646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:08:02 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-4645ebcc-df72-4eb3-8677-aa422facd93a tempest-TestStampPattern-152240646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:08:02 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-4645ebcc-df72-4eb3-8677-aa422facd93a tempest-TestStampPattern-152240646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:08:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4645ebcc-df72-4eb3-8677-aa422facd93a tempest-TestStampPattern-152240646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:08:02 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-4645ebcc-df72-4eb3-8677-aa422facd93a tempest-TestStampPattern-152240646 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:08:02 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-4645ebcc-df72-4eb3-8677-aa422facd93a tempest-TestStampPattern-152240646 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:08:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4645ebcc-df72-4eb3-8677-aa422facd93a tempest-TestStampPattern-152240646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:08:02 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db 1073741824 Jun 24 05:08:02 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-32828c26-a348-4398-8579-7e8d659a030c tempest-CinderUnicodeTest-198422525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:08:02 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:08:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-32828c26-a348-4398-8579-7e8d659a030c tempest-CinderUnicodeTest-198422525 None] Flow 'volume_create_manager' (3fa9195d-3c5a-4d19-9b6e-56c6340405ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:08:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-32828c26-a348-4398-8579-7e8d659a030c tempest-CinderUnicodeTest-198422525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9307bd48-b61d-4621-b396-718273f505c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:08:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-32828c26-a348-4398-8579-7e8d659a030c tempest-CinderUnicodeTest-198422525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9307bd48-b61d-4621-b396-718273f505c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=975190dd-c64f-4efa-af8f-8f10157615eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0127012dcf3c46db93d529cb73e1f091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:08:02Z,use_quota=True,user_id='2cc03377ec9e4ad199b15bc9e251cfd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:08:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-32828c26-a348-4398-8579-7e8d659a030c tempest-CinderUnicodeTest-198422525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9fb4c4b-b30b-4447-b7d3-8b903ef99fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:08:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-32828c26-a348-4398-8579-7e8d659a030c tempest-CinderUnicodeTest-198422525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9fb4c4b-b30b-4447-b7d3-8b903ef99fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:08:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-32828c26-a348-4398-8579-7e8d659a030c tempest-CinderUnicodeTest-198422525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c942335-0c37-47a6-b10b-f6acbf821546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:08:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-32828c26-a348-4398-8579-7e8d659a030c tempest-CinderUnicodeTest-198422525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c942335-0c37-47a6-b10b-f6acbf821546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '975190dd-c64f-4efa-af8f-8f10157615eb', 'volume_name': 'volume-975190dd-c64f-4efa-af8f-8f10157615eb', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:08:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-32828c26-a348-4398-8579-7e8d659a030c tempest-CinderUnicodeTest-198422525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbb7887d-3b5b-4dd4-88d6-80d181f6237b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:08:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-32828c26-a348-4398-8579-7e8d659a030c tempest-CinderUnicodeTest-198422525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbb7887d-3b5b-4dd4-88d6-80d181f6237b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:08:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-32828c26-a348-4398-8579-7e8d659a030c tempest-CinderUnicodeTest-198422525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (682cc7e7-b70f-46a8-b45b-99f40bd08439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:08:02 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-32828c26-a348-4398-8579-7e8d659a030c tempest-CinderUnicodeTest-198422525 None] Volume 975190dd-c64f-4efa-af8f-8f10157615eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-975190dd-c64f-4efa-af8f-8f10157615eb', 'volume_size': 1} Jun 24 05:08:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-32828c26-a348-4398-8579-7e8d659a030c tempest-CinderUnicodeTest-198422525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:08:03 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Jun 24 05:08:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4645ebcc-df72-4eb3-8677-aa422facd93a tempest-TestStampPattern-152240646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db 1073741824" returned: 0 in 1.356s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:08:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4645ebcc-df72-4eb3-8677-aa422facd93a tempest-TestStampPattern-152240646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:08:03 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db Jun 24 05:08:03 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:08:04 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Jun 24 05:08:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4645ebcc-df72-4eb3-8677-aa422facd93a tempest-TestStampPattern-152240646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db" returned: 0 in 0.806s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:08:04 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-4645ebcc-df72-4eb3-8677-aa422facd93a tempest-TestStampPattern-152240646 None] <== create_volume: return (2223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:08:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4645ebcc-df72-4eb3-8677-aa422facd93a tempest-TestStampPattern-152240646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.226s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:08:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-32828c26-a348-4398-8579-7e8d659a030c tempest-CinderUnicodeTest-198422525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.092s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:08:04 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-32828c26-a348-4398-8579-7e8d659a030c tempest-CinderUnicodeTest-198422525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=975190dd-c64f-4efa-af8f-8f10157615eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0127012dcf3c46db93d529cb73e1f091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:08:02Z,use_quota=True,user_id='2cc03377ec9e4ad199b15bc9e251cfd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:08:04 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-32828c26-a348-4398-8579-7e8d659a030c tempest-CinderUnicodeTest-198422525 None] Creating volume 975190dd-c64f-4efa-af8f-8f10157615eb {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:08:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-32828c26-a348-4398-8579-7e8d659a030c tempest-CinderUnicodeTest-198422525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:08:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-32828c26-a348-4398-8579-7e8d659a030c tempest-CinderUnicodeTest-198422525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:08:04 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-32828c26-a348-4398-8579-7e8d659a030c tempest-CinderUnicodeTest-198422525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:08:04 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-32828c26-a348-4398-8579-7e8d659a030c tempest-CinderUnicodeTest-198422525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:08:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-32828c26-a348-4398-8579-7e8d659a030c tempest-CinderUnicodeTest-198422525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:08:04 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-32828c26-a348-4398-8579-7e8d659a030c tempest-CinderUnicodeTest-198422525 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:08:04 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-32828c26-a348-4398-8579-7e8d659a030c tempest-CinderUnicodeTest-198422525 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:08:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-32828c26-a348-4398-8579-7e8d659a030c tempest-CinderUnicodeTest-198422525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-975190dd-c64f-4efa-af8f-8f10157615eb 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:08:04 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4645ebcc-df72-4eb3-8677-aa422facd93a tempest-TestStampPattern-152240646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04a0f7e0-4f8b-4875-b746-509e7f0c580c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20fcf990-b55f-4270-9b50-10eacc6473db', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:08:04 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-975190dd-c64f-4efa-af8f-8f10157615eb 1073741824 Jun 24 05:08:04 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:08:04 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4645ebcc-df72-4eb3-8677-aa422facd93a tempest-TestStampPattern-152240646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e16d975-40a5-4309-bfca-751655806ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:08:04 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-4645ebcc-df72-4eb3-8677-aa422facd93a tempest-TestStampPattern-152240646 None] Volume volume-20fcf990-b55f-4270-9b50-10eacc6473db (20fcf990-b55f-4270-9b50-10eacc6473db): created successfully Jun 24 05:08:04 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4645ebcc-df72-4eb3-8677-aa422facd93a tempest-TestStampPattern-152240646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e16d975-40a5-4309-bfca-751655806ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:08:04 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4645ebcc-df72-4eb3-8677-aa422facd93a tempest-TestStampPattern-152240646 None] Flow 'volume_create_manager' (392963d1-c743-442d-9f85-9622eef49f26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:08:04 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-4645ebcc-df72-4eb3-8677-aa422facd93a tempest-TestStampPattern-152240646 None] Created volume successfully. Jun 24 05:08:05 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Jun 24 05:08:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-32828c26-a348-4398-8579-7e8d659a030c tempest-CinderUnicodeTest-198422525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-975190dd-c64f-4efa-af8f-8f10157615eb 1073741824" returned: 0 in 1.000s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:08:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-32828c26-a348-4398-8579-7e8d659a030c tempest-CinderUnicodeTest-198422525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-975190dd-c64f-4efa-af8f-8f10157615eb {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:08:05 devstack sudo[105485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-975190dd-c64f-4efa-af8f-8f10157615eb Jun 24 05:08:05 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:08:06 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root Jun 24 05:08:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-32828c26-a348-4398-8579-7e8d659a030c tempest-CinderUnicodeTest-198422525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-975190dd-c64f-4efa-af8f-8f10157615eb" returned: 0 in 0.679s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:08:06 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-32828c26-a348-4398-8579-7e8d659a030c tempest-CinderUnicodeTest-198422525 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:08:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-32828c26-a348-4398-8579-7e8d659a030c tempest-CinderUnicodeTest-198422525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:08:06 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-32828c26-a348-4398-8579-7e8d659a030c tempest-CinderUnicodeTest-198422525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (682cc7e7-b70f-46a8-b45b-99f40bd08439) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-975190dd-c64f-4efa-af8f-8f10157615eb', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:08:06 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-32828c26-a348-4398-8579-7e8d659a030c tempest-CinderUnicodeTest-198422525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f85fb51-05a0-446c-a1dd-8676163a3364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:08:06 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-32828c26-a348-4398-8579-7e8d659a030c tempest-CinderUnicodeTest-198422525 None] Volume volume-975190dd-c64f-4efa-af8f-8f10157615eb (975190dd-c64f-4efa-af8f-8f10157615eb): created successfully Jun 24 05:08:06 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-32828c26-a348-4398-8579-7e8d659a030c tempest-CinderUnicodeTest-198422525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f85fb51-05a0-446c-a1dd-8676163a3364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:08:06 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-32828c26-a348-4398-8579-7e8d659a030c tempest-CinderUnicodeTest-198422525 None] Flow 'volume_create_manager' (3fa9195d-3c5a-4d19-9b6e-56c6340405ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:08:06 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-32828c26-a348-4398-8579-7e8d659a030c tempest-CinderUnicodeTest-198422525 None] Created volume successfully. Jun 24 05:08:07 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-6569df59-9f58-4f98-86be-eb8c643861fd tempest-CinderUnicodeTest-198422525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:08:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-6569df59-9f58-4f98-86be-eb8c643861fd tempest-CinderUnicodeTest-198422525 None] Flow 'volume_create_manager' (9e4479be-3fe8-4687-a214-5fcb8dc50fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:08:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-6569df59-9f58-4f98-86be-eb8c643861fd tempest-CinderUnicodeTest-198422525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57ee01fc-43c4-45be-86b5-3b3ccc9858c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:08:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-6569df59-9f58-4f98-86be-eb8c643861fd tempest-CinderUnicodeTest-198422525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57ee01fc-43c4-45be-86b5-3b3ccc9858c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:08:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1073248006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4bd9e85-7793-4022-97d6-99d2c42edb3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0127012dcf3c46db93d529cb73e1f091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:08:08Z,use_quota=True,user_id='2cc03377ec9e4ad199b15bc9e251cfd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:08:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-6569df59-9f58-4f98-86be-eb8c643861fd tempest-CinderUnicodeTest-198422525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea200014-0bcf-487d-b7f3-c9084344e08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:08:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-6569df59-9f58-4f98-86be-eb8c643861fd tempest-CinderUnicodeTest-198422525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea200014-0bcf-487d-b7f3-c9084344e08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:08:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-6569df59-9f58-4f98-86be-eb8c643861fd tempest-CinderUnicodeTest-198422525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9cca7ae-fa16-4317-ab8d-2f837ace8eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:08:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-6569df59-9f58-4f98-86be-eb8c643861fd tempest-CinderUnicodeTest-198422525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9cca7ae-fa16-4317-ab8d-2f837ace8eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4bd9e85-7793-4022-97d6-99d2c42edb3b', 'volume_name': 'volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:08:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-6569df59-9f58-4f98-86be-eb8c643861fd tempest-CinderUnicodeTest-198422525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d410647-5dcd-49d1-8982-7116bf204bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:08:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-6569df59-9f58-4f98-86be-eb8c643861fd tempest-CinderUnicodeTest-198422525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d410647-5dcd-49d1-8982-7116bf204bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:08:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-6569df59-9f58-4f98-86be-eb8c643861fd tempest-CinderUnicodeTest-198422525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (004de154-e503-4fa4-b4ce-4dd170ba5d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:08:07 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-6569df59-9f58-4f98-86be-eb8c643861fd tempest-CinderUnicodeTest-198422525 None] Volume b4bd9e85-7793-4022-97d6-99d2c42edb3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b', 'volume_size': 1} Jun 24 05:08:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-6569df59-9f58-4f98-86be-eb8c643861fd tempest-CinderUnicodeTest-198422525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:08:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-6569df59-9f58-4f98-86be-eb8c643861fd tempest-CinderUnicodeTest-198422525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:08:07 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-6569df59-9f58-4f98-86be-eb8c643861fd tempest-CinderUnicodeTest-198422525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:08:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1073248006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4bd9e85-7793-4022-97d6-99d2c42edb3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0127012dcf3c46db93d529cb73e1f091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:08:08Z,use_quota=True,user_id='2cc03377ec9e4ad199b15bc9e251cfd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:08:07 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-6569df59-9f58-4f98-86be-eb8c643861fd tempest-CinderUnicodeTest-198422525 None] Creating volume b4bd9e85-7793-4022-97d6-99d2c42edb3b {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:08:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-6569df59-9f58-4f98-86be-eb8c643861fd tempest-CinderUnicodeTest-198422525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:08:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-6569df59-9f58-4f98-86be-eb8c643861fd tempest-CinderUnicodeTest-198422525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:08:07 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-6569df59-9f58-4f98-86be-eb8c643861fd tempest-CinderUnicodeTest-198422525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:08:07 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-6569df59-9f58-4f98-86be-eb8c643861fd tempest-CinderUnicodeTest-198422525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:08:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-6569df59-9f58-4f98-86be-eb8c643861fd tempest-CinderUnicodeTest-198422525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:08:07 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-6569df59-9f58-4f98-86be-eb8c643861fd tempest-CinderUnicodeTest-198422525 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:08:07 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-6569df59-9f58-4f98-86be-eb8c643861fd tempest-CinderUnicodeTest-198422525 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:08:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6569df59-9f58-4f98-86be-eb8c643861fd tempest-CinderUnicodeTest-198422525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:08:08 devstack sudo[105488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b 1073741824 Jun 24 05:08:08 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:08:09 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root Jun 24 05:08:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6569df59-9f58-4f98-86be-eb8c643861fd tempest-CinderUnicodeTest-198422525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b 1073741824" returned: 0 in 1.251s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:08:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6569df59-9f58-4f98-86be-eb8c643861fd tempest-CinderUnicodeTest-198422525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:08:09 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b Jun 24 05:08:09 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:08:09 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 05:08:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:08:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:08:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:08:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:08:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:08:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:08:09 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:08:09 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:08:10 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Jun 24 05:08:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6569df59-9f58-4f98-86be-eb8c643861fd tempest-CinderUnicodeTest-198422525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b" returned: 0 in 0.954s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:08:10 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-6569df59-9f58-4f98-86be-eb8c643861fd tempest-CinderUnicodeTest-198422525 None] <== create_volume: return (2283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:08:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-6569df59-9f58-4f98-86be-eb8c643861fd tempest-CinderUnicodeTest-198422525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.287s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:08:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-6569df59-9f58-4f98-86be-eb8c643861fd tempest-CinderUnicodeTest-198422525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (004de154-e503-4fa4-b4ce-4dd170ba5d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:08:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-6569df59-9f58-4f98-86be-eb8c643861fd tempest-CinderUnicodeTest-198422525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12fd1896-93b5-46d0-a6e4-898bb0cf09bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:08:10 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-6569df59-9f58-4f98-86be-eb8c643861fd tempest-CinderUnicodeTest-198422525 None] Volume volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b (b4bd9e85-7793-4022-97d6-99d2c42edb3b): created successfully Jun 24 05:08:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-6569df59-9f58-4f98-86be-eb8c643861fd tempest-CinderUnicodeTest-198422525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12fd1896-93b5-46d0-a6e4-898bb0cf09bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:08:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-6569df59-9f58-4f98-86be-eb8c643861fd tempest-CinderUnicodeTest-198422525 None] Flow 'volume_create_manager' (9e4479be-3fe8-4687-a214-5fcb8dc50fca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:08:10 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-6569df59-9f58-4f98-86be-eb8c643861fd tempest-CinderUnicodeTest-198422525 None] Created volume successfully. Jun 24 05:08:10 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Jun 24 05:08:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.984s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:08:10 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:08:10 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager._thread_info {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 05:08:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread count: 29 {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 05:08:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread info: [<_MainThread(MainThread, started 130211312517248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 05:08:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f0d1f036-9576-4708-9b05-62dd1b6e14e8 tempest-CinderUnicodeTest-198422525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:08:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f0d1f036-9576-4708-9b05-62dd1b6e14e8 tempest-CinderUnicodeTest-198422525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:08:11 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-f0d1f036-9576-4708-9b05-62dd1b6e14e8 tempest-CinderUnicodeTest-198422525 None] Creating offline snapshot 903b7da5-a5fa-4eaa-a8d3-e2f4dae2e91e of volume b4bd9e85-7793-4022-97d6-99d2c42edb3b {{(pid=93830) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 05:08:11 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce756db-2b6b-416e-9e90-2eb702098641]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:08:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f0d1f036-9576-4708-9b05-62dd1b6e14e8 tempest-CinderUnicodeTest-198422525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:08:11 devstack sudo[105524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b Jun 24 05:08:11 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:08:12 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root Jun 24 05:08:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f0d1f036-9576-4708-9b05-62dd1b6e14e8 tempest-CinderUnicodeTest-198422525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b" returned: 0 in 0.999s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:08:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f0d1f036-9576-4708-9b05-62dd1b6e14e8 tempest-CinderUnicodeTest-198422525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b.903b7da5-a5fa-4eaa-a8d3-e2f4dae2e91e 1G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:08:12 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b.903b7da5-a5fa-4eaa-a8d3-e2f4dae2e91e 1G Jun 24 05:08:12 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:08:13 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Jun 24 05:08:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f0d1f036-9576-4708-9b05-62dd1b6e14e8 tempest-CinderUnicodeTest-198422525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b.903b7da5-a5fa-4eaa-a8d3-e2f4dae2e91e 1G" returned: 0 in 0.997s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:08:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f0d1f036-9576-4708-9b05-62dd1b6e14e8 tempest-CinderUnicodeTest-198422525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b.903b7da5-a5fa-4eaa-a8d3-e2f4dae2e91e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:08:13 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b.903b7da5-a5fa-4eaa-a8d3-e2f4dae2e91e Jun 24 05:08:13 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:08:14 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Jun 24 05:08:14 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f0d1f036-9576-4708-9b05-62dd1b6e14e8 tempest-CinderUnicodeTest-198422525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b.903b7da5-a5fa-4eaa-a8d3-e2f4dae2e91e" returned: 0 in 0.998s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:08:14 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-f0d1f036-9576-4708-9b05-62dd1b6e14e8 tempest-CinderUnicodeTest-198422525 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b.903b7da5-a5fa-4eaa-a8d3-e2f4dae2e91e is being set with open permissions: ugo+rw Jun 24 05:08:14 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f0d1f036-9576-4708-9b05-62dd1b6e14e8 tempest-CinderUnicodeTest-198422525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b.903b7da5-a5fa-4eaa-a8d3-e2f4dae2e91e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:08:14 devstack sudo[105553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b.903b7da5-a5fa-4eaa-a8d3-e2f4dae2e91e Jun 24 05:08:14 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:08:15 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root Jun 24 05:08:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f0d1f036-9576-4708-9b05-62dd1b6e14e8 tempest-CinderUnicodeTest-198422525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b.903b7da5-a5fa-4eaa-a8d3-e2f4dae2e91e" returned: 0 in 0.860s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:08:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f0d1f036-9576-4708-9b05-62dd1b6e14e8 tempest-CinderUnicodeTest-198422525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:08:15 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b.info Jun 24 05:08:15 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:08:16 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Jun 24 05:08:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f0d1f036-9576-4708-9b05-62dd1b6e14e8 tempest-CinderUnicodeTest-198422525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b.info" returned: 0 in 0.829s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:08:16 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-f0d1f036-9576-4708-9b05-62dd1b6e14e8 tempest-CinderUnicodeTest-198422525 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b.info is being set with open permissions: ugo+rw Jun 24 05:08:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f0d1f036-9576-4708-9b05-62dd1b6e14e8 tempest-CinderUnicodeTest-198422525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:08:16 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b.info Jun 24 05:08:16 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:08:16 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Jun 24 05:08:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f0d1f036-9576-4708-9b05-62dd1b6e14e8 tempest-CinderUnicodeTest-198422525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b.info" returned: 0 in 0.732s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:08:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f0d1f036-9576-4708-9b05-62dd1b6e14e8 tempest-CinderUnicodeTest-198422525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.571s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:08:16 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-f0d1f036-9576-4708-9b05-62dd1b6e14e8 tempest-CinderUnicodeTest-198422525 None] Create snapshot completed successfully Jun 24 05:08:17 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-1e9a9e30-c08b-4927-ac38-39a63c4de48a tempest-CinderUnicodeTest-198422525 None] Acquiring lock "cinder-903b7da5-a5fa-4eaa-a8d3-e2f4dae2e91e-delete_snapshot" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:08:17 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-1e9a9e30-c08b-4927-ac38-39a63c4de48a tempest-CinderUnicodeTest-198422525 None] Lock "cinder-903b7da5-a5fa-4eaa-a8d3-e2f4dae2e91e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:08:17 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-1e9a9e30-c08b-4927-ac38-39a63c4de48a tempest-CinderUnicodeTest-198422525 None] Acquiring lock "cinder-quobyte-b4bd9e85-7793-4022-97d6-99d2c42edb3b" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:08:17 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-1e9a9e30-c08b-4927-ac38-39a63c4de48a tempest-CinderUnicodeTest-198422525 None] Lock "cinder-quobyte-b4bd9e85-7793-4022-97d6-99d2c42edb3b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:08:17 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-1e9a9e30-c08b-4927-ac38-39a63c4de48a tempest-CinderUnicodeTest-198422525 None] Acquiring lock "cinder-quobyte-903b7da5-a5fa-4eaa-a8d3-e2f4dae2e91e" by "_delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:08:17 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-1e9a9e30-c08b-4927-ac38-39a63c4de48a tempest-CinderUnicodeTest-198422525 None] Lock "cinder-quobyte-903b7da5-a5fa-4eaa-a8d3-e2f4dae2e91e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:08:17 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-1e9a9e30-c08b-4927-ac38-39a63c4de48a tempest-CinderUnicodeTest-198422525 None] Deleting offline snapshot 903b7da5-a5fa-4eaa-a8d3-e2f4dae2e91e of volume b4bd9e85-7793-4022-97d6-99d2c42edb3b {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 05:08:17 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-1e9a9e30-c08b-4927-ac38-39a63c4de48a tempest-CinderUnicodeTest-198422525 None] snapshot_file for this snap is: volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b.903b7da5-a5fa-4eaa-a8d3-e2f4dae2e91e {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 05:08:17 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b664ce-a71d-41e0-8409-fc09b5e072f7]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:08:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1e9a9e30-c08b-4927-ac38-39a63c4de48a tempest-CinderUnicodeTest-198422525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b.903b7da5-a5fa-4eaa-a8d3-e2f4dae2e91e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:08:18 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b.903b7da5-a5fa-4eaa-a8d3-e2f4dae2e91e Jun 24 05:08:18 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:08:18 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Jun 24 05:08:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1e9a9e30-c08b-4927-ac38-39a63c4de48a tempest-CinderUnicodeTest-198422525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b.903b7da5-a5fa-4eaa-a8d3-e2f4dae2e91e" returned: 0 in 0.904s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:08:18 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-1e9a9e30-c08b-4927-ac38-39a63c4de48a tempest-CinderUnicodeTest-198422525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:08:18 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92fd543-037f-4108-8e3d-301e5f4c2550]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:08:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1e9a9e30-c08b-4927-ac38-39a63c4de48a tempest-CinderUnicodeTest-198422525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:08:19 devstack sudo[105572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b Jun 24 05:08:19 devstack sudo[105572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:08:19 devstack sudo[105572]: pam_unix(sudo:session): session closed for user root Jun 24 05:08:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1e9a9e30-c08b-4927-ac38-39a63c4de48a tempest-CinderUnicodeTest-198422525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b" returned: 0 in 0.930s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:08:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1e9a9e30-c08b-4927-ac38-39a63c4de48a tempest-CinderUnicodeTest-198422525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b.903b7da5-a5fa-4eaa-a8d3-e2f4dae2e91e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:08:19 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b.903b7da5-a5fa-4eaa-a8d3-e2f4dae2e91e Jun 24 05:08:19 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:08:21 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Jun 24 05:08:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1e9a9e30-c08b-4927-ac38-39a63c4de48a tempest-CinderUnicodeTest-198422525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b.903b7da5-a5fa-4eaa-a8d3-e2f4dae2e91e" returned: 0 in 1.161s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:08:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1e9a9e30-c08b-4927-ac38-39a63c4de48a tempest-CinderUnicodeTest-198422525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b.903b7da5-a5fa-4eaa-a8d3-e2f4dae2e91e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:08:21 devstack sudo[105654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b.903b7da5-a5fa-4eaa-a8d3-e2f4dae2e91e Jun 24 05:08:21 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:08:22 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root Jun 24 05:08:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1e9a9e30-c08b-4927-ac38-39a63c4de48a tempest-CinderUnicodeTest-198422525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b.903b7da5-a5fa-4eaa-a8d3-e2f4dae2e91e" returned: 0 in 1.025s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:08:22 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-1e9a9e30-c08b-4927-ac38-39a63c4de48a tempest-CinderUnicodeTest-198422525 None] Lock "cinder-quobyte-903b7da5-a5fa-4eaa-a8d3-e2f4dae2e91e" released by "_delete_snapshot" :: held 4.292s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:08:22 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-1e9a9e30-c08b-4927-ac38-39a63c4de48a tempest-CinderUnicodeTest-198422525 None] Lock "cinder-quobyte-b4bd9e85-7793-4022-97d6-99d2c42edb3b" released by "delete_snapshot" :: held 4.324s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:08:22 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-1e9a9e30-c08b-4927-ac38-39a63c4de48a tempest-CinderUnicodeTest-198422525 None] Created reservations ['376ae347-837b-4bb3-9665-a76682803a31', 'ac0ce92c-e6a2-4fa7-b407-724ff3a8df09', '572ea556-a935-48f4-a7e0-e40988181f95', '80e7fd84-fcba-4bbe-93f4-ec3ef920f8a8'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:08:22 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-1e9a9e30-c08b-4927-ac38-39a63c4de48a tempest-CinderUnicodeTest-198422525 None] Delete snapshot completed successfully. Jun 24 05:08:22 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-1e9a9e30-c08b-4927-ac38-39a63c4de48a tempest-CinderUnicodeTest-198422525 None] Lock "cinder-903b7da5-a5fa-4eaa-a8d3-e2f4dae2e91e-delete_snapshot" released by "delete_snapshot" :: held 4.949s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:08:23 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a090a981-ba32-4b6c-9653-1a4f5e4d89cd tempest-CinderUnicodeTest-198422525 None] Acquiring lock "cinder-b4bd9e85-7793-4022-97d6-99d2c42edb3b-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:08:23 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a090a981-ba32-4b6c-9653-1a4f5e4d89cd tempest-CinderUnicodeTest-198422525 None] Lock "cinder-b4bd9e85-7793-4022-97d6-99d2c42edb3b-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:08:23 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a090a981-ba32-4b6c-9653-1a4f5e4d89cd tempest-CinderUnicodeTest-198422525 None] Acquiring lock "cinder-quobyte-b4bd9e85-7793-4022-97d6-99d2c42edb3b" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:08:23 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a090a981-ba32-4b6c-9653-1a4f5e4d89cd tempest-CinderUnicodeTest-198422525 None] Lock "cinder-quobyte-b4bd9e85-7793-4022-97d6-99d2c42edb3b" acquired by "delete_volume" :: waited 0.023s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:08:23 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6fed77b-de71-41df-9885-04dbaa30b165]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:08:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a090a981-ba32-4b6c-9653-1a4f5e4d89cd tempest-CinderUnicodeTest-198422525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:08:23 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b Jun 24 05:08:23 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:08:24 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Jun 24 05:08:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a090a981-ba32-4b6c-9653-1a4f5e4d89cd tempest-CinderUnicodeTest-198422525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b" returned: 0 in 1.140s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:08:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a090a981-ba32-4b6c-9653-1a4f5e4d89cd tempest-CinderUnicodeTest-198422525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:08:25 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b Jun 24 05:08:25 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:08:25 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Jun 24 05:08:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a090a981-ba32-4b6c-9653-1a4f5e4d89cd tempest-CinderUnicodeTest-198422525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b4bd9e85-7793-4022-97d6-99d2c42edb3b" returned: 0 in 0.808s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:08:25 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a090a981-ba32-4b6c-9653-1a4f5e4d89cd tempest-CinderUnicodeTest-198422525 None] Lock "cinder-quobyte-b4bd9e85-7793-4022-97d6-99d2c42edb3b" released by "delete_volume" :: held 2.161s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:08:26 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-a090a981-ba32-4b6c-9653-1a4f5e4d89cd tempest-CinderUnicodeTest-198422525 None] Created reservations ['039092a7-215b-4e31-bd3d-29de78b87c81', '359c4ec8-a023-4abc-be6b-d66bb0a4ebce', '0f8f6150-e828-4bb2-8f8a-0c5c67700efa', 'cefd2baa-44b4-4dae-a848-accbc03c8215'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:08:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a090a981-ba32-4b6c-9653-1a4f5e4d89cd tempest-CinderUnicodeTest-198422525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:08:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a090a981-ba32-4b6c-9653-1a4f5e4d89cd tempest-CinderUnicodeTest-198422525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:08:26 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a090a981-ba32-4b6c-9653-1a4f5e4d89cd tempest-CinderUnicodeTest-198422525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:08:26 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a090a981-ba32-4b6c-9653-1a4f5e4d89cd tempest-CinderUnicodeTest-198422525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:08:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a090a981-ba32-4b6c-9653-1a4f5e4d89cd tempest-CinderUnicodeTest-198422525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:08:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a090a981-ba32-4b6c-9653-1a4f5e4d89cd tempest-CinderUnicodeTest-198422525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:08:26 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:08:26 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:08:27 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3b57242e-b0ef-4138-ba09-b8a2f74ceb1a tempest-CinderUnicodeTest-198422525 None] Acquiring lock "cinder-975190dd-c64f-4efa-af8f-8f10157615eb-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:08:27 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3b57242e-b0ef-4138-ba09-b8a2f74ceb1a tempest-CinderUnicodeTest-198422525 None] Lock "cinder-975190dd-c64f-4efa-af8f-8f10157615eb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:08:27 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3b57242e-b0ef-4138-ba09-b8a2f74ceb1a tempest-CinderUnicodeTest-198422525 None] Acquiring lock "cinder-quobyte-975190dd-c64f-4efa-af8f-8f10157615eb" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:08:27 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3b57242e-b0ef-4138-ba09-b8a2f74ceb1a tempest-CinderUnicodeTest-198422525 None] Lock "cinder-quobyte-975190dd-c64f-4efa-af8f-8f10157615eb" acquired by "delete_volume" :: waited 0.040s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:08:27 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[746de61e-0a24-4e10-9ee0-253e4524e65d]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:08:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3b57242e-b0ef-4138-ba09-b8a2f74ceb1a tempest-CinderUnicodeTest-198422525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-975190dd-c64f-4efa-af8f-8f10157615eb {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:08:27 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-975190dd-c64f-4efa-af8f-8f10157615eb Jun 24 05:08:27 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:08:28 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Jun 24 05:08:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a090a981-ba32-4b6c-9653-1a4f5e4d89cd tempest-CinderUnicodeTest-198422525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 1.617s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:08:28 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-a090a981-ba32-4b6c-9653-1a4f5e4d89cd tempest-CinderUnicodeTest-198422525 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:08:28 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-a090a981-ba32-4b6c-9653-1a4f5e4d89cd tempest-CinderUnicodeTest-198422525 None] Deleted volume successfully. Jun 24 05:08:28 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a090a981-ba32-4b6c-9653-1a4f5e4d89cd tempest-CinderUnicodeTest-198422525 None] Lock "cinder-b4bd9e85-7793-4022-97d6-99d2c42edb3b-delete_volume" released by "delete_volume" :: held 4.640s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:08:28 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Jun 24 05:08:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3b57242e-b0ef-4138-ba09-b8a2f74ceb1a tempest-CinderUnicodeTest-198422525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-975190dd-c64f-4efa-af8f-8f10157615eb" returned: 0 in 1.351s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:08:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3b57242e-b0ef-4138-ba09-b8a2f74ceb1a tempest-CinderUnicodeTest-198422525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-975190dd-c64f-4efa-af8f-8f10157615eb {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:08:28 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-975190dd-c64f-4efa-af8f-8f10157615eb Jun 24 05:08:28 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:08:30 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Jun 24 05:08:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3b57242e-b0ef-4138-ba09-b8a2f74ceb1a tempest-CinderUnicodeTest-198422525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-975190dd-c64f-4efa-af8f-8f10157615eb" returned: 0 in 1.802s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:08:30 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3b57242e-b0ef-4138-ba09-b8a2f74ceb1a tempest-CinderUnicodeTest-198422525 None] Lock "cinder-quobyte-975190dd-c64f-4efa-af8f-8f10157615eb" released by "delete_volume" :: held 3.291s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:08:30 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-3b57242e-b0ef-4138-ba09-b8a2f74ceb1a tempest-CinderUnicodeTest-198422525 None] Created reservations ['b3ab5802-ed9d-448b-8ced-b0ed22ede0b0', 'd9af8001-e7f0-4366-950d-d5cd16d11ee1', '2bc4c836-eef8-4cf9-90e7-466f5a901458', '251b49fd-4039-4957-8569-d468198f6721'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:08:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3b57242e-b0ef-4138-ba09-b8a2f74ceb1a tempest-CinderUnicodeTest-198422525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:08:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3b57242e-b0ef-4138-ba09-b8a2f74ceb1a tempest-CinderUnicodeTest-198422525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:08:31 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-3b57242e-b0ef-4138-ba09-b8a2f74ceb1a tempest-CinderUnicodeTest-198422525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:08:31 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-3b57242e-b0ef-4138-ba09-b8a2f74ceb1a tempest-CinderUnicodeTest-198422525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:08:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3b57242e-b0ef-4138-ba09-b8a2f74ceb1a tempest-CinderUnicodeTest-198422525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:08:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3b57242e-b0ef-4138-ba09-b8a2f74ceb1a tempest-CinderUnicodeTest-198422525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:08:31 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:08:31 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:08:32 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Jun 24 05:08:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3b57242e-b0ef-4138-ba09-b8a2f74ceb1a tempest-CinderUnicodeTest-198422525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 1.041s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:08:32 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-3b57242e-b0ef-4138-ba09-b8a2f74ceb1a tempest-CinderUnicodeTest-198422525 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:08:32 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-3b57242e-b0ef-4138-ba09-b8a2f74ceb1a tempest-CinderUnicodeTest-198422525 None] Deleted volume successfully. Jun 24 05:08:32 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3b57242e-b0ef-4138-ba09-b8a2f74ceb1a tempest-CinderUnicodeTest-198422525 None] Lock "cinder-975190dd-c64f-4efa-af8f-8f10157615eb-delete_volume" released by "delete_volume" :: held 5.173s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:08:40 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-1442c5fe-7dc6-41f7-a723-83d7532b2ec7 tempest-TestInstancesWithCinderVolumes-1434125260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:08:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1442c5fe-7dc6-41f7-a723-83d7532b2ec7 tempest-TestInstancesWithCinderVolumes-1434125260 None] Flow 'volume_create_manager' (9571e474-3bd5-4411-86e8-cf8b95d2f17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:08:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1442c5fe-7dc6-41f7-a723-83d7532b2ec7 tempest-TestInstancesWithCinderVolumes-1434125260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebacaa4a-9388-4798-96e4-813069b3772b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:08:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1442c5fe-7dc6-41f7-a723-83d7532b2ec7 tempest-TestInstancesWithCinderVolumes-1434125260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebacaa4a-9388-4798-96e4-813069b3772b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-763096814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c24d74d3-a269-44d3-bcac-a96593a2b087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c1e2e42638d4c2795c21090772013de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:08:40Z,use_quota=True,user_id='a95ff96f229940f8922ef75f5415f592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc6ce90e-b5f4-4d87-8279-1fd1edf8ca21),volume_type_id=dc6ce90e-b5f4-4d87-8279-1fd1edf8ca21)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:08:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1442c5fe-7dc6-41f7-a723-83d7532b2ec7 tempest-TestInstancesWithCinderVolumes-1434125260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d79483d4-67cc-4abb-9945-574d34c5a8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:08:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1442c5fe-7dc6-41f7-a723-83d7532b2ec7 tempest-TestInstancesWithCinderVolumes-1434125260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d79483d4-67cc-4abb-9945-574d34c5a8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:08:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1442c5fe-7dc6-41f7-a723-83d7532b2ec7 tempest-TestInstancesWithCinderVolumes-1434125260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6293eca2-c93b-4ba6-8004-d6c9d3bccbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:08:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1442c5fe-7dc6-41f7-a723-83d7532b2ec7 tempest-TestInstancesWithCinderVolumes-1434125260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6293eca2-c93b-4ba6-8004-d6c9d3bccbdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c24d74d3-a269-44d3-bcac-a96593a2b087', 'volume_name': 'volume-c24d74d3-a269-44d3-bcac-a96593a2b087', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:08:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1442c5fe-7dc6-41f7-a723-83d7532b2ec7 tempest-TestInstancesWithCinderVolumes-1434125260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aa996c3-e4cc-435e-a42c-636d0252077f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:08:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1442c5fe-7dc6-41f7-a723-83d7532b2ec7 tempest-TestInstancesWithCinderVolumes-1434125260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aa996c3-e4cc-435e-a42c-636d0252077f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:08:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1442c5fe-7dc6-41f7-a723-83d7532b2ec7 tempest-TestInstancesWithCinderVolumes-1434125260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (684768f8-a92e-4bfc-987e-30e58dd20f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:08:40 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-1442c5fe-7dc6-41f7-a723-83d7532b2ec7 tempest-TestInstancesWithCinderVolumes-1434125260 None] Volume c24d74d3-a269-44d3-bcac-a96593a2b087: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c24d74d3-a269-44d3-bcac-a96593a2b087', 'volume_size': 1} Jun 24 05:08:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1442c5fe-7dc6-41f7-a723-83d7532b2ec7 tempest-TestInstancesWithCinderVolumes-1434125260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:08:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1442c5fe-7dc6-41f7-a723-83d7532b2ec7 tempest-TestInstancesWithCinderVolumes-1434125260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:08:40 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-1442c5fe-7dc6-41f7-a723-83d7532b2ec7 tempest-TestInstancesWithCinderVolumes-1434125260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-763096814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c24d74d3-a269-44d3-bcac-a96593a2b087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c1e2e42638d4c2795c21090772013de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:08:40Z,use_quota=True,user_id='a95ff96f229940f8922ef75f5415f592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc6ce90e-b5f4-4d87-8279-1fd1edf8ca21),volume_type_id=dc6ce90e-b5f4-4d87-8279-1fd1edf8ca21)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:08:40 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-1442c5fe-7dc6-41f7-a723-83d7532b2ec7 tempest-TestInstancesWithCinderVolumes-1434125260 None] Creating volume c24d74d3-a269-44d3-bcac-a96593a2b087 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:08:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1442c5fe-7dc6-41f7-a723-83d7532b2ec7 tempest-TestInstancesWithCinderVolumes-1434125260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:08:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1442c5fe-7dc6-41f7-a723-83d7532b2ec7 tempest-TestInstancesWithCinderVolumes-1434125260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:08:40 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-1442c5fe-7dc6-41f7-a723-83d7532b2ec7 tempest-TestInstancesWithCinderVolumes-1434125260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:08:40 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-1442c5fe-7dc6-41f7-a723-83d7532b2ec7 tempest-TestInstancesWithCinderVolumes-1434125260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:08:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1442c5fe-7dc6-41f7-a723-83d7532b2ec7 tempest-TestInstancesWithCinderVolumes-1434125260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:08:40 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-1442c5fe-7dc6-41f7-a723-83d7532b2ec7 tempest-TestInstancesWithCinderVolumes-1434125260 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:08:40 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-1442c5fe-7dc6-41f7-a723-83d7532b2ec7 tempest-TestInstancesWithCinderVolumes-1434125260 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:08:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1442c5fe-7dc6-41f7-a723-83d7532b2ec7 tempest-TestInstancesWithCinderVolumes-1434125260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c24d74d3-a269-44d3-bcac-a96593a2b087 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:08:40 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c24d74d3-a269-44d3-bcac-a96593a2b087 1073741824 Jun 24 05:08:40 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:08:40 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbe13746-87f6-4584-85a7-63f7efd563fa tempest-TestInstancesWithCinderVolumes-1434125260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:08:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cbe13746-87f6-4584-85a7-63f7efd563fa tempest-TestInstancesWithCinderVolumes-1434125260 None] Flow 'volume_create_manager' (4bac04da-4e69-4dbf-aa9c-28d19f9c4a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:08:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cbe13746-87f6-4584-85a7-63f7efd563fa tempest-TestInstancesWithCinderVolumes-1434125260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55b37b2f-9ab3-4c16-9163-bf9c74467080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:08:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cbe13746-87f6-4584-85a7-63f7efd563fa tempest-TestInstancesWithCinderVolumes-1434125260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55b37b2f-9ab3-4c16-9163-bf9c74467080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-517511549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0118a52a-bef2-46ee-9745-15238c0c571d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c1e2e42638d4c2795c21090772013de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:08:41Z,use_quota=True,user_id='a95ff96f229940f8922ef75f5415f592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3d3d96cf-1939-4611-9f52-75795c2225b6),volume_type_id=3d3d96cf-1939-4611-9f52-75795c2225b6)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:08:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cbe13746-87f6-4584-85a7-63f7efd563fa tempest-TestInstancesWithCinderVolumes-1434125260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8083410b-12d5-40dc-9159-1c0b3659e138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:08:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cbe13746-87f6-4584-85a7-63f7efd563fa tempest-TestInstancesWithCinderVolumes-1434125260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8083410b-12d5-40dc-9159-1c0b3659e138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:08:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cbe13746-87f6-4584-85a7-63f7efd563fa tempest-TestInstancesWithCinderVolumes-1434125260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (417d4fdc-9caf-4fca-8629-5687721a18f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:08:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cbe13746-87f6-4584-85a7-63f7efd563fa tempest-TestInstancesWithCinderVolumes-1434125260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (417d4fdc-9caf-4fca-8629-5687721a18f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0118a52a-bef2-46ee-9745-15238c0c571d', 'volume_name': 'volume-0118a52a-bef2-46ee-9745-15238c0c571d', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:08:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cbe13746-87f6-4584-85a7-63f7efd563fa tempest-TestInstancesWithCinderVolumes-1434125260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a18f2f4-c657-4543-afc0-47609a267965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:08:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cbe13746-87f6-4584-85a7-63f7efd563fa tempest-TestInstancesWithCinderVolumes-1434125260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a18f2f4-c657-4543-afc0-47609a267965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:08:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cbe13746-87f6-4584-85a7-63f7efd563fa tempest-TestInstancesWithCinderVolumes-1434125260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dbe0655-3cc7-42d5-970d-77bd4de5eeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:08:40 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-cbe13746-87f6-4584-85a7-63f7efd563fa tempest-TestInstancesWithCinderVolumes-1434125260 None] Volume 0118a52a-bef2-46ee-9745-15238c0c571d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0118a52a-bef2-46ee-9745-15238c0c571d', 'volume_size': 1} Jun 24 05:08:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-cbe13746-87f6-4584-85a7-63f7efd563fa tempest-TestInstancesWithCinderVolumes-1434125260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:08:41 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:08:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Flow 'volume_create_manager' (e6c9797d-8d07-4479-920a-06c949234f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:08:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (926d7fba-7fc6-4410-bb4b-ec512f8a492c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:08:41 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Jun 24 05:08:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1442c5fe-7dc6-41f7-a723-83d7532b2ec7 tempest-TestInstancesWithCinderVolumes-1434125260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c24d74d3-a269-44d3-bcac-a96593a2b087 1073741824" returned: 0 in 1.288s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:08:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (926d7fba-7fc6-4410-bb4b-ec512f8a492c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1519732609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=435de2bf-d394-4aa9-86a9-a0c9765d13f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c1e2e42638d4c2795c21090772013de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:08:41Z,use_quota=True,user_id='a95ff96f229940f8922ef75f5415f592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1c7545b9-3a6c-4ab7-b07c-0962ef92c952),volume_type_id=1c7545b9-3a6c-4ab7-b07c-0962ef92c952)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:08:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f617be8f-ea05-4fe3-bc49-68a2b11bf329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:08:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f617be8f-ea05-4fe3-bc49-68a2b11bf329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:08:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7787d44-4f01-4465-aa08-ea128eedcddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:08:41 devstack cinder-volume[93830]: DEBUG cinder.image.glance [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Creating Keystone auth plugin from conf {{(pid=93830) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 24 05:08:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1442c5fe-7dc6-41f7-a723-83d7532b2ec7 tempest-TestInstancesWithCinderVolumes-1434125260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c24d74d3-a269-44d3-bcac-a96593a2b087 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:08:41 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c24d74d3-a269-44d3-bcac-a96593a2b087 Jun 24 05:08:41 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:08:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7787d44-4f01-4465-aa08-ea128eedcddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '435de2bf-d394-4aa9-86a9-a0c9765d13f3', 'volume_name': 'volume-435de2bf-d394-4aa9-86a9-a0c9765d13f3', 'volume_size': 1, 'image_id': 'e31d9c7f-cb0a-4970-b86b-c4b710f896e9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e31d9c7f-cb0a-4970-b86b-c4b710f896e9', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1282208920', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0c1e2e42638d4c2795c21090772013de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e31d9c7f-cb0a-4970-b86b-c4b710f896e9', 'created_at': datetime.datetime(2026, 6, 24, 3, 8, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 3, 8, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e31d9c7f-cb0a-4970-b86b-c4b710f896e9/file', 'properties': {}}, 'image_service': }' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:08:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61f84363-173b-4276-b3a6-1f652a4d519d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:08:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61f84363-173b-4276-b3a6-1f652a4d519d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:08:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cca48538-7f5e-4fbc-b8ce-4d5d620c4b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:08:41 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Volume 435de2bf-d394-4aa9-86a9-a0c9765d13f3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-435de2bf-d394-4aa9-86a9-a0c9765d13f3', 'volume_size': 1, 'image_id': 'e31d9c7f-cb0a-4970-b86b-c4b710f896e9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e31d9c7f-cb0a-4970-b86b-c4b710f896e9', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1282208920', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0c1e2e42638d4c2795c21090772013de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e31d9c7f-cb0a-4970-b86b-c4b710f896e9', 'created_at': datetime.datetime(2026, 6, 24, 3, 8, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 3, 8, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e31d9c7f-cb0a-4970-b86b-c4b710f896e9/file', 'properties': {}}, 'image_service': } Jun 24 05:08:41 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Trying to clone 435de2bf-d394-4aa9-86a9-a0c9765d13f3 from image e31d9c7f-cb0a-4970-b86b-c4b710f896e9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e31d9c7f-cb0a-4970-b86b-c4b710f896e9', 'metadata': {}}]). {{(pid=93830) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 24 05:08:42 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Jun 24 05:08:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1442c5fe-7dc6-41f7-a723-83d7532b2ec7 tempest-TestInstancesWithCinderVolumes-1434125260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c24d74d3-a269-44d3-bcac-a96593a2b087" returned: 0 in 0.698s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:08:42 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-1442c5fe-7dc6-41f7-a723-83d7532b2ec7 tempest-TestInstancesWithCinderVolumes-1434125260 None] <== create_volume: return (2061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:08:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1442c5fe-7dc6-41f7-a723-83d7532b2ec7 tempest-TestInstancesWithCinderVolumes-1434125260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.064s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:08:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-cbe13746-87f6-4584-85a7-63f7efd563fa tempest-TestInstancesWithCinderVolumes-1434125260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.397s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:08:42 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-cbe13746-87f6-4584-85a7-63f7efd563fa tempest-TestInstancesWithCinderVolumes-1434125260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-517511549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0118a52a-bef2-46ee-9745-15238c0c571d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c1e2e42638d4c2795c21090772013de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:08:41Z,use_quota=True,user_id='a95ff96f229940f8922ef75f5415f592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3d3d96cf-1939-4611-9f52-75795c2225b6),volume_type_id=3d3d96cf-1939-4611-9f52-75795c2225b6)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:08:42 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-cbe13746-87f6-4584-85a7-63f7efd563fa tempest-TestInstancesWithCinderVolumes-1434125260 None] Creating volume 0118a52a-bef2-46ee-9745-15238c0c571d {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:08:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-cbe13746-87f6-4584-85a7-63f7efd563fa tempest-TestInstancesWithCinderVolumes-1434125260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:08:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-cbe13746-87f6-4584-85a7-63f7efd563fa tempest-TestInstancesWithCinderVolumes-1434125260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:08:42 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-cbe13746-87f6-4584-85a7-63f7efd563fa tempest-TestInstancesWithCinderVolumes-1434125260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:08:42 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-cbe13746-87f6-4584-85a7-63f7efd563fa tempest-TestInstancesWithCinderVolumes-1434125260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:08:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-cbe13746-87f6-4584-85a7-63f7efd563fa tempest-TestInstancesWithCinderVolumes-1434125260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:08:42 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-cbe13746-87f6-4584-85a7-63f7efd563fa tempest-TestInstancesWithCinderVolumes-1434125260 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:08:42 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-cbe13746-87f6-4584-85a7-63f7efd563fa tempest-TestInstancesWithCinderVolumes-1434125260 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:08:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-cbe13746-87f6-4584-85a7-63f7efd563fa tempest-TestInstancesWithCinderVolumes-1434125260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-0118a52a-bef2-46ee-9745-15238c0c571d 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:08:42 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1442c5fe-7dc6-41f7-a723-83d7532b2ec7 tempest-TestInstancesWithCinderVolumes-1434125260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (684768f8-a92e-4bfc-987e-30e58dd20f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c24d74d3-a269-44d3-bcac-a96593a2b087', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:08:42 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-0118a52a-bef2-46ee-9745-15238c0c571d 1073741824 Jun 24 05:08:42 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:08:42 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1442c5fe-7dc6-41f7-a723-83d7532b2ec7 tempest-TestInstancesWithCinderVolumes-1434125260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b50512ca-9af5-4e74-90b2-85ff1cdac92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:08:42 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-1442c5fe-7dc6-41f7-a723-83d7532b2ec7 tempest-TestInstancesWithCinderVolumes-1434125260 None] Volume volume-c24d74d3-a269-44d3-bcac-a96593a2b087 (c24d74d3-a269-44d3-bcac-a96593a2b087): created successfully Jun 24 05:08:42 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1442c5fe-7dc6-41f7-a723-83d7532b2ec7 tempest-TestInstancesWithCinderVolumes-1434125260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b50512ca-9af5-4e74-90b2-85ff1cdac92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:08:42 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1442c5fe-7dc6-41f7-a723-83d7532b2ec7 tempest-TestInstancesWithCinderVolumes-1434125260 None] Flow 'volume_create_manager' (9571e474-3bd5-4411-86e8-cf8b95d2f17d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:08:42 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-1442c5fe-7dc6-41f7-a723-83d7532b2ec7 tempest-TestInstancesWithCinderVolumes-1434125260 None] Created volume successfully. Jun 24 05:08:43 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Jun 24 05:08:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-cbe13746-87f6-4584-85a7-63f7efd563fa tempest-TestInstancesWithCinderVolumes-1434125260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-0118a52a-bef2-46ee-9745-15238c0c571d 1073741824" returned: 0 in 0.946s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:08:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-cbe13746-87f6-4584-85a7-63f7efd563fa tempest-TestInstancesWithCinderVolumes-1434125260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-0118a52a-bef2-46ee-9745-15238c0c571d {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:08:43 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-0118a52a-bef2-46ee-9745-15238c0c571d Jun 24 05:08:43 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:08:43 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Jun 24 05:08:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-cbe13746-87f6-4584-85a7-63f7efd563fa tempest-TestInstancesWithCinderVolumes-1434125260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-0118a52a-bef2-46ee-9745-15238c0c571d" returned: 0 in 0.709s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:08:43 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-cbe13746-87f6-4584-85a7-63f7efd563fa tempest-TestInstancesWithCinderVolumes-1434125260 None] <== create_volume: return (1716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:08:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-cbe13746-87f6-4584-85a7-63f7efd563fa tempest-TestInstancesWithCinderVolumes-1434125260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.719s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:08:44 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cbe13746-87f6-4584-85a7-63f7efd563fa tempest-TestInstancesWithCinderVolumes-1434125260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dbe0655-3cc7-42d5-970d-77bd4de5eeca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0118a52a-bef2-46ee-9745-15238c0c571d', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:08:44 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cbe13746-87f6-4584-85a7-63f7efd563fa tempest-TestInstancesWithCinderVolumes-1434125260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1f5901f-a396-417c-b7cf-f18d2a568b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:08:44 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-cbe13746-87f6-4584-85a7-63f7efd563fa tempest-TestInstancesWithCinderVolumes-1434125260 None] Volume volume-0118a52a-bef2-46ee-9745-15238c0c571d (0118a52a-bef2-46ee-9745-15238c0c571d): created successfully Jun 24 05:08:44 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cbe13746-87f6-4584-85a7-63f7efd563fa tempest-TestInstancesWithCinderVolumes-1434125260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1f5901f-a396-417c-b7cf-f18d2a568b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:08:44 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cbe13746-87f6-4584-85a7-63f7efd563fa tempest-TestInstancesWithCinderVolumes-1434125260 None] Flow 'volume_create_manager' (4bac04da-4e69-4dbf-aa9c-28d19f9c4a3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:08:44 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-cbe13746-87f6-4584-85a7-63f7efd563fa tempest-TestInstancesWithCinderVolumes-1434125260 None] Created volume successfully. Jun 24 05:08:45 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e31d9c7f-cb0a-4970-b86b-c4b710f896e9_psl_mw34devstack@QuobyteHD, size 20.69 MB, duration 3.51 sec {{(pid=93830) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 24 05:08:45 devstack cinder-volume[93830]: INFO cinder.image.image_utils [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Image download 20.69 MB at 5.89 MB/s Jun 24 05:08:45 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[53662d7f-574c-4aa8-8b8c-3e78df72b3d4]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:08:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e31d9c7f-cb0a-4970-b86b-c4b710f896e9_psl_mw34devstack@QuobyteHD {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:08:45 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e31d9c7f-cb0a-4970-b86b-c4b710f896e9_psl_mw34devstack@QuobyteHD Jun 24 05:08:45 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:08:46 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Jun 24 05:08:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e31d9c7f-cb0a-4970-b86b-c4b710f896e9_psl_mw34devstack@QuobyteHD" returned: 0 in 0.737s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:08:46 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Temporary image e31d9c7f-cb0a-4970-b86b-c4b710f896e9 is fetched for user a95ff96f229940f8922ef75f5415f592. {{(pid=93830) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 24 05:08:46 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da7d1cf-c9df-4f69-b50a-705f0a584071]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:08:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e31d9c7f-cb0a-4970-b86b-c4b710f896e9_psl_mw34devstack@QuobyteHD {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:08:46 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e31d9c7f-cb0a-4970-b86b-c4b710f896e9_psl_mw34devstack@QuobyteHD Jun 24 05:08:46 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:08:47 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Jun 24 05:08:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e31d9c7f-cb0a-4970-b86b-c4b710f896e9_psl_mw34devstack@QuobyteHD" returned: 0 in 0.728s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:08:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:08:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:08:47 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1519732609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=435de2bf-d394-4aa9-86a9-a0c9765d13f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c1e2e42638d4c2795c21090772013de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:08:41Z,use_quota=True,user_id='a95ff96f229940f8922ef75f5415f592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1c7545b9-3a6c-4ab7-b07c-0962ef92c952),volume_type_id=1c7545b9-3a6c-4ab7-b07c-0962ef92c952)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:08:47 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Creating volume 435de2bf-d394-4aa9-86a9-a0c9765d13f3 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:08:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:08:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:08:47 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:08:47 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:08:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:08:47 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:08:47 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:08:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-435de2bf-d394-4aa9-86a9-a0c9765d13f3 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:08:47 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-435de2bf-d394-4aa9-86a9-a0c9765d13f3 1073741824 Jun 24 05:08:47 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:08:47 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Jun 24 05:08:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-435de2bf-d394-4aa9-86a9-a0c9765d13f3 1073741824" returned: 0 in 0.892s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:08:47 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:SELECT=71,cinder:INSERT=17,cinder:UPDATE=71,cinder:DELETE=4 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:08:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-435de2bf-d394-4aa9-86a9-a0c9765d13f3 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:08:47 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-435de2bf-d394-4aa9-86a9-a0c9765d13f3 Jun 24 05:08:47 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:08:48 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Jun 24 05:08:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-435de2bf-d394-4aa9-86a9-a0c9765d13f3" returned: 0 in 0.634s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:08:48 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:08:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:08:48 devstack cinder-volume[93830]: DEBUG cinder.volume.volume_utils [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Attempting download of e31d9c7f-cb0a-4970-b86b-c4b710f896e9 ((None, [{'url': 'file:///opt/stack/data/glance/images/e31d9c7f-cb0a-4970-b86b-c4b710f896e9', 'metadata': {}}])) to volume 435de2bf-d394-4aa9-86a9-a0c9765d13f3. {{(pid=93830) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 24 05:08:48 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1e3a8b-25ba-4e55-9ff9-efb41b0c4582]: (4, 'raw') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:08:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e31d9c7f-cb0a-4970-b86b-c4b710f896e9_wu1uqiqc {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:08:48 devstack sudo[105955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e31d9c7f-cb0a-4970-b86b-c4b710f896e9_wu1uqiqc Jun 24 05:08:48 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:08:49 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root Jun 24 05:08:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e31d9c7f-cb0a-4970-b86b-c4b710f896e9_wu1uqiqc" returned: 0 in 0.743s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:08:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e31d9c7f-cb0a-4970-b86b-c4b710f896e9_wu1uqiqc {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:08:49 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e31d9c7f-cb0a-4970-b86b-c4b710f896e9_wu1uqiqc Jun 24 05:08:49 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:08:50 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Jun 24 05:08:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e31d9c7f-cb0a-4970-b86b-c4b710f896e9_wu1uqiqc" returned: 1 in 0.777s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:08:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e31d9c7f-cb0a-4970-b86b-c4b710f896e9_wu1uqiqc' failed. Not Retrying. {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 05:08:50 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[c510f0bf-6bf9-44db-bf4e-5ea48f57d636]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:08:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e31d9c7f-cb0a-4970-b86b-c4b710f896e9_psl_mw34devstack@QuobyteHD {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:08:50 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e31d9c7f-cb0a-4970-b86b-c4b710f896e9_psl_mw34devstack@QuobyteHD Jun 24 05:08:50 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:08:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-55572c21-2acb-4cc9-b381-162b3e56ee63 req-31466dc2-ef0f-4051-8e1d-29788f684ac3 tempest-TestStampPattern-152240646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:08:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-55572c21-2acb-4cc9-b381-162b3e56ee63 req-31466dc2-ef0f-4051-8e1d-29788f684ac3 tempest-TestStampPattern-152240646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:08:50 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[534ed5e5-eb63-4160-be99-00f715d48934]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:08:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-55572c21-2acb-4cc9-b381-162b3e56ee63 req-31466dc2-ef0f-4051-8e1d-29788f684ac3 tempest-TestStampPattern-152240646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:08:50 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Jun 24 05:08:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e31d9c7f-cb0a-4970-b86b-c4b710f896e9_psl_mw34devstack@QuobyteHD" returned: 0 in 0.801s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:08:51 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] e31d9c7f-cb0a-4970-b86b-c4b710f896e9 was qcow2, converting to raw {{(pid=93830) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 24 05:08:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e31d9c7f-cb0a-4970-b86b-c4b710f896e9_psl_mw34devstack@QuobyteHD /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-435de2bf-d394-4aa9-86a9-a0c9765d13f3 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:08:51 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e31d9c7f-cb0a-4970-b86b-c4b710f896e9_psl_mw34devstack@QuobyteHD /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-435de2bf-d394-4aa9-86a9-a0c9765d13f3 Jun 24 05:08:51 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:08:51 devstack sudo[105977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db Jun 24 05:08:51 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:08:51 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root Jun 24 05:08:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-55572c21-2acb-4cc9-b381-162b3e56ee63 req-31466dc2-ef0f-4051-8e1d-29788f684ac3 tempest-TestStampPattern-152240646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db" returned: 0 in 0.838s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:08:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-55572c21-2acb-4cc9-b381-162b3e56ee63 req-31466dc2-ef0f-4051-8e1d-29788f684ac3 tempest-TestStampPattern-152240646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.871s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:08:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-55572c21-2acb-4cc9-b381-162b3e56ee63 req-31466dc2-ef0f-4051-8e1d-29788f684ac3 tempest-TestStampPattern-152240646 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05', 'name': 'volume-20fcf990-b55f-4270-9b50-10eacc6473db', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c8fc8d42-a14b-4435-ae15-5a163477558c', 'enforce_multipath': True} {{(pid=93830) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 05:08:51 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-55572c21-2acb-4cc9-b381-162b3e56ee63 req-31466dc2-ef0f-4051-8e1d-29788f684ac3 tempest-TestStampPattern-152240646 None] attachment_update completed successfully. Jun 24 05:08:53 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Jun 24 05:08:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e31d9c7f-cb0a-4970-b86b-c4b710f896e9_psl_mw34devstack@QuobyteHD /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-435de2bf-d394-4aa9-86a9-a0c9765d13f3" returned: 0 in 2.026s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:08:53 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e31d9c7f-cb0a-4970-b86b-c4b710f896e9_psl_mw34devstack@QuobyteHD, size 112.00 MB, duration 2.03 sec, destination /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-435de2bf-d394-4aa9-86a9-a0c9765d13f3 {{(pid=93830) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 05:08:53 devstack cinder-volume[93830]: INFO cinder.image.image_utils [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Converted 112.00 MB image at 55.24 MB/s Jun 24 05:08:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-435de2bf-d394-4aa9-86a9-a0c9765d13f3 1G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:08:53 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-435de2bf-d394-4aa9-86a9-a0c9765d13f3 1G Jun 24 05:08:53 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:08:53 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Jun 24 05:08:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-435de2bf-d394-4aa9-86a9-a0c9765d13f3 1G" returned: 0 in 0.708s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:08:53 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[656ef780-3bc3-4836-8ea9-51f7438c9b43]: (4, 'raw') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:08:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-435de2bf-d394-4aa9-86a9-a0c9765d13f3 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:08:53 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-435de2bf-d394-4aa9-86a9-a0c9765d13f3 Jun 24 05:08:53 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:08:54 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Jun 24 05:08:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-435de2bf-d394-4aa9-86a9-a0c9765d13f3" returned: 0 in 0.757s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:08:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-435de2bf-d394-4aa9-86a9-a0c9765d13f3 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:08:54 devstack sudo[106389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-435de2bf-d394-4aa9-86a9-a0c9765d13f3 Jun 24 05:08:54 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:08:55 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root Jun 24 05:08:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-435de2bf-d394-4aa9-86a9-a0c9765d13f3" returned: 1 in 0.751s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:08:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-435de2bf-d394-4aa9-86a9-a0c9765d13f3' failed. Not Retrying. {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 05:08:55 devstack cinder-volume[93830]: DEBUG cinder.volume.volume_utils [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Downloaded image e31d9c7f-cb0a-4970-b86b-c4b710f896e9 ((None, [{'url': 'file:///opt/stack/data/glance/images/e31d9c7f-cb0a-4970-b86b-c4b710f896e9', 'metadata': {}}])) to volume 435de2bf-d394-4aa9-86a9-a0c9765d13f3 successfully. {{(pid=93830) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 24 05:08:55 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Temporary image e31d9c7f-cb0a-4970-b86b-c4b710f896e9 for user a95ff96f229940f8922ef75f5415f592 is deleted. {{(pid=93830) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 24 05:08:55 devstack cinder-volume[93830]: DEBUG cinder.volume.volume_utils [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Marking volume 435de2bf-d394-4aa9-86a9-a0c9765d13f3 as bootable. {{(pid=93830) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 24 05:08:55 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Copying metadata from image e31d9c7f-cb0a-4970-b86b-c4b710f896e9 to 435de2bf-d394-4aa9-86a9-a0c9765d13f3. {{(pid=93830) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 24 05:08:55 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Creating volume glance metadata for volume 435de2bf-d394-4aa9-86a9-a0c9765d13f3 backed by image e31d9c7f-cb0a-4970-b86b-c4b710f896e9 with: {'image_id': 'e31d9c7f-cb0a-4970-b86b-c4b710f896e9', 'image_name': 'tempest-scenario-img--1282208920', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93830) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 24 05:08:55 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cca48538-7f5e-4fbc-b8ce-4d5d620c4b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-435de2bf-d394-4aa9-86a9-a0c9765d13f3', 'volume_size': 1, 'image_id': 'e31d9c7f-cb0a-4970-b86b-c4b710f896e9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e31d9c7f-cb0a-4970-b86b-c4b710f896e9', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1282208920', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0c1e2e42638d4c2795c21090772013de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e31d9c7f-cb0a-4970-b86b-c4b710f896e9', 'created_at': datetime.datetime(2026, 6, 24, 3, 8, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 3, 8, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e31d9c7f-cb0a-4970-b86b-c4b710f896e9/file', 'properties': {}}, 'image_service': }' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:08:55 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbf91ed5-178d-49ec-8ba2-56dcf9af0055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:08:55 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Volume volume-435de2bf-d394-4aa9-86a9-a0c9765d13f3 (435de2bf-d394-4aa9-86a9-a0c9765d13f3): created successfully Jun 24 05:08:55 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbf91ed5-178d-49ec-8ba2-56dcf9af0055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:08:55 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Flow 'volume_create_manager' (e6c9797d-8d07-4479-920a-06c949234f4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:08:55 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-485e42ee-20da-44dd-8c06-f8a2e62948d4 tempest-TestInstancesWithCinderVolumes-1434125260 None] Created volume successfully. Jun 24 05:08:58 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-a42e7e9d-a8c0-4cb5-825a-fb1f7e210963 tempest-AttachVolumeNegativeTest-111486486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:08:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a42e7e9d-a8c0-4cb5-825a-fb1f7e210963 tempest-AttachVolumeNegativeTest-111486486 None] Flow 'volume_create_manager' (2d2a8413-f6ce-43be-82e3-7d4264092f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:08:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a42e7e9d-a8c0-4cb5-825a-fb1f7e210963 tempest-AttachVolumeNegativeTest-111486486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9f2d0b8-7154-47bf-9395-7b93bfd09f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:08:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a42e7e9d-a8c0-4cb5-825a-fb1f7e210963 tempest-AttachVolumeNegativeTest-111486486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9f2d0b8-7154-47bf-9395-7b93bfd09f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-508491987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc4e8b53-ff0e-48be-848f-32dfa12f6fb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d469e3abf0c849f59a9e06ca7b031d96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:08:58Z,use_quota=True,user_id='cea5c21618c24cd2aded0d3bbef0fd8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:08:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a42e7e9d-a8c0-4cb5-825a-fb1f7e210963 tempest-AttachVolumeNegativeTest-111486486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (581cbfc7-0822-4b03-91db-44838fc48508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:08:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a42e7e9d-a8c0-4cb5-825a-fb1f7e210963 tempest-AttachVolumeNegativeTest-111486486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (581cbfc7-0822-4b03-91db-44838fc48508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:08:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a42e7e9d-a8c0-4cb5-825a-fb1f7e210963 tempest-AttachVolumeNegativeTest-111486486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af6f8b06-d113-4172-8b5e-2c6eccad16b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:08:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a42e7e9d-a8c0-4cb5-825a-fb1f7e210963 tempest-AttachVolumeNegativeTest-111486486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af6f8b06-d113-4172-8b5e-2c6eccad16b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc4e8b53-ff0e-48be-848f-32dfa12f6fb6', 'volume_name': 'volume-dc4e8b53-ff0e-48be-848f-32dfa12f6fb6', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:08:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a42e7e9d-a8c0-4cb5-825a-fb1f7e210963 tempest-AttachVolumeNegativeTest-111486486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb90916d-e284-417b-8a88-41fea917a138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:08:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a42e7e9d-a8c0-4cb5-825a-fb1f7e210963 tempest-AttachVolumeNegativeTest-111486486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb90916d-e284-417b-8a88-41fea917a138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:08:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a42e7e9d-a8c0-4cb5-825a-fb1f7e210963 tempest-AttachVolumeNegativeTest-111486486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d11e2ef8-325a-495b-9b14-ae8338cd9a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:08:58 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-a42e7e9d-a8c0-4cb5-825a-fb1f7e210963 tempest-AttachVolumeNegativeTest-111486486 None] Volume dc4e8b53-ff0e-48be-848f-32dfa12f6fb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc4e8b53-ff0e-48be-848f-32dfa12f6fb6', 'volume_size': 1} Jun 24 05:08:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a42e7e9d-a8c0-4cb5-825a-fb1f7e210963 tempest-AttachVolumeNegativeTest-111486486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:08:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a42e7e9d-a8c0-4cb5-825a-fb1f7e210963 tempest-AttachVolumeNegativeTest-111486486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:08:58 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a42e7e9d-a8c0-4cb5-825a-fb1f7e210963 tempest-AttachVolumeNegativeTest-111486486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-508491987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc4e8b53-ff0e-48be-848f-32dfa12f6fb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d469e3abf0c849f59a9e06ca7b031d96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:08:58Z,use_quota=True,user_id='cea5c21618c24cd2aded0d3bbef0fd8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:08:58 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-a42e7e9d-a8c0-4cb5-825a-fb1f7e210963 tempest-AttachVolumeNegativeTest-111486486 None] Creating volume dc4e8b53-ff0e-48be-848f-32dfa12f6fb6 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:08:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a42e7e9d-a8c0-4cb5-825a-fb1f7e210963 tempest-AttachVolumeNegativeTest-111486486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:08:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a42e7e9d-a8c0-4cb5-825a-fb1f7e210963 tempest-AttachVolumeNegativeTest-111486486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:08:58 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a42e7e9d-a8c0-4cb5-825a-fb1f7e210963 tempest-AttachVolumeNegativeTest-111486486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:08:58 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a42e7e9d-a8c0-4cb5-825a-fb1f7e210963 tempest-AttachVolumeNegativeTest-111486486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:08:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a42e7e9d-a8c0-4cb5-825a-fb1f7e210963 tempest-AttachVolumeNegativeTest-111486486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:08:58 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a42e7e9d-a8c0-4cb5-825a-fb1f7e210963 tempest-AttachVolumeNegativeTest-111486486 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:08:58 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-a42e7e9d-a8c0-4cb5-825a-fb1f7e210963 tempest-AttachVolumeNegativeTest-111486486 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:08:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a42e7e9d-a8c0-4cb5-825a-fb1f7e210963 tempest-AttachVolumeNegativeTest-111486486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-dc4e8b53-ff0e-48be-848f-32dfa12f6fb6 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:08:58 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-dc4e8b53-ff0e-48be-848f-32dfa12f6fb6 1073741824 Jun 24 05:08:58 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:08:59 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Jun 24 05:08:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a42e7e9d-a8c0-4cb5-825a-fb1f7e210963 tempest-AttachVolumeNegativeTest-111486486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-dc4e8b53-ff0e-48be-848f-32dfa12f6fb6 1073741824" returned: 0 in 0.926s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:08:59 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:SELECT=44,cinder:INSERT=17,cinder:UPDATE=57,cinder:DELETE=6 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:08:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a42e7e9d-a8c0-4cb5-825a-fb1f7e210963 tempest-AttachVolumeNegativeTest-111486486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-dc4e8b53-ff0e-48be-848f-32dfa12f6fb6 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:08:59 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-dc4e8b53-ff0e-48be-848f-32dfa12f6fb6 Jun 24 05:08:59 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:08:59 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Jun 24 05:08:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a42e7e9d-a8c0-4cb5-825a-fb1f7e210963 tempest-AttachVolumeNegativeTest-111486486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-dc4e8b53-ff0e-48be-848f-32dfa12f6fb6" returned: 0 in 0.686s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:08:59 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a42e7e9d-a8c0-4cb5-825a-fb1f7e210963 tempest-AttachVolumeNegativeTest-111486486 None] <== create_volume: return (1660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:08:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a42e7e9d-a8c0-4cb5-825a-fb1f7e210963 tempest-AttachVolumeNegativeTest-111486486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:08:59 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a42e7e9d-a8c0-4cb5-825a-fb1f7e210963 tempest-AttachVolumeNegativeTest-111486486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d11e2ef8-325a-495b-9b14-ae8338cd9a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc4e8b53-ff0e-48be-848f-32dfa12f6fb6', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:08:59 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a42e7e9d-a8c0-4cb5-825a-fb1f7e210963 tempest-AttachVolumeNegativeTest-111486486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6b10d30-7aa0-4c53-b3f9-9bbdd844925a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:08:59 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-a42e7e9d-a8c0-4cb5-825a-fb1f7e210963 tempest-AttachVolumeNegativeTest-111486486 None] Volume volume-dc4e8b53-ff0e-48be-848f-32dfa12f6fb6 (dc4e8b53-ff0e-48be-848f-32dfa12f6fb6): created successfully Jun 24 05:08:59 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a42e7e9d-a8c0-4cb5-825a-fb1f7e210963 tempest-AttachVolumeNegativeTest-111486486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6b10d30-7aa0-4c53-b3f9-9bbdd844925a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:08:59 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a42e7e9d-a8c0-4cb5-825a-fb1f7e210963 tempest-AttachVolumeNegativeTest-111486486 None] Flow 'volume_create_manager' (2d2a8413-f6ce-43be-82e3-7d4264092f47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:08:59 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-a42e7e9d-a8c0-4cb5-825a-fb1f7e210963 tempest-AttachVolumeNegativeTest-111486486 None] Created volume successfully. Jun 24 05:09:01 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-cb4a4832-e01e-414d-a9e1-4729ff24fe91 req-ac08245a-3e81-424b-99f5-c0c71719a2fa tempest-TestStampPattern-152240646 None] Terminate volume connection completed successfully. Jun 24 05:09:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-cb4a4832-e01e-414d-a9e1-4729ff24fe91 req-ac08245a-3e81-424b-99f5-c0c71719a2fa tempest-TestStampPattern-152240646 None] Deleting attachment c8fc8d42-a14b-4435-ae15-5a163477558c. {{(pid=93830) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 05:09:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-d3dda3dc-54e5-43d7-a648-3552401ccc99 req-362e61c1-d17d-4386-b02b-3e39283996cf tempest-AttachVolumeNegativeTest-111486486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:09:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-d3dda3dc-54e5-43d7-a648-3552401ccc99 req-362e61c1-d17d-4386-b02b-3e39283996cf tempest-AttachVolumeNegativeTest-111486486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:09:03 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[853c7f26-945f-4e3a-9fa0-c3a917ccd1ef]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:09:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-d3dda3dc-54e5-43d7-a648-3552401ccc99 req-362e61c1-d17d-4386-b02b-3e39283996cf tempest-AttachVolumeNegativeTest-111486486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-dc4e8b53-ff0e-48be-848f-32dfa12f6fb6 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:09:03 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-dc4e8b53-ff0e-48be-848f-32dfa12f6fb6 Jun 24 05:09:03 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:09:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-290fdd5d-d046-40a6-93af-b3b57f46469b req-f2a66ed8-f5e0-46d5-86ab-93b92738762b tempest-TestInstancesWithCinderVolumes-1434125260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:09:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-80257346-b3a5-4915-a575-69af8762a9de tempest-TestStampPattern-152240646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:09:04 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Jun 24 05:09:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-d3dda3dc-54e5-43d7-a648-3552401ccc99 req-362e61c1-d17d-4386-b02b-3e39283996cf tempest-AttachVolumeNegativeTest-111486486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-dc4e8b53-ff0e-48be-848f-32dfa12f6fb6" returned: 0 in 0.940s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:09:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-d3dda3dc-54e5-43d7-a648-3552401ccc99 req-362e61c1-d17d-4386-b02b-3e39283996cf tempest-AttachVolumeNegativeTest-111486486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.964s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:09:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-290fdd5d-d046-40a6-93af-b3b57f46469b req-f2a66ed8-f5e0-46d5-86ab-93b92738762b tempest-TestInstancesWithCinderVolumes-1434125260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.406s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:09:04 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-d3dda3dc-54e5-43d7-a648-3552401ccc99 req-362e61c1-d17d-4386-b02b-3e39283996cf tempest-AttachVolumeNegativeTest-111486486 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05', 'name': 'volume-dc4e8b53-ff0e-48be-848f-32dfa12f6fb6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0085472a-c785-4375-adc5-64376f85b321', 'enforce_multipath': True} {{(pid=93830) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 05:09:04 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[033a3a0d-e3b4-4860-aea2-d2ac027549ef]: (4, 'raw') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:09:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-290fdd5d-d046-40a6-93af-b3b57f46469b req-f2a66ed8-f5e0-46d5-86ab-93b92738762b tempest-TestInstancesWithCinderVolumes-1434125260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-435de2bf-d394-4aa9-86a9-a0c9765d13f3 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:09:04 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-d3dda3dc-54e5-43d7-a648-3552401ccc99 req-362e61c1-d17d-4386-b02b-3e39283996cf tempest-AttachVolumeNegativeTest-111486486 None] attachment_update completed successfully. Jun 24 05:09:04 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-435de2bf-d394-4aa9-86a9-a0c9765d13f3 Jun 24 05:09:04 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:09:05 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Jun 24 05:09:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-290fdd5d-d046-40a6-93af-b3b57f46469b req-f2a66ed8-f5e0-46d5-86ab-93b92738762b tempest-TestInstancesWithCinderVolumes-1434125260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-435de2bf-d394-4aa9-86a9-a0c9765d13f3" returned: 0 in 0.817s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:09:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-290fdd5d-d046-40a6-93af-b3b57f46469b req-f2a66ed8-f5e0-46d5-86ab-93b92738762b tempest-TestInstancesWithCinderVolumes-1434125260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-435de2bf-d394-4aa9-86a9-a0c9765d13f3 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:09:05 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-435de2bf-d394-4aa9-86a9-a0c9765d13f3 Jun 24 05:09:05 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:09:05 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Jun 24 05:09:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-290fdd5d-d046-40a6-93af-b3b57f46469b req-f2a66ed8-f5e0-46d5-86ab-93b92738762b tempest-TestInstancesWithCinderVolumes-1434125260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-435de2bf-d394-4aa9-86a9-a0c9765d13f3" returned: 1 in 0.781s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:09:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-290fdd5d-d046-40a6-93af-b3b57f46469b req-f2a66ed8-f5e0-46d5-86ab-93b92738762b tempest-TestInstancesWithCinderVolumes-1434125260 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-435de2bf-d394-4aa9-86a9-a0c9765d13f3' failed. Not Retrying. {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 05:09:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-290fdd5d-d046-40a6-93af-b3b57f46469b req-f2a66ed8-f5e0-46d5-86ab-93b92738762b tempest-TestInstancesWithCinderVolumes-1434125260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.661s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:09:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-80257346-b3a5-4915-a575-69af8762a9de tempest-TestStampPattern-152240646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.069s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:09:05 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-80257346-b3a5-4915-a575-69af8762a9de tempest-TestStampPattern-152240646 None] Creating offline snapshot 4fd1dc34-cdc5-4516-a335-271a2f775ae4 of volume 20fcf990-b55f-4270-9b50-10eacc6473db {{(pid=93830) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 05:09:05 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-290fdd5d-d046-40a6-93af-b3b57f46469b req-f2a66ed8-f5e0-46d5-86ab-93b92738762b tempest-TestInstancesWithCinderVolumes-1434125260 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05', 'name': 'volume-435de2bf-d394-4aa9-86a9-a0c9765d13f3', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '64086a8f-2559-44c9-956a-b5fdfd1f87d9', 'enforce_multipath': True} {{(pid=93830) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 05:09:05 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f89a05-901e-46c2-840c-9559ba05c823]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:09:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-80257346-b3a5-4915-a575-69af8762a9de tempest-TestStampPattern-152240646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:09:06 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-290fdd5d-d046-40a6-93af-b3b57f46469b req-f2a66ed8-f5e0-46d5-86ab-93b92738762b tempest-TestInstancesWithCinderVolumes-1434125260 None] attachment_update completed successfully. Jun 24 05:09:06 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db Jun 24 05:09:06 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:09:06 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Jun 24 05:09:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-80257346-b3a5-4915-a575-69af8762a9de tempest-TestStampPattern-152240646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db" returned: 0 in 0.821s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:09:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-80257346-b3a5-4915-a575-69af8762a9de tempest-TestStampPattern-152240646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db.4fd1dc34-cdc5-4516-a335-271a2f775ae4 1G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:09:06 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db.4fd1dc34-cdc5-4516-a335-271a2f775ae4 1G Jun 24 05:09:06 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:09:07 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Jun 24 05:09:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-80257346-b3a5-4915-a575-69af8762a9de tempest-TestStampPattern-152240646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db.4fd1dc34-cdc5-4516-a335-271a2f775ae4 1G" returned: 0 in 0.843s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:09:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-80257346-b3a5-4915-a575-69af8762a9de tempest-TestStampPattern-152240646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20fcf990-b55f-4270-9b50-10eacc6473db -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db.4fd1dc34-cdc5-4516-a335-271a2f775ae4 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:09:07 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20fcf990-b55f-4270-9b50-10eacc6473db -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db.4fd1dc34-cdc5-4516-a335-271a2f775ae4 Jun 24 05:09:07 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:09:08 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Jun 24 05:09:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-80257346-b3a5-4915-a575-69af8762a9de tempest-TestStampPattern-152240646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20fcf990-b55f-4270-9b50-10eacc6473db -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db.4fd1dc34-cdc5-4516-a335-271a2f775ae4" returned: 0 in 0.696s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:09:08 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-80257346-b3a5-4915-a575-69af8762a9de tempest-TestStampPattern-152240646 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db.4fd1dc34-cdc5-4516-a335-271a2f775ae4 is being set with open permissions: ugo+rw Jun 24 05:09:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-80257346-b3a5-4915-a575-69af8762a9de tempest-TestStampPattern-152240646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db.4fd1dc34-cdc5-4516-a335-271a2f775ae4 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:09:08 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db.4fd1dc34-cdc5-4516-a335-271a2f775ae4 Jun 24 05:09:08 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:09:08 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Jun 24 05:09:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-80257346-b3a5-4915-a575-69af8762a9de tempest-TestStampPattern-152240646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db.4fd1dc34-cdc5-4516-a335-271a2f775ae4" returned: 0 in 0.665s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:09:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-80257346-b3a5-4915-a575-69af8762a9de tempest-TestStampPattern-152240646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:09:09 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db.info Jun 24 05:09:09 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:09:09 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Jun 24 05:09:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-80257346-b3a5-4915-a575-69af8762a9de tempest-TestStampPattern-152240646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db.info" returned: 0 in 0.687s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:09:09 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-80257346-b3a5-4915-a575-69af8762a9de tempest-TestStampPattern-152240646 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db.info is being set with open permissions: ugo+rw Jun 24 05:09:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-80257346-b3a5-4915-a575-69af8762a9de tempest-TestStampPattern-152240646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:09:09 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db.info Jun 24 05:09:09 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:09:09 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 05:09:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:09:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:09:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:09:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:09:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:09:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:09:09 devstack sudo[106916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:09:09 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:09:10 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Jun 24 05:09:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-80257346-b3a5-4915-a575-69af8762a9de tempest-TestStampPattern-152240646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db.info" returned: 0 in 0.667s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:09:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-80257346-b3a5-4915-a575-69af8762a9de tempest-TestStampPattern-152240646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.492s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:09:10 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-80257346-b3a5-4915-a575-69af8762a9de tempest-TestStampPattern-152240646 None] Create snapshot completed successfully Jun 24 05:09:10 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root Jun 24 05:09:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.703s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:09:10 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:09:10 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager._thread_info {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 05:09:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread count: 29 {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 05:09:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread info: [<_MainThread(MainThread, started 130211312517248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 05:09:11 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-b7f15980-61ee-4ed3-bf41-1e166ad023b9 req-cbaff3fb-b019-4087-aac6-51e5469e0857 tempest-AttachVolumeNegativeTest-111486486 None] Terminate volume connection completed successfully. Jun 24 05:09:11 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-b7f15980-61ee-4ed3-bf41-1e166ad023b9 req-cbaff3fb-b019-4087-aac6-51e5469e0857 tempest-AttachVolumeNegativeTest-111486486 None] Deleting attachment 0085472a-c785-4375-adc5-64376f85b321. {{(pid=93830) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 05:09:21 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:UPDATE=5,cinder:SELECT=20 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:09:21 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:UPDATE=16,cinder:SELECT=24,cinder:INSERT=8,cinder:DELETE=2 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:09:22 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-cddee539-9e39-4c21-8cae-9068b22016e7 tempest-AttachVolumeNegativeTest-111486486 None] Acquiring lock "cinder-dc4e8b53-ff0e-48be-848f-32dfa12f6fb6-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:09:22 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-cddee539-9e39-4c21-8cae-9068b22016e7 tempest-AttachVolumeNegativeTest-111486486 None] Lock "cinder-dc4e8b53-ff0e-48be-848f-32dfa12f6fb6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:09:22 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-cddee539-9e39-4c21-8cae-9068b22016e7 tempest-AttachVolumeNegativeTest-111486486 None] Acquiring lock "cinder-quobyte-dc4e8b53-ff0e-48be-848f-32dfa12f6fb6" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:09:22 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-cddee539-9e39-4c21-8cae-9068b22016e7 tempest-AttachVolumeNegativeTest-111486486 None] Lock "cinder-quobyte-dc4e8b53-ff0e-48be-848f-32dfa12f6fb6" acquired by "delete_volume" :: waited 0.016s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:09:22 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[092903f5-7269-494a-ae03-da8bbd5b7180]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:09:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-cddee539-9e39-4c21-8cae-9068b22016e7 tempest-AttachVolumeNegativeTest-111486486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-dc4e8b53-ff0e-48be-848f-32dfa12f6fb6 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:09:22 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-dc4e8b53-ff0e-48be-848f-32dfa12f6fb6 Jun 24 05:09:22 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:09:23 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Jun 24 05:09:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-cddee539-9e39-4c21-8cae-9068b22016e7 tempest-AttachVolumeNegativeTest-111486486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-dc4e8b53-ff0e-48be-848f-32dfa12f6fb6" returned: 0 in 1.053s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:09:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-cddee539-9e39-4c21-8cae-9068b22016e7 tempest-AttachVolumeNegativeTest-111486486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-dc4e8b53-ff0e-48be-848f-32dfa12f6fb6 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:09:23 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-dc4e8b53-ff0e-48be-848f-32dfa12f6fb6 Jun 24 05:09:23 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:09:23 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:09:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Flow 'volume_create_manager' (1dd83348-cd42-4b2c-88be-9e0096f72618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:09:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b07a06ce-086e-41bb-8ff9-068e0e32bb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:09:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b07a06ce-086e-41bb-8ff9-068e0e32bb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-286794982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a6bc804-759b-45dd-a3c1-ea242ab133b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3edefa52f08d4edb9df68993f7c1478e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4fd1dc34-cdc5-4516-a335-271a2f775ae4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:09:24Z,use_quota=True,user_id='8b7e1d708db64b5fab370ae554d3eb7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:09:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c573b029-178f-4464-84ea-886166d5554b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:09:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c573b029-178f-4464-84ea-886166d5554b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:09:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5886e97-943b-4dd1-b9b5-e3da2b120bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:09:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5886e97-943b-4dd1-b9b5-e3da2b120bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1a6bc804-759b-45dd-a3c1-ea242ab133b9', 'volume_name': 'volume-1a6bc804-759b-45dd-a3c1-ea242ab133b9', 'volume_size': 1, 'snapshot_id': '4fd1dc34-cdc5-4516-a335-271a2f775ae4'}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:09:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c1af59b-0bf5-4969-8802-6b26289f659d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:09:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c1af59b-0bf5-4969-8802-6b26289f659d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:09:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbc33709-12fb-476c-a10d-615573dcecd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:09:24 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Volume 1a6bc804-759b-45dd-a3c1-ea242ab133b9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1a6bc804-759b-45dd-a3c1-ea242ab133b9', 'volume_size': 1, 'snapshot_id': '4fd1dc34-cdc5-4516-a335-271a2f775ae4'} Jun 24 05:09:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:09:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:09:24 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Acquiring lock "cinder-quobyte-4fd1dc34-cdc5-4516-a335-271a2f775ae4-1a6bc804-759b-45dd-a3c1-ea242ab133b9" by "_create_volume_from_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:09:24 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Lock "cinder-quobyte-4fd1dc34-cdc5-4516-a335-271a2f775ae4-1a6bc804-759b-45dd-a3c1-ea242ab133b9" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:09:24 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Creating volume 1a6bc804-759b-45dd-a3c1-ea242ab133b9 from snapshot 4fd1dc34-cdc5-4516-a335-271a2f775ae4 {{(pid=93830) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 24 05:09:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:09:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:09:24 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:09:24 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:09:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:09:24 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:09:24 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Acquiring lock "cinder-quobyte-1a6bc804-759b-45dd-a3c1-ea242ab133b9" by "_copy_volume_from_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:09:24 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Lock "cinder-quobyte-1a6bc804-759b-45dd-a3c1-ea242ab133b9" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:09:24 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] snapshot: 4fd1dc34-cdc5-4516-a335-271a2f775ae4, volume: 1a6bc804-759b-45dd-a3c1-ea242ab133b9, {{(pid=93830) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 05:09:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:09:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:09:24 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:09:24 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:09:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:09:24 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a5434e-9cb0-488c-8c31-30300acb8e55]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:09:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db.4fd1dc34-cdc5-4516-a335-271a2f775ae4 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:09:24 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db.4fd1dc34-cdc5-4516-a335-271a2f775ae4 Jun 24 05:09:24 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:09:24 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Jun 24 05:09:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-cddee539-9e39-4c21-8cae-9068b22016e7 tempest-AttachVolumeNegativeTest-111486486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-dc4e8b53-ff0e-48be-848f-32dfa12f6fb6" returned: 0 in 0.966s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:09:24 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-cddee539-9e39-4c21-8cae-9068b22016e7 tempest-AttachVolumeNegativeTest-111486486 None] Lock "cinder-quobyte-dc4e8b53-ff0e-48be-848f-32dfa12f6fb6" released by "delete_volume" :: held 2.114s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:09:24 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-cddee539-9e39-4c21-8cae-9068b22016e7 tempest-AttachVolumeNegativeTest-111486486 None] Created reservations ['679b8117-fc43-45bc-928f-82d9c1c540b8', 'd0ed2b26-3bdf-445c-afe3-729026df2d56', 'c4fcfa7c-ca2e-4ab9-832a-a8d7b9875452', '20d4841a-de61-456c-bd41-b990f84d4db9'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:09:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-cddee539-9e39-4c21-8cae-9068b22016e7 tempest-AttachVolumeNegativeTest-111486486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:09:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-cddee539-9e39-4c21-8cae-9068b22016e7 tempest-AttachVolumeNegativeTest-111486486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:09:24 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-cddee539-9e39-4c21-8cae-9068b22016e7 tempest-AttachVolumeNegativeTest-111486486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:09:24 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-cddee539-9e39-4c21-8cae-9068b22016e7 tempest-AttachVolumeNegativeTest-111486486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:09:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-cddee539-9e39-4c21-8cae-9068b22016e7 tempest-AttachVolumeNegativeTest-111486486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:09:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-cddee539-9e39-4c21-8cae-9068b22016e7 tempest-AttachVolumeNegativeTest-111486486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:09:25 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:09:25 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:09:25 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f56a18a7-b3a7-4293-8bc4-3140f4ae2595 tempest-AttachVolumeNegativeTest-111486486 None] Acquiring lock "cinder-098558f2-a68d-49f2-b1c9-182efab3f15b-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:09:25 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f56a18a7-b3a7-4293-8bc4-3140f4ae2595 tempest-AttachVolumeNegativeTest-111486486 None] Lock "cinder-098558f2-a68d-49f2-b1c9-182efab3f15b-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:09:25 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f56a18a7-b3a7-4293-8bc4-3140f4ae2595 tempest-AttachVolumeNegativeTest-111486486 None] Acquiring lock "cinder-quobyte-098558f2-a68d-49f2-b1c9-182efab3f15b" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:09:25 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f56a18a7-b3a7-4293-8bc4-3140f4ae2595 tempest-AttachVolumeNegativeTest-111486486 None] Lock "cinder-quobyte-098558f2-a68d-49f2-b1c9-182efab3f15b" acquired by "delete_volume" :: waited 0.039s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:09:25 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Jun 24 05:09:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db.4fd1dc34-cdc5-4516-a335-271a2f775ae4" returned: 0 in 1.241s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:09:25 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20fcf990-b55f-4270-9b50-10eacc6473db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:09:25 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db {{(pid=93830) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 05:09:25 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Creating direct copy from snapshot {{(pid=93830) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 05:09:25 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e00e719-08aa-41f5-b761-8c531df4f6fd]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:09:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f56a18a7-b3a7-4293-8bc4-3140f4ae2595 tempest-AttachVolumeNegativeTest-111486486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-098558f2-a68d-49f2-b1c9-182efab3f15b {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:09:25 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb32fc78-0856-4280-b231-6607f9977e88]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:09:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:09:25 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-098558f2-a68d-49f2-b1c9-182efab3f15b Jun 24 05:09:25 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:09:25 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db Jun 24 05:09:25 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:09:26 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Jun 24 05:09:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-cddee539-9e39-4c21-8cae-9068b22016e7 tempest-AttachVolumeNegativeTest-111486486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 1.016s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:09:26 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-cddee539-9e39-4c21-8cae-9068b22016e7 tempest-AttachVolumeNegativeTest-111486486 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:09:26 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-cddee539-9e39-4c21-8cae-9068b22016e7 tempest-AttachVolumeNegativeTest-111486486 None] Deleted volume successfully. Jun 24 05:09:26 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-cddee539-9e39-4c21-8cae-9068b22016e7 tempest-AttachVolumeNegativeTest-111486486 None] Lock "cinder-dc4e8b53-ff0e-48be-848f-32dfa12f6fb6-delete_volume" released by "delete_volume" :: held 3.471s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:09:26 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Jun 24 05:09:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f56a18a7-b3a7-4293-8bc4-3140f4ae2595 tempest-AttachVolumeNegativeTest-111486486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-098558f2-a68d-49f2-b1c9-182efab3f15b" returned: 0 in 1.054s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:09:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f56a18a7-b3a7-4293-8bc4-3140f4ae2595 tempest-AttachVolumeNegativeTest-111486486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-098558f2-a68d-49f2-b1c9-182efab3f15b {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:09:26 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-098558f2-a68d-49f2-b1c9-182efab3f15b Jun 24 05:09:26 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Jun 24 05:09:26 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:09:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db" returned: 0 in 1.071s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:09:26 devstack cinder-volume[93830]: DEBUG cinder.utils [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Path /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-1a6bc804-759b-45dd-a3c1-ea242ab133b9 not found in is_blk_device check {{(pid=93830) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 05:09:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-1a6bc804-759b-45dd-a3c1-ea242ab133b9 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:09:26 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-1a6bc804-759b-45dd-a3c1-ea242ab133b9 Jun 24 05:09:26 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:09:27 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Jun 24 05:09:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f56a18a7-b3a7-4293-8bc4-3140f4ae2595 tempest-AttachVolumeNegativeTest-111486486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-098558f2-a68d-49f2-b1c9-182efab3f15b" returned: 0 in 0.722s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:09:27 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f56a18a7-b3a7-4293-8bc4-3140f4ae2595 tempest-AttachVolumeNegativeTest-111486486 None] Lock "cinder-quobyte-098558f2-a68d-49f2-b1c9-182efab3f15b" released by "delete_volume" :: held 1.861s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:09:27 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-f56a18a7-b3a7-4293-8bc4-3140f4ae2595 tempest-AttachVolumeNegativeTest-111486486 None] Created reservations ['6339cdfe-c8b6-4159-8645-b5a2e3f644f9', 'df6950bd-2457-4971-beca-18c788bcc088', 'b055b93d-1ec8-480c-ac3a-4e6d4f05a65d', 'e7341f5b-a248-48a5-8dce-bbe4a659f01c'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:09:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f56a18a7-b3a7-4293-8bc4-3140f4ae2595 tempest-AttachVolumeNegativeTest-111486486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:09:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f56a18a7-b3a7-4293-8bc4-3140f4ae2595 tempest-AttachVolumeNegativeTest-111486486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:09:27 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f56a18a7-b3a7-4293-8bc4-3140f4ae2595 tempest-AttachVolumeNegativeTest-111486486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:09:27 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f56a18a7-b3a7-4293-8bc4-3140f4ae2595 tempest-AttachVolumeNegativeTest-111486486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:09:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f56a18a7-b3a7-4293-8bc4-3140f4ae2595 tempest-AttachVolumeNegativeTest-111486486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:09:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f56a18a7-b3a7-4293-8bc4-3140f4ae2595 tempest-AttachVolumeNegativeTest-111486486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:09:27 devstack sudo[107164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:09:27 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:09:28 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e2e61c96-32f3-4966-ac96-ccc418e7ed6e tempest-AttachVolumeNegativeTest-111486486 None] Acquiring lock "cinder-5cdb0dac-f29e-4078-b34e-3795072f4fd8-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:09:28 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e2e61c96-32f3-4966-ac96-ccc418e7ed6e tempest-AttachVolumeNegativeTest-111486486 None] Lock "cinder-5cdb0dac-f29e-4078-b34e-3795072f4fd8-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:09:28 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e2e61c96-32f3-4966-ac96-ccc418e7ed6e tempest-AttachVolumeNegativeTest-111486486 None] Acquiring lock "cinder-quobyte-5cdb0dac-f29e-4078-b34e-3795072f4fd8" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:09:28 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e2e61c96-32f3-4966-ac96-ccc418e7ed6e tempest-AttachVolumeNegativeTest-111486486 None] Lock "cinder-quobyte-5cdb0dac-f29e-4078-b34e-3795072f4fd8" acquired by "delete_volume" :: waited 0.056s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:09:28 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2980420-4c88-476d-baaf-1c2bd00b979a]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:09:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e2e61c96-32f3-4966-ac96-ccc418e7ed6e tempest-AttachVolumeNegativeTest-111486486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-5cdb0dac-f29e-4078-b34e-3795072f4fd8 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:09:28 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-5cdb0dac-f29e-4078-b34e-3795072f4fd8 Jun 24 05:09:28 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:09:29 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root Jun 24 05:09:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f56a18a7-b3a7-4293-8bc4-3140f4ae2595 tempest-AttachVolumeNegativeTest-111486486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 1.969s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:09:29 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-f56a18a7-b3a7-4293-8bc4-3140f4ae2595 tempest-AttachVolumeNegativeTest-111486486 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:09:29 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-f56a18a7-b3a7-4293-8bc4-3140f4ae2595 tempest-AttachVolumeNegativeTest-111486486 None] Deleted volume successfully. Jun 24 05:09:29 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f56a18a7-b3a7-4293-8bc4-3140f4ae2595 tempest-AttachVolumeNegativeTest-111486486 None] Lock "cinder-098558f2-a68d-49f2-b1c9-182efab3f15b-delete_volume" released by "delete_volume" :: held 4.299s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:09:30 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Jun 24 05:09:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e2e61c96-32f3-4966-ac96-ccc418e7ed6e tempest-AttachVolumeNegativeTest-111486486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-5cdb0dac-f29e-4078-b34e-3795072f4fd8" returned: 0 in 1.841s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:09:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e2e61c96-32f3-4966-ac96-ccc418e7ed6e tempest-AttachVolumeNegativeTest-111486486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-5cdb0dac-f29e-4078-b34e-3795072f4fd8 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:09:30 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-5cdb0dac-f29e-4078-b34e-3795072f4fd8 Jun 24 05:09:30 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:09:32 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Jun 24 05:09:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e2e61c96-32f3-4966-ac96-ccc418e7ed6e tempest-AttachVolumeNegativeTest-111486486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-5cdb0dac-f29e-4078-b34e-3795072f4fd8" returned: 0 in 1.925s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:09:32 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e2e61c96-32f3-4966-ac96-ccc418e7ed6e tempest-AttachVolumeNegativeTest-111486486 None] Lock "cinder-quobyte-5cdb0dac-f29e-4078-b34e-3795072f4fd8" released by "delete_volume" :: held 3.890s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:09:32 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-e2e61c96-32f3-4966-ac96-ccc418e7ed6e tempest-AttachVolumeNegativeTest-111486486 None] Created reservations ['3998ba71-826c-4691-8bef-93af9e05f221', 'b553f01a-b80e-4379-8e2b-b43d35704dcc', '9e3caa74-96cb-40b1-9124-0451d99c3f18', 'cf41d810-2452-4cdb-8495-dbe2054ae8da'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:09:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e2e61c96-32f3-4966-ac96-ccc418e7ed6e tempest-AttachVolumeNegativeTest-111486486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:09:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e2e61c96-32f3-4966-ac96-ccc418e7ed6e tempest-AttachVolumeNegativeTest-111486486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:09:32 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e2e61c96-32f3-4966-ac96-ccc418e7ed6e tempest-AttachVolumeNegativeTest-111486486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:09:32 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e2e61c96-32f3-4966-ac96-ccc418e7ed6e tempest-AttachVolumeNegativeTest-111486486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:09:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e2e61c96-32f3-4966-ac96-ccc418e7ed6e tempest-AttachVolumeNegativeTest-111486486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:09:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e2e61c96-32f3-4966-ac96-ccc418e7ed6e tempest-AttachVolumeNegativeTest-111486486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:09:32 devstack sudo[107307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:09:32 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:09:33 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root Jun 24 05:09:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e2e61c96-32f3-4966-ac96-ccc418e7ed6e tempest-AttachVolumeNegativeTest-111486486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 1.194s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:09:33 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-e2e61c96-32f3-4966-ac96-ccc418e7ed6e tempest-AttachVolumeNegativeTest-111486486 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:09:33 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-e2e61c96-32f3-4966-ac96-ccc418e7ed6e tempest-AttachVolumeNegativeTest-111486486 None] Deleted volume successfully. Jun 24 05:09:33 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e2e61c96-32f3-4966-ac96-ccc418e7ed6e tempest-AttachVolumeNegativeTest-111486486 None] Lock "cinder-5cdb0dac-f29e-4078-b34e-3795072f4fd8-delete_volume" released by "delete_volume" :: held 5.702s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:09:33 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Jun 24 05:09:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-1a6bc804-759b-45dd-a3c1-ea242ab133b9" returned: 0 in 7.307s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:09:33 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[089f07fe-f35e-4394-9e52-c9c7a576afd7]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:09:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:09:34 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db Jun 24 05:09:34 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:09:35 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Jun 24 05:09:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db" returned: 0 in 1.073s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:09:35 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Image conversion details: src /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db, size 1024.00 MB, duration 7.31 sec, destination /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-1a6bc804-759b-45dd-a3c1-ea242ab133b9 {{(pid=93830) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 05:09:35 devstack cinder-volume[93830]: INFO cinder.image.image_utils [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Converted 1024.00 MB image at 140.13 MB/s Jun 24 05:09:35 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-1a6bc804-759b-45dd-a3c1-ea242ab133b9 is being set with open permissions: ugo+rw Jun 24 05:09:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-1a6bc804-759b-45dd-a3c1-ea242ab133b9 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:09:35 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-1a6bc804-759b-45dd-a3c1-ea242ab133b9 Jun 24 05:09:35 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:09:35 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Jun 24 05:09:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-1a6bc804-759b-45dd-a3c1-ea242ab133b9" returned: 0 in 0.824s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:09:35 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Lock "cinder-quobyte-1a6bc804-759b-45dd-a3c1-ea242ab133b9" released by "_copy_volume_from_snapshot" :: held 11.684s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:09:35 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Lock "cinder-quobyte-4fd1dc34-cdc5-4516-a335-271a2f775ae4-1a6bc804-759b-45dd-a3c1-ea242ab133b9" released by "_create_volume_from_snapshot" :: held 11.738s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:09:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.770s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:09:35 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbc33709-12fb-476c-a10d-615573dcecd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a6bc804-759b-45dd-a3c1-ea242ab133b9', 'volume_size': 1, 'snapshot_id': '4fd1dc34-cdc5-4516-a335-271a2f775ae4'}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:09:35 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24c642fb-0832-41ed-ba27-da5d99358ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:09:35 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Volume volume-1a6bc804-759b-45dd-a3c1-ea242ab133b9 (1a6bc804-759b-45dd-a3c1-ea242ab133b9): created successfully Jun 24 05:09:35 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24c642fb-0832-41ed-ba27-da5d99358ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:09:35 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Flow 'volume_create_manager' (1dd83348-cd42-4b2c-88be-9e0096f72618) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:09:35 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-dcf0ecc2-59b6-4e63-96c4-1461b24cc00e tempest-TestStampPattern-152240646 None] Created volume successfully. Jun 24 05:09:41 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [req-cec9a8f2-9aaa-47d8-9468-e1ef8d001e5b req-dfaf1330-c6aa-49cf-8899-899536399f89 tempest-VolumesSnapshotsTestJSON-1500356696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:09:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-cec9a8f2-9aaa-47d8-9468-e1ef8d001e5b req-dfaf1330-c6aa-49cf-8899-899536399f89 tempest-VolumesSnapshotsTestJSON-1500356696 None] Flow 'volume_create_manager' (fa7ab5b1-ced0-4b27-962c-8cd4b3a7eb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:09:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-cec9a8f2-9aaa-47d8-9468-e1ef8d001e5b req-dfaf1330-c6aa-49cf-8899-899536399f89 tempest-VolumesSnapshotsTestJSON-1500356696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59cfc828-3a4d-42d5-b03d-fc383ca65f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:09:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-cec9a8f2-9aaa-47d8-9468-e1ef8d001e5b req-dfaf1330-c6aa-49cf-8899-899536399f89 tempest-VolumesSnapshotsTestJSON-1500356696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59cfc828-3a4d-42d5-b03d-fc383ca65f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-391618704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac1eec919cd14a20b6d85c593b4fc629',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:09:42Z,use_quota=True,user_id='7955b640b903409697b63c913a637e58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:09:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-cec9a8f2-9aaa-47d8-9468-e1ef8d001e5b req-dfaf1330-c6aa-49cf-8899-899536399f89 tempest-VolumesSnapshotsTestJSON-1500356696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfcdab21-522d-4337-a5b0-dad32ead724d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:09:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-cec9a8f2-9aaa-47d8-9468-e1ef8d001e5b req-dfaf1330-c6aa-49cf-8899-899536399f89 tempest-VolumesSnapshotsTestJSON-1500356696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfcdab21-522d-4337-a5b0-dad32ead724d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:09:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-cec9a8f2-9aaa-47d8-9468-e1ef8d001e5b req-dfaf1330-c6aa-49cf-8899-899536399f89 tempest-VolumesSnapshotsTestJSON-1500356696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cea484d9-46f6-4438-8ec2-2268a89a67cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:09:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-cec9a8f2-9aaa-47d8-9468-e1ef8d001e5b req-dfaf1330-c6aa-49cf-8899-899536399f89 tempest-VolumesSnapshotsTestJSON-1500356696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cea484d9-46f6-4438-8ec2-2268a89a67cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94', 'volume_name': 'volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:09:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-cec9a8f2-9aaa-47d8-9468-e1ef8d001e5b req-dfaf1330-c6aa-49cf-8899-899536399f89 tempest-VolumesSnapshotsTestJSON-1500356696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c994158f-b40f-47da-82a9-f137896b8fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:09:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-cec9a8f2-9aaa-47d8-9468-e1ef8d001e5b req-dfaf1330-c6aa-49cf-8899-899536399f89 tempest-VolumesSnapshotsTestJSON-1500356696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c994158f-b40f-47da-82a9-f137896b8fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:09:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-cec9a8f2-9aaa-47d8-9468-e1ef8d001e5b req-dfaf1330-c6aa-49cf-8899-899536399f89 tempest-VolumesSnapshotsTestJSON-1500356696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27a24759-fe4c-4ae0-8e88-abc8379467e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:09:41 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [req-cec9a8f2-9aaa-47d8-9468-e1ef8d001e5b req-dfaf1330-c6aa-49cf-8899-899536399f89 tempest-VolumesSnapshotsTestJSON-1500356696 None] Volume 71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94', 'volume_size': 1} Jun 24 05:09:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-cec9a8f2-9aaa-47d8-9468-e1ef8d001e5b req-dfaf1330-c6aa-49cf-8899-899536399f89 tempest-VolumesSnapshotsTestJSON-1500356696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:09:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-cec9a8f2-9aaa-47d8-9468-e1ef8d001e5b req-dfaf1330-c6aa-49cf-8899-899536399f89 tempest-VolumesSnapshotsTestJSON-1500356696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:09:41 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [req-cec9a8f2-9aaa-47d8-9468-e1ef8d001e5b req-dfaf1330-c6aa-49cf-8899-899536399f89 tempest-VolumesSnapshotsTestJSON-1500356696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-391618704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac1eec919cd14a20b6d85c593b4fc629',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:09:42Z,use_quota=True,user_id='7955b640b903409697b63c913a637e58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:09:41 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [req-cec9a8f2-9aaa-47d8-9468-e1ef8d001e5b req-dfaf1330-c6aa-49cf-8899-899536399f89 tempest-VolumesSnapshotsTestJSON-1500356696 None] Creating volume 71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:09:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-cec9a8f2-9aaa-47d8-9468-e1ef8d001e5b req-dfaf1330-c6aa-49cf-8899-899536399f89 tempest-VolumesSnapshotsTestJSON-1500356696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:09:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-cec9a8f2-9aaa-47d8-9468-e1ef8d001e5b req-dfaf1330-c6aa-49cf-8899-899536399f89 tempest-VolumesSnapshotsTestJSON-1500356696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:09:41 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [req-cec9a8f2-9aaa-47d8-9468-e1ef8d001e5b req-dfaf1330-c6aa-49cf-8899-899536399f89 tempest-VolumesSnapshotsTestJSON-1500356696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:09:41 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [req-cec9a8f2-9aaa-47d8-9468-e1ef8d001e5b req-dfaf1330-c6aa-49cf-8899-899536399f89 tempest-VolumesSnapshotsTestJSON-1500356696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:09:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-cec9a8f2-9aaa-47d8-9468-e1ef8d001e5b req-dfaf1330-c6aa-49cf-8899-899536399f89 tempest-VolumesSnapshotsTestJSON-1500356696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:09:41 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [req-cec9a8f2-9aaa-47d8-9468-e1ef8d001e5b req-dfaf1330-c6aa-49cf-8899-899536399f89 tempest-VolumesSnapshotsTestJSON-1500356696 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:09:41 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [req-cec9a8f2-9aaa-47d8-9468-e1ef8d001e5b req-dfaf1330-c6aa-49cf-8899-899536399f89 tempest-VolumesSnapshotsTestJSON-1500356696 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:09:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-cec9a8f2-9aaa-47d8-9468-e1ef8d001e5b req-dfaf1330-c6aa-49cf-8899-899536399f89 tempest-VolumesSnapshotsTestJSON-1500356696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:09:41 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94 1073741824 Jun 24 05:09:41 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:09:42 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Jun 24 05:09:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-cec9a8f2-9aaa-47d8-9468-e1ef8d001e5b req-dfaf1330-c6aa-49cf-8899-899536399f89 tempest-VolumesSnapshotsTestJSON-1500356696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94 1073741824" returned: 0 in 1.044s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:09:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-cec9a8f2-9aaa-47d8-9468-e1ef8d001e5b req-dfaf1330-c6aa-49cf-8899-899536399f89 tempest-VolumesSnapshotsTestJSON-1500356696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:09:42 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94 Jun 24 05:09:42 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:09:43 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Jun 24 05:09:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-cec9a8f2-9aaa-47d8-9468-e1ef8d001e5b req-dfaf1330-c6aa-49cf-8899-899536399f89 tempest-VolumesSnapshotsTestJSON-1500356696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94" returned: 0 in 0.748s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:09:43 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [req-cec9a8f2-9aaa-47d8-9468-e1ef8d001e5b req-dfaf1330-c6aa-49cf-8899-899536399f89 tempest-VolumesSnapshotsTestJSON-1500356696 None] <== create_volume: return (1842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:09:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-cec9a8f2-9aaa-47d8-9468-e1ef8d001e5b req-dfaf1330-c6aa-49cf-8899-899536399f89 tempest-VolumesSnapshotsTestJSON-1500356696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.845s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:09:43 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-cec9a8f2-9aaa-47d8-9468-e1ef8d001e5b req-dfaf1330-c6aa-49cf-8899-899536399f89 tempest-VolumesSnapshotsTestJSON-1500356696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27a24759-fe4c-4ae0-8e88-abc8379467e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:09:43 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-cec9a8f2-9aaa-47d8-9468-e1ef8d001e5b req-dfaf1330-c6aa-49cf-8899-899536399f89 tempest-VolumesSnapshotsTestJSON-1500356696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c8876a9-d1d4-4387-bf22-bb8fa2fc3524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:09:43 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [req-cec9a8f2-9aaa-47d8-9468-e1ef8d001e5b req-dfaf1330-c6aa-49cf-8899-899536399f89 tempest-VolumesSnapshotsTestJSON-1500356696 None] Volume volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94 (71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94): created successfully Jun 24 05:09:43 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-cec9a8f2-9aaa-47d8-9468-e1ef8d001e5b req-dfaf1330-c6aa-49cf-8899-899536399f89 tempest-VolumesSnapshotsTestJSON-1500356696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c8876a9-d1d4-4387-bf22-bb8fa2fc3524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:09:43 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-cec9a8f2-9aaa-47d8-9468-e1ef8d001e5b req-dfaf1330-c6aa-49cf-8899-899536399f89 tempest-VolumesSnapshotsTestJSON-1500356696 None] Flow 'volume_create_manager' (fa7ab5b1-ced0-4b27-962c-8cd4b3a7eb85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:09:43 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-cec9a8f2-9aaa-47d8-9468-e1ef8d001e5b req-dfaf1330-c6aa-49cf-8899-899536399f89 tempest-VolumesSnapshotsTestJSON-1500356696 None] Created volume successfully. Jun 24 05:09:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-b35e343f-08eb-416f-9d41-db633dac4e83 req-0bb52b8d-0027-4d72-b39c-3c61341b1453 tempest-VolumesSnapshotsTestJSON-1500356696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:09:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-b35e343f-08eb-416f-9d41-db633dac4e83 req-0bb52b8d-0027-4d72-b39c-3c61341b1453 tempest-VolumesSnapshotsTestJSON-1500356696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:09:44 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [req-b35e343f-08eb-416f-9d41-db633dac4e83 req-0bb52b8d-0027-4d72-b39c-3c61341b1453 tempest-VolumesSnapshotsTestJSON-1500356696 None] Creating offline snapshot 56a13d47-bcf5-4026-b119-9e718637f313 of volume 71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94 {{(pid=93830) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 05:09:44 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2c13fc-ff3b-4042-9ac0-96f2d3d897fe]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:09:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-b35e343f-08eb-416f-9d41-db633dac4e83 req-0bb52b8d-0027-4d72-b39c-3c61341b1453 tempest-VolumesSnapshotsTestJSON-1500356696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:09:44 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94 Jun 24 05:09:44 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:09:45 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Jun 24 05:09:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-b35e343f-08eb-416f-9d41-db633dac4e83 req-0bb52b8d-0027-4d72-b39c-3c61341b1453 tempest-VolumesSnapshotsTestJSON-1500356696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94" returned: 0 in 0.952s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:09:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-b35e343f-08eb-416f-9d41-db633dac4e83 req-0bb52b8d-0027-4d72-b39c-3c61341b1453 tempest-VolumesSnapshotsTestJSON-1500356696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94.56a13d47-bcf5-4026-b119-9e718637f313 1G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:09:45 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94.56a13d47-bcf5-4026-b119-9e718637f313 1G Jun 24 05:09:45 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:09:46 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Jun 24 05:09:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-b35e343f-08eb-416f-9d41-db633dac4e83 req-0bb52b8d-0027-4d72-b39c-3c61341b1453 tempest-VolumesSnapshotsTestJSON-1500356696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94.56a13d47-bcf5-4026-b119-9e718637f313 1G" returned: 0 in 1.107s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:09:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-b35e343f-08eb-416f-9d41-db633dac4e83 req-0bb52b8d-0027-4d72-b39c-3c61341b1453 tempest-VolumesSnapshotsTestJSON-1500356696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94.56a13d47-bcf5-4026-b119-9e718637f313 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:09:46 devstack sudo[107436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94.56a13d47-bcf5-4026-b119-9e718637f313 Jun 24 05:09:46 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:09:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-849addfd-00d9-4553-b093-e84f0d4dcb99 req-f1b62980-8ea8-4a47-981b-62b7b6af4757 tempest-TestInstancesWithCinderVolumes-1434125260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:09:47 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root Jun 24 05:09:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-b35e343f-08eb-416f-9d41-db633dac4e83 req-0bb52b8d-0027-4d72-b39c-3c61341b1453 tempest-VolumesSnapshotsTestJSON-1500356696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94.56a13d47-bcf5-4026-b119-9e718637f313" returned: 0 in 0.942s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:09:47 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [req-b35e343f-08eb-416f-9d41-db633dac4e83 req-0bb52b8d-0027-4d72-b39c-3c61341b1453 tempest-VolumesSnapshotsTestJSON-1500356696 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94.56a13d47-bcf5-4026-b119-9e718637f313 is being set with open permissions: ugo+rw Jun 24 05:09:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-b35e343f-08eb-416f-9d41-db633dac4e83 req-0bb52b8d-0027-4d72-b39c-3c61341b1453 tempest-VolumesSnapshotsTestJSON-1500356696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94.56a13d47-bcf5-4026-b119-9e718637f313 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:09:47 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94.56a13d47-bcf5-4026-b119-9e718637f313 Jun 24 05:09:47 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:09:47 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Jun 24 05:09:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-b35e343f-08eb-416f-9d41-db633dac4e83 req-0bb52b8d-0027-4d72-b39c-3c61341b1453 tempest-VolumesSnapshotsTestJSON-1500356696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94.56a13d47-bcf5-4026-b119-9e718637f313" returned: 0 in 0.731s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:09:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-b35e343f-08eb-416f-9d41-db633dac4e83 req-0bb52b8d-0027-4d72-b39c-3c61341b1453 tempest-VolumesSnapshotsTestJSON-1500356696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:09:47 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94.info Jun 24 05:09:47 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:09:48 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Jun 24 05:09:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-b35e343f-08eb-416f-9d41-db633dac4e83 req-0bb52b8d-0027-4d72-b39c-3c61341b1453 tempest-VolumesSnapshotsTestJSON-1500356696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94.info" returned: 0 in 0.693s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:09:48 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [req-b35e343f-08eb-416f-9d41-db633dac4e83 req-0bb52b8d-0027-4d72-b39c-3c61341b1453 tempest-VolumesSnapshotsTestJSON-1500356696 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94.info is being set with open permissions: ugo+rw Jun 24 05:09:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-b35e343f-08eb-416f-9d41-db633dac4e83 req-0bb52b8d-0027-4d72-b39c-3c61341b1453 tempest-VolumesSnapshotsTestJSON-1500356696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:09:48 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94.info Jun 24 05:09:48 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:09:49 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Jun 24 05:09:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-b35e343f-08eb-416f-9d41-db633dac4e83 req-0bb52b8d-0027-4d72-b39c-3c61341b1453 tempest-VolumesSnapshotsTestJSON-1500356696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94.info" returned: 0 in 0.642s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:09:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-b35e343f-08eb-416f-9d41-db633dac4e83 req-0bb52b8d-0027-4d72-b39c-3c61341b1453 tempest-VolumesSnapshotsTestJSON-1500356696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.156s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:09:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-849addfd-00d9-4553-b093-e84f0d4dcb99 req-f1b62980-8ea8-4a47-981b-62b7b6af4757 tempest-TestInstancesWithCinderVolumes-1434125260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.703s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:09:49 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c3b4eb-8af7-4b98-a301-e9be12b02a5f]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:09:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-849addfd-00d9-4553-b093-e84f0d4dcb99 req-f1b62980-8ea8-4a47-981b-62b7b6af4757 tempest-TestInstancesWithCinderVolumes-1434125260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c24d74d3-a269-44d3-bcac-a96593a2b087 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:09:49 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-b35e343f-08eb-416f-9d41-db633dac4e83 req-0bb52b8d-0027-4d72-b39c-3c61341b1453 tempest-VolumesSnapshotsTestJSON-1500356696 None] Create snapshot completed successfully Jun 24 05:09:49 devstack sudo[107459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c24d74d3-a269-44d3-bcac-a96593a2b087 Jun 24 05:09:49 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:09:49 devstack cinder-volume[93830]: DEBUG cinder.coordination [req-aaeec5f8-d2c8-470a-96fa-ffa36fd34a05 req-a472ac73-237f-4188-9d50-b280b59a9918 tempest-VolumesSnapshotsTestJSON-1500356696 None] Acquiring lock "cinder-56a13d47-bcf5-4026-b119-9e718637f313-delete_snapshot" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:09:49 devstack cinder-volume[93830]: DEBUG cinder.coordination [req-aaeec5f8-d2c8-470a-96fa-ffa36fd34a05 req-a472ac73-237f-4188-9d50-b280b59a9918 tempest-VolumesSnapshotsTestJSON-1500356696 None] Lock "cinder-56a13d47-bcf5-4026-b119-9e718637f313-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:09:49 devstack cinder-volume[93830]: DEBUG cinder.coordination [req-aaeec5f8-d2c8-470a-96fa-ffa36fd34a05 req-a472ac73-237f-4188-9d50-b280b59a9918 tempest-VolumesSnapshotsTestJSON-1500356696 None] Acquiring lock "cinder-quobyte-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:09:49 devstack cinder-volume[93830]: DEBUG cinder.coordination [req-aaeec5f8-d2c8-470a-96fa-ffa36fd34a05 req-a472ac73-237f-4188-9d50-b280b59a9918 tempest-VolumesSnapshotsTestJSON-1500356696 None] Lock "cinder-quobyte-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:09:49 devstack cinder-volume[93830]: DEBUG cinder.coordination [req-aaeec5f8-d2c8-470a-96fa-ffa36fd34a05 req-a472ac73-237f-4188-9d50-b280b59a9918 tempest-VolumesSnapshotsTestJSON-1500356696 None] Acquiring lock "cinder-quobyte-56a13d47-bcf5-4026-b119-9e718637f313" by "_delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:09:49 devstack cinder-volume[93830]: DEBUG cinder.coordination [req-aaeec5f8-d2c8-470a-96fa-ffa36fd34a05 req-a472ac73-237f-4188-9d50-b280b59a9918 tempest-VolumesSnapshotsTestJSON-1500356696 None] Lock "cinder-quobyte-56a13d47-bcf5-4026-b119-9e718637f313" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:09:49 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [req-aaeec5f8-d2c8-470a-96fa-ffa36fd34a05 req-a472ac73-237f-4188-9d50-b280b59a9918 tempest-VolumesSnapshotsTestJSON-1500356696 None] Deleting offline snapshot 56a13d47-bcf5-4026-b119-9e718637f313 of volume 71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94 {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 05:09:49 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [req-aaeec5f8-d2c8-470a-96fa-ffa36fd34a05 req-a472ac73-237f-4188-9d50-b280b59a9918 tempest-VolumesSnapshotsTestJSON-1500356696 None] snapshot_file for this snap is: volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94.56a13d47-bcf5-4026-b119-9e718637f313 {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 05:09:49 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[d828a0e8-6f0e-40ef-9800-2e5aaad2dd3b]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:09:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-aaeec5f8-d2c8-470a-96fa-ffa36fd34a05 req-a472ac73-237f-4188-9d50-b280b59a9918 tempest-VolumesSnapshotsTestJSON-1500356696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94.56a13d47-bcf5-4026-b119-9e718637f313 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:09:49 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94.56a13d47-bcf5-4026-b119-9e718637f313 Jun 24 05:09:49 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:09:50 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root Jun 24 05:09:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-849addfd-00d9-4553-b093-e84f0d4dcb99 req-f1b62980-8ea8-4a47-981b-62b7b6af4757 tempest-TestInstancesWithCinderVolumes-1434125260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c24d74d3-a269-44d3-bcac-a96593a2b087" returned: 0 in 0.786s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:09:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-849addfd-00d9-4553-b093-e84f0d4dcb99 req-f1b62980-8ea8-4a47-981b-62b7b6af4757 tempest-TestInstancesWithCinderVolumes-1434125260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.813s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:09:50 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-849addfd-00d9-4553-b093-e84f0d4dcb99 req-f1b62980-8ea8-4a47-981b-62b7b6af4757 tempest-TestInstancesWithCinderVolumes-1434125260 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05', 'name': 'volume-c24d74d3-a269-44d3-bcac-a96593a2b087', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '39c8844d-06d1-4d75-9087-b55b08e9c135', 'enforce_multipath': True} {{(pid=93830) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 05:09:50 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-849addfd-00d9-4553-b093-e84f0d4dcb99 req-f1b62980-8ea8-4a47-981b-62b7b6af4757 tempest-TestInstancesWithCinderVolumes-1434125260 None] attachment_update completed successfully. Jun 24 05:09:50 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Jun 24 05:09:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-aaeec5f8-d2c8-470a-96fa-ffa36fd34a05 req-a472ac73-237f-4188-9d50-b280b59a9918 tempest-VolumesSnapshotsTestJSON-1500356696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94.56a13d47-bcf5-4026-b119-9e718637f313" returned: 0 in 0.856s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:09:50 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [req-aaeec5f8-d2c8-470a-96fa-ffa36fd34a05 req-a472ac73-237f-4188-9d50-b280b59a9918 tempest-VolumesSnapshotsTestJSON-1500356696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:09:50 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd697ca-610e-4be9-8589-333f803bbd2f]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:09:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-aaeec5f8-d2c8-470a-96fa-ffa36fd34a05 req-a472ac73-237f-4188-9d50-b280b59a9918 tempest-VolumesSnapshotsTestJSON-1500356696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:09:50 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94 Jun 24 05:09:50 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:09:51 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Jun 24 05:09:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-aaeec5f8-d2c8-470a-96fa-ffa36fd34a05 req-a472ac73-237f-4188-9d50-b280b59a9918 tempest-VolumesSnapshotsTestJSON-1500356696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94" returned: 0 in 0.843s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:09:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-aaeec5f8-d2c8-470a-96fa-ffa36fd34a05 req-a472ac73-237f-4188-9d50-b280b59a9918 tempest-VolumesSnapshotsTestJSON-1500356696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94.56a13d47-bcf5-4026-b119-9e718637f313 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:09:51 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94.56a13d47-bcf5-4026-b119-9e718637f313 Jun 24 05:09:51 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:09:52 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Jun 24 05:09:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-aaeec5f8-d2c8-470a-96fa-ffa36fd34a05 req-a472ac73-237f-4188-9d50-b280b59a9918 tempest-VolumesSnapshotsTestJSON-1500356696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94.56a13d47-bcf5-4026-b119-9e718637f313" returned: 0 in 0.780s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:09:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-aaeec5f8-d2c8-470a-96fa-ffa36fd34a05 req-a472ac73-237f-4188-9d50-b280b59a9918 tempest-VolumesSnapshotsTestJSON-1500356696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94.56a13d47-bcf5-4026-b119-9e718637f313 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:09:52 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94.56a13d47-bcf5-4026-b119-9e718637f313 Jun 24 05:09:52 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:09:53 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Jun 24 05:09:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-aaeec5f8-d2c8-470a-96fa-ffa36fd34a05 req-a472ac73-237f-4188-9d50-b280b59a9918 tempest-VolumesSnapshotsTestJSON-1500356696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94.56a13d47-bcf5-4026-b119-9e718637f313" returned: 0 in 0.682s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:09:53 devstack cinder-volume[93830]: DEBUG cinder.coordination [req-aaeec5f8-d2c8-470a-96fa-ffa36fd34a05 req-a472ac73-237f-4188-9d50-b280b59a9918 tempest-VolumesSnapshotsTestJSON-1500356696 None] Lock "cinder-quobyte-56a13d47-bcf5-4026-b119-9e718637f313" released by "_delete_snapshot" :: held 3.275s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:09:53 devstack cinder-volume[93830]: DEBUG cinder.coordination [req-aaeec5f8-d2c8-470a-96fa-ffa36fd34a05 req-a472ac73-237f-4188-9d50-b280b59a9918 tempest-VolumesSnapshotsTestJSON-1500356696 None] Lock "cinder-quobyte-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94" released by "delete_snapshot" :: held 3.301s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:09:53 devstack cinder-volume[93830]: DEBUG cinder.quota [req-aaeec5f8-d2c8-470a-96fa-ffa36fd34a05 req-a472ac73-237f-4188-9d50-b280b59a9918 tempest-VolumesSnapshotsTestJSON-1500356696 None] Created reservations ['994aa509-6822-4b26-9c75-a85111588521', 'c816ecbd-ee4a-4b9c-a940-04a1d0e60fa4', '04cdac83-09e1-4670-9168-e1923d7f0be0', 'ba2d09c0-9260-462f-9d4a-6379beba3177'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:09:53 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-aaeec5f8-d2c8-470a-96fa-ffa36fd34a05 req-a472ac73-237f-4188-9d50-b280b59a9918 tempest-VolumesSnapshotsTestJSON-1500356696 None] Delete snapshot completed successfully. Jun 24 05:09:53 devstack cinder-volume[93830]: DEBUG cinder.coordination [req-aaeec5f8-d2c8-470a-96fa-ffa36fd34a05 req-a472ac73-237f-4188-9d50-b280b59a9918 tempest-VolumesSnapshotsTestJSON-1500356696 None] Lock "cinder-56a13d47-bcf5-4026-b119-9e718637f313-delete_snapshot" released by "delete_snapshot" :: held 3.442s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:09:54 devstack cinder-volume[93830]: DEBUG cinder.coordination [req-a3b57341-e605-4662-a860-bda20f3e76fb req-4f366b03-e075-4f8d-b57d-f44164a6ed9c tempest-VolumesSnapshotsTestJSON-1500356696 None] Acquiring lock "cinder-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:09:54 devstack cinder-volume[93830]: DEBUG cinder.coordination [req-a3b57341-e605-4662-a860-bda20f3e76fb req-4f366b03-e075-4f8d-b57d-f44164a6ed9c tempest-VolumesSnapshotsTestJSON-1500356696 None] Lock "cinder-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:09:54 devstack cinder-volume[93830]: DEBUG cinder.coordination [req-a3b57341-e605-4662-a860-bda20f3e76fb req-4f366b03-e075-4f8d-b57d-f44164a6ed9c tempest-VolumesSnapshotsTestJSON-1500356696 None] Acquiring lock "cinder-quobyte-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:09:54 devstack cinder-volume[93830]: DEBUG cinder.coordination [req-a3b57341-e605-4662-a860-bda20f3e76fb req-4f366b03-e075-4f8d-b57d-f44164a6ed9c tempest-VolumesSnapshotsTestJSON-1500356696 None] Lock "cinder-quobyte-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94" acquired by "delete_volume" :: waited 0.021s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:09:54 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[3785d74c-8cc4-46f2-94c1-53c8f222aac2]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:09:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-a3b57341-e605-4662-a860-bda20f3e76fb req-4f366b03-e075-4f8d-b57d-f44164a6ed9c tempest-VolumesSnapshotsTestJSON-1500356696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:09:54 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94 Jun 24 05:09:54 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:09:55 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Jun 24 05:09:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-a3b57341-e605-4662-a860-bda20f3e76fb req-4f366b03-e075-4f8d-b57d-f44164a6ed9c tempest-VolumesSnapshotsTestJSON-1500356696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94" returned: 0 in 0.816s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:09:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-a3b57341-e605-4662-a860-bda20f3e76fb req-4f366b03-e075-4f8d-b57d-f44164a6ed9c tempest-VolumesSnapshotsTestJSON-1500356696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:09:55 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94 Jun 24 05:09:55 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:09:55 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Jun 24 05:09:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-a3b57341-e605-4662-a860-bda20f3e76fb req-4f366b03-e075-4f8d-b57d-f44164a6ed9c tempest-VolumesSnapshotsTestJSON-1500356696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94" returned: 0 in 0.713s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:09:55 devstack cinder-volume[93830]: DEBUG cinder.coordination [req-a3b57341-e605-4662-a860-bda20f3e76fb req-4f366b03-e075-4f8d-b57d-f44164a6ed9c tempest-VolumesSnapshotsTestJSON-1500356696 None] Lock "cinder-quobyte-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94" released by "delete_volume" :: held 1.587s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:09:55 devstack cinder-volume[93830]: DEBUG cinder.quota [req-a3b57341-e605-4662-a860-bda20f3e76fb req-4f366b03-e075-4f8d-b57d-f44164a6ed9c tempest-VolumesSnapshotsTestJSON-1500356696 None] Created reservations ['6684684a-7319-449c-ad2b-0402dee65e96', 'c2241a0c-69d3-4582-b7b4-27dd67b2b92d', 'e2d6eafd-ee87-40d6-8fd7-b54897014d2a', '43d52b11-543a-4052-821d-457698bdea9d'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:09:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-a3b57341-e605-4662-a860-bda20f3e76fb req-4f366b03-e075-4f8d-b57d-f44164a6ed9c tempest-VolumesSnapshotsTestJSON-1500356696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:09:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-a3b57341-e605-4662-a860-bda20f3e76fb req-4f366b03-e075-4f8d-b57d-f44164a6ed9c tempest-VolumesSnapshotsTestJSON-1500356696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:09:55 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [req-a3b57341-e605-4662-a860-bda20f3e76fb req-4f366b03-e075-4f8d-b57d-f44164a6ed9c tempest-VolumesSnapshotsTestJSON-1500356696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:09:55 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [req-a3b57341-e605-4662-a860-bda20f3e76fb req-4f366b03-e075-4f8d-b57d-f44164a6ed9c tempest-VolumesSnapshotsTestJSON-1500356696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:09:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-a3b57341-e605-4662-a860-bda20f3e76fb req-4f366b03-e075-4f8d-b57d-f44164a6ed9c tempest-VolumesSnapshotsTestJSON-1500356696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:09:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-a3b57341-e605-4662-a860-bda20f3e76fb req-4f366b03-e075-4f8d-b57d-f44164a6ed9c tempest-VolumesSnapshotsTestJSON-1500356696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:09:55 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:09:55 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:09:56 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Jun 24 05:09:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-a3b57341-e605-4662-a860-bda20f3e76fb req-4f366b03-e075-4f8d-b57d-f44164a6ed9c tempest-VolumesSnapshotsTestJSON-1500356696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.687s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:09:56 devstack cinder-volume[93830]: DEBUG cinder.manager [req-a3b57341-e605-4662-a860-bda20f3e76fb req-4f366b03-e075-4f8d-b57d-f44164a6ed9c tempest-VolumesSnapshotsTestJSON-1500356696 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:09:56 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-a3b57341-e605-4662-a860-bda20f3e76fb req-4f366b03-e075-4f8d-b57d-f44164a6ed9c tempest-VolumesSnapshotsTestJSON-1500356696 None] Deleted volume successfully. Jun 24 05:09:56 devstack cinder-volume[93830]: DEBUG cinder.coordination [req-a3b57341-e605-4662-a860-bda20f3e76fb req-4f366b03-e075-4f8d-b57d-f44164a6ed9c tempest-VolumesSnapshotsTestJSON-1500356696 None] Lock "cinder-71dd8da7-f5dc-4e7a-ab7a-70f19da0cf94-delete_volume" released by "delete_volume" :: held 2.498s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:09:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-cce7eabc-d2f0-42ac-8a4d-588a727049b7 req-551a4cfe-8fd2-4b19-95c4-c50f81836506 tempest-TestInstancesWithCinderVolumes-1434125260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:09:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-cce7eabc-d2f0-42ac-8a4d-588a727049b7 req-551a4cfe-8fd2-4b19-95c4-c50f81836506 tempest-TestInstancesWithCinderVolumes-1434125260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:09:58 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce8eaa6-5cce-4f1a-8f9c-7e0c61bc0a1c]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:09:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-cce7eabc-d2f0-42ac-8a4d-588a727049b7 req-551a4cfe-8fd2-4b19-95c4-c50f81836506 tempest-TestInstancesWithCinderVolumes-1434125260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-0118a52a-bef2-46ee-9745-15238c0c571d {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:09:58 devstack sudo[107525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-0118a52a-bef2-46ee-9745-15238c0c571d Jun 24 05:09:58 devstack sudo[107525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:09:59 devstack sudo[107525]: pam_unix(sudo:session): session closed for user root Jun 24 05:09:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-cce7eabc-d2f0-42ac-8a4d-588a727049b7 req-551a4cfe-8fd2-4b19-95c4-c50f81836506 tempest-TestInstancesWithCinderVolumes-1434125260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-0118a52a-bef2-46ee-9745-15238c0c571d" returned: 0 in 0.818s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:09:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-cce7eabc-d2f0-42ac-8a4d-588a727049b7 req-551a4cfe-8fd2-4b19-95c4-c50f81836506 tempest-TestInstancesWithCinderVolumes-1434125260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.840s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:09:59 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-cce7eabc-d2f0-42ac-8a4d-588a727049b7 req-551a4cfe-8fd2-4b19-95c4-c50f81836506 tempest-TestInstancesWithCinderVolumes-1434125260 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05', 'name': 'volume-0118a52a-bef2-46ee-9745-15238c0c571d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8143d5a2-3953-427c-a513-59493c31ee22', 'enforce_multipath': True} {{(pid=93830) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 05:09:59 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-cce7eabc-d2f0-42ac-8a4d-588a727049b7 req-551a4cfe-8fd2-4b19-95c4-c50f81836506 tempest-TestInstancesWithCinderVolumes-1434125260 None] attachment_update completed successfully. Jun 24 05:10:05 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-39e074d4-dffe-4afc-9714-d66e8a78ff7c tempest-GroupsTest-972710143 None] Group tempest-Group1-599924883: creating Jun 24 05:10:05 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-39e074d4-dffe-4afc-9714-d66e8a78ff7c tempest-GroupsTest-972710143 None] Group tempest-Group1-599924883: created successfully Jun 24 05:10:05 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-39e074d4-dffe-4afc-9714-d66e8a78ff7c tempest-GroupsTest-972710143 None] Create group completed successfully. Jun 24 05:10:06 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-bfe45357-b8b8-41fc-8bab-bb4077f832ec tempest-GroupsTest-972710143 None] Group tempest-Group2-1555011257: creating Jun 24 05:10:06 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-bfe45357-b8b8-41fc-8bab-bb4077f832ec tempest-GroupsTest-972710143 None] Group tempest-Group2-1555011257: created successfully Jun 24 05:10:06 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-bfe45357-b8b8-41fc-8bab-bb4077f832ec tempest-GroupsTest-972710143 None] Create group completed successfully. Jun 24 05:10:08 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-419885ed-5ffa-420c-b270-efb97de96b03 tempest-GroupsTest-972710143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:10:08 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-419885ed-5ffa-420c-b270-efb97de96b03 tempest-GroupsTest-972710143 None] Flow 'volume_create_manager' (f48433fd-146d-4181-a327-9664a5fd566b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:10:08 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-419885ed-5ffa-420c-b270-efb97de96b03 tempest-GroupsTest-972710143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e9059c8-96df-4b9a-917d-99dea91d70e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:10:08 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-419885ed-5ffa-420c-b270-efb97de96b03 tempest-GroupsTest-972710143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e9059c8-96df-4b9a-917d-99dea91d70e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1748281316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b5e0e4a3-243a-4f57-91fe-b686ac6f343e,host='devstack@QuobyteHD#QuobyteHD',id=a884e0fc-dcfe-4262-b92c-cf7c70dddece,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a0fca2ba31445ea5e4e407c8d1441e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:10:08Z,use_quota=True,user_id='0d8e01590d674c7f8cf83a1215b0cbdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29262206-7489-47f9-8a5d-06bb1a116c2b),volume_type_id=29262206-7489-47f9-8a5d-06bb1a116c2b)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:10:08 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-419885ed-5ffa-420c-b270-efb97de96b03 tempest-GroupsTest-972710143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bd542b0-bce9-4407-b079-2b4b89d08c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:10:08 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-419885ed-5ffa-420c-b270-efb97de96b03 tempest-GroupsTest-972710143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bd542b0-bce9-4407-b079-2b4b89d08c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:10:08 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-419885ed-5ffa-420c-b270-efb97de96b03 tempest-GroupsTest-972710143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37324a51-14bb-4ab8-97ba-ecdc6be7565d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:10:08 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-419885ed-5ffa-420c-b270-efb97de96b03 tempest-GroupsTest-972710143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37324a51-14bb-4ab8-97ba-ecdc6be7565d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a884e0fc-dcfe-4262-b92c-cf7c70dddece', 'volume_name': 'volume-a884e0fc-dcfe-4262-b92c-cf7c70dddece', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:10:08 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-419885ed-5ffa-420c-b270-efb97de96b03 tempest-GroupsTest-972710143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78d8497c-703a-451e-8c24-5756bda1eb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:10:08 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-419885ed-5ffa-420c-b270-efb97de96b03 tempest-GroupsTest-972710143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78d8497c-703a-451e-8c24-5756bda1eb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:10:08 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-419885ed-5ffa-420c-b270-efb97de96b03 tempest-GroupsTest-972710143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eb629c7-464d-4c20-a491-7ee7be5a55a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:10:08 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-419885ed-5ffa-420c-b270-efb97de96b03 tempest-GroupsTest-972710143 None] Volume a884e0fc-dcfe-4262-b92c-cf7c70dddece: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a884e0fc-dcfe-4262-b92c-cf7c70dddece', 'volume_size': 1} Jun 24 05:10:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-419885ed-5ffa-420c-b270-efb97de96b03 tempest-GroupsTest-972710143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:10:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-419885ed-5ffa-420c-b270-efb97de96b03 tempest-GroupsTest-972710143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:10:08 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-419885ed-5ffa-420c-b270-efb97de96b03 tempest-GroupsTest-972710143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b5e0e4a3-243a-4f57-91fe-b686ac6f343e,created_at=2026-06-24T03:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1748281316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b5e0e4a3-243a-4f57-91fe-b686ac6f343e,host='devstack@QuobyteHD#QuobyteHD',id=a884e0fc-dcfe-4262-b92c-cf7c70dddece,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a0fca2ba31445ea5e4e407c8d1441e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:10:08Z,use_quota=True,user_id='0d8e01590d674c7f8cf83a1215b0cbdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29262206-7489-47f9-8a5d-06bb1a116c2b),volume_type_id=29262206-7489-47f9-8a5d-06bb1a116c2b)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:10:08 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-419885ed-5ffa-420c-b270-efb97de96b03 tempest-GroupsTest-972710143 None] Creating volume a884e0fc-dcfe-4262-b92c-cf7c70dddece {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:10:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-419885ed-5ffa-420c-b270-efb97de96b03 tempest-GroupsTest-972710143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:10:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-419885ed-5ffa-420c-b270-efb97de96b03 tempest-GroupsTest-972710143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:10:08 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-419885ed-5ffa-420c-b270-efb97de96b03 tempest-GroupsTest-972710143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:10:08 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-419885ed-5ffa-420c-b270-efb97de96b03 tempest-GroupsTest-972710143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:10:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-419885ed-5ffa-420c-b270-efb97de96b03 tempest-GroupsTest-972710143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:10:08 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-419885ed-5ffa-420c-b270-efb97de96b03 tempest-GroupsTest-972710143 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:10:08 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-419885ed-5ffa-420c-b270-efb97de96b03 tempest-GroupsTest-972710143 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:10:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-419885ed-5ffa-420c-b270-efb97de96b03 tempest-GroupsTest-972710143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a884e0fc-dcfe-4262-b92c-cf7c70dddece 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:08 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a884e0fc-dcfe-4262-b92c-cf7c70dddece 1073741824 Jun 24 05:10:08 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:08 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-fb527f11-e894-454a-99c6-7578ed47acdf req-d4c55ed2-a267-4a12-93cf-0568c00997c8 tempest-TestInstancesWithCinderVolumes-1434125260 None] Terminate volume connection completed successfully. Jun 24 05:10:08 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-fb527f11-e894-454a-99c6-7578ed47acdf req-d4c55ed2-a267-4a12-93cf-0568c00997c8 tempest-TestInstancesWithCinderVolumes-1434125260 None] Deleting attachment 39c8844d-06d1-4d75-9087-b55b08e9c135. {{(pid=93830) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 05:10:09 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-419885ed-5ffa-420c-b270-efb97de96b03 tempest-GroupsTest-972710143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a884e0fc-dcfe-4262-b92c-cf7c70dddece 1073741824" returned: 0 in 0.922s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-419885ed-5ffa-420c-b270-efb97de96b03 tempest-GroupsTest-972710143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a884e0fc-dcfe-4262-b92c-cf7c70dddece {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:09 devstack sudo[107585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a884e0fc-dcfe-4262-b92c-cf7c70dddece Jun 24 05:10:09 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:09 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 05:10:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:10:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:10:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:10:09 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:10:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:10:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-419885ed-5ffa-420c-b270-efb97de96b03 tempest-GroupsTest-972710143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a884e0fc-dcfe-4262-b92c-cf7c70dddece" returned: 0 in 0.685s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-419885ed-5ffa-420c-b270-efb97de96b03 tempest-GroupsTest-972710143 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:10:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-419885ed-5ffa-420c-b270-efb97de96b03 tempest-GroupsTest-972710143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:10:09 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:10:09 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:09 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-419885ed-5ffa-420c-b270-efb97de96b03 tempest-GroupsTest-972710143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eb629c7-464d-4c20-a491-7ee7be5a55a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a884e0fc-dcfe-4262-b92c-cf7c70dddece', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:10:09 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-419885ed-5ffa-420c-b270-efb97de96b03 tempest-GroupsTest-972710143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e793dcd6-0ab4-4843-b793-0ebb77cf3493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:10:09 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-419885ed-5ffa-420c-b270-efb97de96b03 tempest-GroupsTest-972710143 None] Volume volume-a884e0fc-dcfe-4262-b92c-cf7c70dddece (a884e0fc-dcfe-4262-b92c-cf7c70dddece): created successfully Jun 24 05:10:09 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-419885ed-5ffa-420c-b270-efb97de96b03 tempest-GroupsTest-972710143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e793dcd6-0ab4-4843-b793-0ebb77cf3493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:10:09 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-419885ed-5ffa-420c-b270-efb97de96b03 tempest-GroupsTest-972710143 None] Flow 'volume_create_manager' (f48433fd-146d-4181-a327-9664a5fd566b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:10:09 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-419885ed-5ffa-420c-b270-efb97de96b03 tempest-GroupsTest-972710143 None] Created volume successfully. Jun 24 05:10:10 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-4eaea621-ad12-4dc2-a0d6-ce111ab96e81 tempest-TestInstancesWithCinderVolumes-1434125260 None] Acquiring lock "cinder-c24d74d3-a269-44d3-bcac-a96593a2b087-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:10:10 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-4eaea621-ad12-4dc2-a0d6-ce111ab96e81 tempest-TestInstancesWithCinderVolumes-1434125260 None] Lock "cinder-c24d74d3-a269-44d3-bcac-a96593a2b087-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:10:10 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-4eaea621-ad12-4dc2-a0d6-ce111ab96e81 tempest-TestInstancesWithCinderVolumes-1434125260 None] Acquiring lock "cinder-quobyte-c24d74d3-a269-44d3-bcac-a96593a2b087" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:10:10 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-4eaea621-ad12-4dc2-a0d6-ce111ab96e81 tempest-TestInstancesWithCinderVolumes-1434125260 None] Lock "cinder-quobyte-c24d74d3-a269-44d3-bcac-a96593a2b087" acquired by "delete_volume" :: waited 0.014s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:10:10 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[958506fb-03ab-4909-9e0d-80084d30eb09]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:10:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4eaea621-ad12-4dc2-a0d6-ce111ab96e81 tempest-TestInstancesWithCinderVolumes-1434125260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c24d74d3-a269-44d3-bcac-a96593a2b087 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:10 devstack sudo[107593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c24d74d3-a269-44d3-bcac-a96593a2b087 Jun 24 05:10:10 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:10 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.688s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:10 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:10:10 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager._thread_info {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 05:10:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread count: 29 {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 05:10:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread info: [<_MainThread(MainThread, started 130211312517248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 05:10:11 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9a75c03d-830b-4054-9197-c78ca1da4d1a tempest-GroupsTest-972710143 None] Acquiring lock "cinder-quobyte-a884e0fc-dcfe-4262-b92c-cf7c70dddece" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:10:11 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4eaea621-ad12-4dc2-a0d6-ce111ab96e81 tempest-TestInstancesWithCinderVolumes-1434125260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c24d74d3-a269-44d3-bcac-a96593a2b087" returned: 0 in 0.870s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4eaea621-ad12-4dc2-a0d6-ce111ab96e81 tempest-TestInstancesWithCinderVolumes-1434125260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c24d74d3-a269-44d3-bcac-a96593a2b087 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:11 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9a75c03d-830b-4054-9197-c78ca1da4d1a tempest-GroupsTest-972710143 None] Lock "cinder-quobyte-a884e0fc-dcfe-4262-b92c-cf7c70dddece" acquired by "delete_volume" :: waited 0.031s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:10:11 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c24d74d3-a269-44d3-bcac-a96593a2b087 Jun 24 05:10:11 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:11 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f5cb3d-5a2a-495a-8877-0a053cc0f367]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:10:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9a75c03d-830b-4054-9197-c78ca1da4d1a tempest-GroupsTest-972710143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a884e0fc-dcfe-4262-b92c-cf7c70dddece {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:11 devstack sudo[107604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a884e0fc-dcfe-4262-b92c-cf7c70dddece Jun 24 05:10:11 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:11 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4eaea621-ad12-4dc2-a0d6-ce111ab96e81 tempest-TestInstancesWithCinderVolumes-1434125260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c24d74d3-a269-44d3-bcac-a96593a2b087" returned: 0 in 0.702s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:11 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-4eaea621-ad12-4dc2-a0d6-ce111ab96e81 tempest-TestInstancesWithCinderVolumes-1434125260 None] Lock "cinder-quobyte-c24d74d3-a269-44d3-bcac-a96593a2b087" released by "delete_volume" :: held 1.619s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:10:11 devstack cinder-volume[93830]: WARNING cinder.quota [None req-4eaea621-ad12-4dc2-a0d6-ce111ab96e81 tempest-TestInstancesWithCinderVolumes-1434125260 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-27543990-375083839 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-27543990-375083839, it is now deprecated. Please use the default quota class for default quota. Jun 24 05:10:11 devstack cinder-volume[93830]: WARNING cinder.quota [None req-4eaea621-ad12-4dc2-a0d6-ce111ab96e81 tempest-TestInstancesWithCinderVolumes-1434125260 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-27543990-375083839 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-27543990-375083839, it is now deprecated. Please use the default quota class for default quota. Jun 24 05:10:11 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-4eaea621-ad12-4dc2-a0d6-ce111ab96e81 tempest-TestInstancesWithCinderVolumes-1434125260 None] Created reservations ['f42bec60-75f7-41e9-9c5b-3e6afe6abf1a', '21a45949-77d4-4d96-99db-40278b9db39b', 'df8ba956-2bec-4088-9442-075c7ef8aa85', 'e44dd410-826a-4352-982f-631937dc354c'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:10:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4eaea621-ad12-4dc2-a0d6-ce111ab96e81 tempest-TestInstancesWithCinderVolumes-1434125260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:10:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4eaea621-ad12-4dc2-a0d6-ce111ab96e81 tempest-TestInstancesWithCinderVolumes-1434125260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:10:11 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-4eaea621-ad12-4dc2-a0d6-ce111ab96e81 tempest-TestInstancesWithCinderVolumes-1434125260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:10:11 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-4eaea621-ad12-4dc2-a0d6-ce111ab96e81 tempest-TestInstancesWithCinderVolumes-1434125260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:10:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4eaea621-ad12-4dc2-a0d6-ce111ab96e81 tempest-TestInstancesWithCinderVolumes-1434125260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:10:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4eaea621-ad12-4dc2-a0d6-ce111ab96e81 tempest-TestInstancesWithCinderVolumes-1434125260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:12 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:10:12 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:12 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9a75c03d-830b-4054-9197-c78ca1da4d1a tempest-GroupsTest-972710143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a884e0fc-dcfe-4262-b92c-cf7c70dddece" returned: 0 in 0.881s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9a75c03d-830b-4054-9197-c78ca1da4d1a tempest-GroupsTest-972710143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a884e0fc-dcfe-4262-b92c-cf7c70dddece {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:12 devstack sudo[107612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a884e0fc-dcfe-4262-b92c-cf7c70dddece Jun 24 05:10:12 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:12 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4eaea621-ad12-4dc2-a0d6-ce111ab96e81 tempest-TestInstancesWithCinderVolumes-1434125260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.685s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:12 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-4eaea621-ad12-4dc2-a0d6-ce111ab96e81 tempest-TestInstancesWithCinderVolumes-1434125260 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:10:12 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-4eaea621-ad12-4dc2-a0d6-ce111ab96e81 tempest-TestInstancesWithCinderVolumes-1434125260 None] Deleted volume successfully. Jun 24 05:10:12 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-4eaea621-ad12-4dc2-a0d6-ce111ab96e81 tempest-TestInstancesWithCinderVolumes-1434125260 None] Lock "cinder-c24d74d3-a269-44d3-bcac-a96593a2b087-delete_volume" released by "delete_volume" :: held 2.564s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:10:12 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9a75c03d-830b-4054-9197-c78ca1da4d1a tempest-GroupsTest-972710143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a884e0fc-dcfe-4262-b92c-cf7c70dddece" returned: 0 in 0.717s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:12 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9a75c03d-830b-4054-9197-c78ca1da4d1a tempest-GroupsTest-972710143 None] Lock "cinder-quobyte-a884e0fc-dcfe-4262-b92c-cf7c70dddece" released by "delete_volume" :: held 1.650s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:10:12 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-9a75c03d-830b-4054-9197-c78ca1da4d1a tempest-GroupsTest-972710143 None] Created reservations ['b4e73024-f9a6-4353-b8d1-3dcc5b8f5833'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:10:12 devstack cinder-volume[93830]: WARNING cinder.quota [None req-9a75c03d-830b-4054-9197-c78ca1da4d1a tempest-GroupsTest-972710143 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1308171005 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1308171005, it is now deprecated. Please use the default quota class for default quota. Jun 24 05:10:12 devstack cinder-volume[93830]: WARNING cinder.quota [None req-9a75c03d-830b-4054-9197-c78ca1da4d1a tempest-GroupsTest-972710143 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1308171005 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1308171005, it is now deprecated. Please use the default quota class for default quota. Jun 24 05:10:12 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-9a75c03d-830b-4054-9197-c78ca1da4d1a tempest-GroupsTest-972710143 None] Created reservations ['a39b2a73-d352-483a-ac21-d9e5c1c8e82b', 'b33af4b7-b697-4d26-a505-fbec47a02146', 'a762b13f-8841-46a4-819c-b865a92fcfef', '6fab0ba2-676a-4db7-ada1-2f7350733104'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:10:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9a75c03d-830b-4054-9197-c78ca1da4d1a tempest-GroupsTest-972710143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:10:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9a75c03d-830b-4054-9197-c78ca1da4d1a tempest-GroupsTest-972710143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:10:12 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-9a75c03d-830b-4054-9197-c78ca1da4d1a tempest-GroupsTest-972710143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:10:12 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-9a75c03d-830b-4054-9197-c78ca1da4d1a tempest-GroupsTest-972710143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:10:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9a75c03d-830b-4054-9197-c78ca1da4d1a tempest-GroupsTest-972710143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:10:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9a75c03d-830b-4054-9197-c78ca1da4d1a tempest-GroupsTest-972710143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:12 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:10:13 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:13 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9a75c03d-830b-4054-9197-c78ca1da4d1a tempest-GroupsTest-972710143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.649s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:13 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-9a75c03d-830b-4054-9197-c78ca1da4d1a tempest-GroupsTest-972710143 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:10:13 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-9a75c03d-830b-4054-9197-c78ca1da4d1a tempest-GroupsTest-972710143 None] Delete group completed successfully. Jun 24 05:10:13 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-6cc65ac0-14df-47a3-80a3-5b7ded4b00b1 tempest-GroupsTest-972710143 None] Created reservations ['8f3dc9a6-0a60-4981-b44a-45ad47d63253'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:10:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-6cc65ac0-14df-47a3-80a3-5b7ded4b00b1 tempest-GroupsTest-972710143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:10:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-6cc65ac0-14df-47a3-80a3-5b7ded4b00b1 tempest-GroupsTest-972710143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:10:13 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-6cc65ac0-14df-47a3-80a3-5b7ded4b00b1 tempest-GroupsTest-972710143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:10:13 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-6cc65ac0-14df-47a3-80a3-5b7ded4b00b1 tempest-GroupsTest-972710143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:10:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-6cc65ac0-14df-47a3-80a3-5b7ded4b00b1 tempest-GroupsTest-972710143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:10:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6cc65ac0-14df-47a3-80a3-5b7ded4b00b1 tempest-GroupsTest-972710143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:13 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:10:13 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:14 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:14 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6cc65ac0-14df-47a3-80a3-5b7ded4b00b1 tempest-GroupsTest-972710143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.632s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:14 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-6cc65ac0-14df-47a3-80a3-5b7ded4b00b1 tempest-GroupsTest-972710143 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:10:14 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-6cc65ac0-14df-47a3-80a3-5b7ded4b00b1 tempest-GroupsTest-972710143 None] Delete group completed successfully. Jun 24 05:10:14 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-827786e4-4cce-49cb-a367-01ce41f75129 req-41c6e98f-d0b3-4ca7-aede-5a7a5931d748 tempest-TestInstancesWithCinderVolumes-1434125260 None] Terminate volume connection completed successfully. Jun 24 05:10:14 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-827786e4-4cce-49cb-a367-01ce41f75129 req-41c6e98f-d0b3-4ca7-aede-5a7a5931d748 tempest-TestInstancesWithCinderVolumes-1434125260 None] Deleting attachment 8143d5a2-3953-427c-a513-59493c31ee22. {{(pid=93830) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 05:10:15 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-35d53c52-79bf-4e1e-8994-3790ef34ed01 tempest-GroupsTest-972710143 None] Group tempest-GroupsTest-Group-1852083777: creating Jun 24 05:10:15 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-35d53c52-79bf-4e1e-8994-3790ef34ed01 tempest-GroupsTest-972710143 None] Group tempest-GroupsTest-Group-1852083777: created successfully Jun 24 05:10:15 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-35d53c52-79bf-4e1e-8994-3790ef34ed01 tempest-GroupsTest-972710143 None] Create group completed successfully. Jun 24 05:10:16 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ff40b7a-2b04-4613-9a6e-5efb88c5deeb tempest-GroupsTest-972710143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:10:16 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3ff40b7a-2b04-4613-9a6e-5efb88c5deeb tempest-GroupsTest-972710143 None] Flow 'volume_create_manager' (3004807b-e330-4ba0-8716-a9d345cd3d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:10:16 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3ff40b7a-2b04-4613-9a6e-5efb88c5deeb tempest-GroupsTest-972710143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a805b73f-019a-4b11-ac48-f988ca647c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:10:16 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9c21bc5d-fb2c-46bf-8f5a-12e763481ba5 tempest-TestInstancesWithCinderVolumes-1434125260 None] Acquiring lock "cinder-0118a52a-bef2-46ee-9745-15238c0c571d-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:10:16 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3ff40b7a-2b04-4613-9a6e-5efb88c5deeb tempest-GroupsTest-972710143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a805b73f-019a-4b11-ac48-f988ca647c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1829734318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=04a2c301-3212-4499-8f3a-9b211fb03ee2,host='devstack@QuobyteHD#QuobyteHD',id=da964880-fbff-46c7-b4b2-3f04af31b261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a0fca2ba31445ea5e4e407c8d1441e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:10:17Z,use_quota=True,user_id='0d8e01590d674c7f8cf83a1215b0cbdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3903f7e8-1ce3-480b-b58f-1b28cd03ef7a),volume_type_id=3903f7e8-1ce3-480b-b58f-1b28cd03ef7a)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:10:16 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3ff40b7a-2b04-4613-9a6e-5efb88c5deeb tempest-GroupsTest-972710143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a29bcd2c-635a-46ee-a377-10ade72825d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:10:16 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3ff40b7a-2b04-4613-9a6e-5efb88c5deeb tempest-GroupsTest-972710143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a29bcd2c-635a-46ee-a377-10ade72825d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:10:16 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3ff40b7a-2b04-4613-9a6e-5efb88c5deeb tempest-GroupsTest-972710143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (208a73ff-c378-4c92-9554-40e3e101f017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:10:16 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3ff40b7a-2b04-4613-9a6e-5efb88c5deeb tempest-GroupsTest-972710143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (208a73ff-c378-4c92-9554-40e3e101f017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da964880-fbff-46c7-b4b2-3f04af31b261', 'volume_name': 'volume-da964880-fbff-46c7-b4b2-3f04af31b261', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:10:16 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3ff40b7a-2b04-4613-9a6e-5efb88c5deeb tempest-GroupsTest-972710143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8614978d-5ded-4429-ade9-985bea1d591f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:10:16 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3ff40b7a-2b04-4613-9a6e-5efb88c5deeb tempest-GroupsTest-972710143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8614978d-5ded-4429-ade9-985bea1d591f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:10:16 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3ff40b7a-2b04-4613-9a6e-5efb88c5deeb tempest-GroupsTest-972710143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b9fbb0f-65f4-4b45-bee4-451b08e6f370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:10:16 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-3ff40b7a-2b04-4613-9a6e-5efb88c5deeb tempest-GroupsTest-972710143 None] Volume da964880-fbff-46c7-b4b2-3f04af31b261: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da964880-fbff-46c7-b4b2-3f04af31b261', 'volume_size': 1} Jun 24 05:10:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3ff40b7a-2b04-4613-9a6e-5efb88c5deeb tempest-GroupsTest-972710143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:10:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3ff40b7a-2b04-4613-9a6e-5efb88c5deeb tempest-GroupsTest-972710143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:10:16 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-3ff40b7a-2b04-4613-9a6e-5efb88c5deeb tempest-GroupsTest-972710143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=04a2c301-3212-4499-8f3a-9b211fb03ee2,created_at=2026-06-24T03:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1829734318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=04a2c301-3212-4499-8f3a-9b211fb03ee2,host='devstack@QuobyteHD#QuobyteHD',id=da964880-fbff-46c7-b4b2-3f04af31b261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a0fca2ba31445ea5e4e407c8d1441e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:10:17Z,use_quota=True,user_id='0d8e01590d674c7f8cf83a1215b0cbdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3903f7e8-1ce3-480b-b58f-1b28cd03ef7a),volume_type_id=3903f7e8-1ce3-480b-b58f-1b28cd03ef7a)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:10:16 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-3ff40b7a-2b04-4613-9a6e-5efb88c5deeb tempest-GroupsTest-972710143 None] Creating volume da964880-fbff-46c7-b4b2-3f04af31b261 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:10:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3ff40b7a-2b04-4613-9a6e-5efb88c5deeb tempest-GroupsTest-972710143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:10:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3ff40b7a-2b04-4613-9a6e-5efb88c5deeb tempest-GroupsTest-972710143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:10:16 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-3ff40b7a-2b04-4613-9a6e-5efb88c5deeb tempest-GroupsTest-972710143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:10:16 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-3ff40b7a-2b04-4613-9a6e-5efb88c5deeb tempest-GroupsTest-972710143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:10:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3ff40b7a-2b04-4613-9a6e-5efb88c5deeb tempest-GroupsTest-972710143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:10:16 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-3ff40b7a-2b04-4613-9a6e-5efb88c5deeb tempest-GroupsTest-972710143 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:10:16 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-3ff40b7a-2b04-4613-9a6e-5efb88c5deeb tempest-GroupsTest-972710143 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:10:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3ff40b7a-2b04-4613-9a6e-5efb88c5deeb tempest-GroupsTest-972710143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-da964880-fbff-46c7-b4b2-3f04af31b261 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:16 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9c21bc5d-fb2c-46bf-8f5a-12e763481ba5 tempest-TestInstancesWithCinderVolumes-1434125260 None] Lock "cinder-0118a52a-bef2-46ee-9745-15238c0c571d-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:10:16 devstack sudo[107647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-da964880-fbff-46c7-b4b2-3f04af31b261 1073741824 Jun 24 05:10:16 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:16 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9c21bc5d-fb2c-46bf-8f5a-12e763481ba5 tempest-TestInstancesWithCinderVolumes-1434125260 None] Acquiring lock "cinder-quobyte-0118a52a-bef2-46ee-9745-15238c0c571d" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:10:16 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9c21bc5d-fb2c-46bf-8f5a-12e763481ba5 tempest-TestInstancesWithCinderVolumes-1434125260 None] Lock "cinder-quobyte-0118a52a-bef2-46ee-9745-15238c0c571d" acquired by "delete_volume" :: waited 0.025s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:10:16 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f02ebfe-eba5-46a1-abcc-fc1aed393c7c]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:10:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9c21bc5d-fb2c-46bf-8f5a-12e763481ba5 tempest-TestInstancesWithCinderVolumes-1434125260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-0118a52a-bef2-46ee-9745-15238c0c571d {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:17 devstack sudo[107649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-0118a52a-bef2-46ee-9745-15238c0c571d Jun 24 05:10:17 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:17 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3ff40b7a-2b04-4613-9a6e-5efb88c5deeb tempest-GroupsTest-972710143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-da964880-fbff-46c7-b4b2-3f04af31b261 1073741824" returned: 0 in 0.984s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3ff40b7a-2b04-4613-9a6e-5efb88c5deeb tempest-GroupsTest-972710143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-da964880-fbff-46c7-b4b2-3f04af31b261 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:17 devstack sudo[107660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-da964880-fbff-46c7-b4b2-3f04af31b261 Jun 24 05:10:17 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:17 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9c21bc5d-fb2c-46bf-8f5a-12e763481ba5 tempest-TestInstancesWithCinderVolumes-1434125260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-0118a52a-bef2-46ee-9745-15238c0c571d" returned: 0 in 0.972s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9c21bc5d-fb2c-46bf-8f5a-12e763481ba5 tempest-TestInstancesWithCinderVolumes-1434125260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-0118a52a-bef2-46ee-9745-15238c0c571d {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:18 devstack sudo[107662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-0118a52a-bef2-46ee-9745-15238c0c571d Jun 24 05:10:18 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:18 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9c21bc5d-fb2c-46bf-8f5a-12e763481ba5 tempest-TestInstancesWithCinderVolumes-1434125260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-0118a52a-bef2-46ee-9745-15238c0c571d" returned: 0 in 0.728s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:18 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:18 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9c21bc5d-fb2c-46bf-8f5a-12e763481ba5 tempest-TestInstancesWithCinderVolumes-1434125260 None] Lock "cinder-quobyte-0118a52a-bef2-46ee-9745-15238c0c571d" released by "delete_volume" :: held 1.762s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:10:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3ff40b7a-2b04-4613-9a6e-5efb88c5deeb tempest-GroupsTest-972710143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-da964880-fbff-46c7-b4b2-3f04af31b261" returned: 0 in 0.833s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:18 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-3ff40b7a-2b04-4613-9a6e-5efb88c5deeb tempest-GroupsTest-972710143 None] <== create_volume: return (1870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:10:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3ff40b7a-2b04-4613-9a6e-5efb88c5deeb tempest-GroupsTest-972710143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.872s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:10:18 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3ff40b7a-2b04-4613-9a6e-5efb88c5deeb tempest-GroupsTest-972710143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b9fbb0f-65f4-4b45-bee4-451b08e6f370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da964880-fbff-46c7-b4b2-3f04af31b261', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:10:18 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3ff40b7a-2b04-4613-9a6e-5efb88c5deeb tempest-GroupsTest-972710143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7ce330c-200d-4b08-8ae6-7a2c356e9ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:10:18 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-3ff40b7a-2b04-4613-9a6e-5efb88c5deeb tempest-GroupsTest-972710143 None] Volume volume-da964880-fbff-46c7-b4b2-3f04af31b261 (da964880-fbff-46c7-b4b2-3f04af31b261): created successfully Jun 24 05:10:18 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3ff40b7a-2b04-4613-9a6e-5efb88c5deeb tempest-GroupsTest-972710143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7ce330c-200d-4b08-8ae6-7a2c356e9ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:10:18 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3ff40b7a-2b04-4613-9a6e-5efb88c5deeb tempest-GroupsTest-972710143 None] Flow 'volume_create_manager' (3004807b-e330-4ba0-8716-a9d345cd3d5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:10:18 devstack cinder-volume[93830]: WARNING cinder.quota [None req-9c21bc5d-fb2c-46bf-8f5a-12e763481ba5 tempest-TestInstancesWithCinderVolumes-1434125260 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-556203475-1577582387 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-556203475-1577582387, it is now deprecated. Please use the default quota class for default quota. Jun 24 05:10:18 devstack cinder-volume[93830]: WARNING cinder.quota [None req-9c21bc5d-fb2c-46bf-8f5a-12e763481ba5 tempest-TestInstancesWithCinderVolumes-1434125260 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-556203475-1577582387 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-556203475-1577582387, it is now deprecated. Please use the default quota class for default quota. Jun 24 05:10:18 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-3ff40b7a-2b04-4613-9a6e-5efb88c5deeb tempest-GroupsTest-972710143 None] Created volume successfully. Jun 24 05:10:18 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-9c21bc5d-fb2c-46bf-8f5a-12e763481ba5 tempest-TestInstancesWithCinderVolumes-1434125260 None] Created reservations ['82d3fe5b-bdde-4f7b-8918-3e25ba218824', '21493fa9-6f12-4fd7-9e7b-54d8a2211480', 'd4e4a066-ad7c-4eb4-913b-6a6b5858a129', 'f736e5af-5a87-415c-82d7-d8727398b0b2'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:10:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9c21bc5d-fb2c-46bf-8f5a-12e763481ba5 tempest-TestInstancesWithCinderVolumes-1434125260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:10:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9c21bc5d-fb2c-46bf-8f5a-12e763481ba5 tempest-TestInstancesWithCinderVolumes-1434125260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:10:18 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-9c21bc5d-fb2c-46bf-8f5a-12e763481ba5 tempest-TestInstancesWithCinderVolumes-1434125260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:10:18 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-9c21bc5d-fb2c-46bf-8f5a-12e763481ba5 tempest-TestInstancesWithCinderVolumes-1434125260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:10:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9c21bc5d-fb2c-46bf-8f5a-12e763481ba5 tempest-TestInstancesWithCinderVolumes-1434125260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:10:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9c21bc5d-fb2c-46bf-8f5a-12e763481ba5 tempest-TestInstancesWithCinderVolumes-1434125260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:18 devstack sudo[107667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:10:18 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:19 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9c21bc5d-fb2c-46bf-8f5a-12e763481ba5 tempest-TestInstancesWithCinderVolumes-1434125260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.799s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:19 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-9c21bc5d-fb2c-46bf-8f5a-12e763481ba5 tempest-TestInstancesWithCinderVolumes-1434125260 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:10:19 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-9c21bc5d-fb2c-46bf-8f5a-12e763481ba5 tempest-TestInstancesWithCinderVolumes-1434125260 None] Deleted volume successfully. Jun 24 05:10:19 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9c21bc5d-fb2c-46bf-8f5a-12e763481ba5 tempest-TestInstancesWithCinderVolumes-1434125260 None] Lock "cinder-0118a52a-bef2-46ee-9745-15238c0c571d-delete_volume" released by "delete_volume" :: held 2.856s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:10:19 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc3a07bd-204a-4c5f-91eb-cdc5841c1903 tempest-GroupsTest-972710143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:10:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fc3a07bd-204a-4c5f-91eb-cdc5841c1903 tempest-GroupsTest-972710143 None] Flow 'volume_create_manager' (7a7d6531-049b-43a5-a4e6-c839e49ec86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:10:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fc3a07bd-204a-4c5f-91eb-cdc5841c1903 tempest-GroupsTest-972710143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26169846-70e7-4200-91d2-cf7518689c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:10:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fc3a07bd-204a-4c5f-91eb-cdc5841c1903 tempest-GroupsTest-972710143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26169846-70e7-4200-91d2-cf7518689c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-132827572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=04a2c301-3212-4499-8f3a-9b211fb03ee2,host='devstack@QuobyteHD#QuobyteHD',id=4aad7870-5bd8-4a7c-a37c-119a2a965de5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a0fca2ba31445ea5e4e407c8d1441e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:10:20Z,use_quota=True,user_id='0d8e01590d674c7f8cf83a1215b0cbdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3903f7e8-1ce3-480b-b58f-1b28cd03ef7a),volume_type_id=3903f7e8-1ce3-480b-b58f-1b28cd03ef7a)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:10:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fc3a07bd-204a-4c5f-91eb-cdc5841c1903 tempest-GroupsTest-972710143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (648a47ef-24e4-48e6-8189-2669fc8c94f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:10:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fc3a07bd-204a-4c5f-91eb-cdc5841c1903 tempest-GroupsTest-972710143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (648a47ef-24e4-48e6-8189-2669fc8c94f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:10:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fc3a07bd-204a-4c5f-91eb-cdc5841c1903 tempest-GroupsTest-972710143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9017c8e6-1787-465e-9d4b-390ffb3d5249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:10:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fc3a07bd-204a-4c5f-91eb-cdc5841c1903 tempest-GroupsTest-972710143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9017c8e6-1787-465e-9d4b-390ffb3d5249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4aad7870-5bd8-4a7c-a37c-119a2a965de5', 'volume_name': 'volume-4aad7870-5bd8-4a7c-a37c-119a2a965de5', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:10:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fc3a07bd-204a-4c5f-91eb-cdc5841c1903 tempest-GroupsTest-972710143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (725148ad-8a5d-4627-9c3f-7f27188693a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:10:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fc3a07bd-204a-4c5f-91eb-cdc5841c1903 tempest-GroupsTest-972710143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (725148ad-8a5d-4627-9c3f-7f27188693a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:10:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fc3a07bd-204a-4c5f-91eb-cdc5841c1903 tempest-GroupsTest-972710143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a3ede8f-b258-43e4-855e-58f5e74f4de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:10:19 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-fc3a07bd-204a-4c5f-91eb-cdc5841c1903 tempest-GroupsTest-972710143 None] Volume 4aad7870-5bd8-4a7c-a37c-119a2a965de5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4aad7870-5bd8-4a7c-a37c-119a2a965de5', 'volume_size': 1} Jun 24 05:10:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fc3a07bd-204a-4c5f-91eb-cdc5841c1903 tempest-GroupsTest-972710143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:10:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fc3a07bd-204a-4c5f-91eb-cdc5841c1903 tempest-GroupsTest-972710143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:10:19 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-fc3a07bd-204a-4c5f-91eb-cdc5841c1903 tempest-GroupsTest-972710143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=04a2c301-3212-4499-8f3a-9b211fb03ee2,created_at=2026-06-24T03:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-132827572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=04a2c301-3212-4499-8f3a-9b211fb03ee2,host='devstack@QuobyteHD#QuobyteHD',id=4aad7870-5bd8-4a7c-a37c-119a2a965de5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a0fca2ba31445ea5e4e407c8d1441e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:10:20Z,use_quota=True,user_id='0d8e01590d674c7f8cf83a1215b0cbdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3903f7e8-1ce3-480b-b58f-1b28cd03ef7a),volume_type_id=3903f7e8-1ce3-480b-b58f-1b28cd03ef7a)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:10:19 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-fc3a07bd-204a-4c5f-91eb-cdc5841c1903 tempest-GroupsTest-972710143 None] Creating volume 4aad7870-5bd8-4a7c-a37c-119a2a965de5 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:10:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fc3a07bd-204a-4c5f-91eb-cdc5841c1903 tempest-GroupsTest-972710143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:10:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fc3a07bd-204a-4c5f-91eb-cdc5841c1903 tempest-GroupsTest-972710143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:10:19 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-fc3a07bd-204a-4c5f-91eb-cdc5841c1903 tempest-GroupsTest-972710143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:10:19 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-fc3a07bd-204a-4c5f-91eb-cdc5841c1903 tempest-GroupsTest-972710143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:10:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fc3a07bd-204a-4c5f-91eb-cdc5841c1903 tempest-GroupsTest-972710143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:10:19 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-fc3a07bd-204a-4c5f-91eb-cdc5841c1903 tempest-GroupsTest-972710143 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:10:19 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-fc3a07bd-204a-4c5f-91eb-cdc5841c1903 tempest-GroupsTest-972710143 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:10:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fc3a07bd-204a-4c5f-91eb-cdc5841c1903 tempest-GroupsTest-972710143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4aad7870-5bd8-4a7c-a37c-119a2a965de5 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:20 devstack sudo[107672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4aad7870-5bd8-4a7c-a37c-119a2a965de5 1073741824 Jun 24 05:10:20 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:21 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fc3a07bd-204a-4c5f-91eb-cdc5841c1903 tempest-GroupsTest-972710143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4aad7870-5bd8-4a7c-a37c-119a2a965de5 1073741824" returned: 0 in 1.104s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fc3a07bd-204a-4c5f-91eb-cdc5841c1903 tempest-GroupsTest-972710143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4aad7870-5bd8-4a7c-a37c-119a2a965de5 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:21 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4aad7870-5bd8-4a7c-a37c-119a2a965de5 Jun 24 05:10:21 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:21 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fc3a07bd-204a-4c5f-91eb-cdc5841c1903 tempest-GroupsTest-972710143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4aad7870-5bd8-4a7c-a37c-119a2a965de5" returned: 0 in 0.753s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:21 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-fc3a07bd-204a-4c5f-91eb-cdc5841c1903 tempest-GroupsTest-972710143 None] <== create_volume: return (1919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:10:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fc3a07bd-204a-4c5f-91eb-cdc5841c1903 tempest-GroupsTest-972710143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.922s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:10:21 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:SELECT=85,cinder:UPDATE=92,cinder:INSERT=17,cinder:DELETE=2 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:10:21 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fc3a07bd-204a-4c5f-91eb-cdc5841c1903 tempest-GroupsTest-972710143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a3ede8f-b258-43e4-855e-58f5e74f4de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4aad7870-5bd8-4a7c-a37c-119a2a965de5', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:10:21 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fc3a07bd-204a-4c5f-91eb-cdc5841c1903 tempest-GroupsTest-972710143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36bedc92-ba4e-45a2-97fd-bfb105e3acd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:10:21 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:SELECT=76,cinder:UPDATE=83,cinder:INSERT=22,cinder:DELETE=9 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:10:21 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-fc3a07bd-204a-4c5f-91eb-cdc5841c1903 tempest-GroupsTest-972710143 None] Volume volume-4aad7870-5bd8-4a7c-a37c-119a2a965de5 (4aad7870-5bd8-4a7c-a37c-119a2a965de5): created successfully Jun 24 05:10:21 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fc3a07bd-204a-4c5f-91eb-cdc5841c1903 tempest-GroupsTest-972710143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36bedc92-ba4e-45a2-97fd-bfb105e3acd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:10:21 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fc3a07bd-204a-4c5f-91eb-cdc5841c1903 tempest-GroupsTest-972710143 None] Flow 'volume_create_manager' (7a7d6531-049b-43a5-a4e6-c839e49ec86d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:10:21 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-fc3a07bd-204a-4c5f-91eb-cdc5841c1903 tempest-GroupsTest-972710143 None] Created volume successfully. Jun 24 05:10:22 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-2448d21b-f7e9-4810-8c19-f804eb643f6e tempest-GroupsTest-972710143 None] Update group completed successfully. Jun 24 05:10:23 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-b2909ebf-8c3c-4821-b5aa-f338be84cb45 req-12fe1bf5-443c-4568-a45a-da094a5e3bf0 tempest-TestInstancesWithCinderVolumes-1434125260 None] Terminate volume connection completed successfully. Jun 24 05:10:23 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-b2909ebf-8c3c-4821-b5aa-f338be84cb45 req-12fe1bf5-443c-4568-a45a-da094a5e3bf0 tempest-TestInstancesWithCinderVolumes-1434125260 None] Deleting attachment 64086a8f-2559-44c9-956a-b5fdfd1f87d9. {{(pid=93830) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 05:10:23 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-24482f60-96fb-48cf-87a7-038209d1918e tempest-GroupsTest-972710143 None] Update group completed successfully. Jun 24 05:10:25 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9dbb87b4-b538-4572-b55e-edd0cfa7cd57 tempest-GroupsTest-972710143 None] Acquiring lock "cinder-quobyte-4aad7870-5bd8-4a7c-a37c-119a2a965de5" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:10:25 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9dbb87b4-b538-4572-b55e-edd0cfa7cd57 tempest-GroupsTest-972710143 None] Lock "cinder-quobyte-4aad7870-5bd8-4a7c-a37c-119a2a965de5" acquired by "delete_volume" :: waited 0.016s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:10:25 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9de572d-1bc0-42ed-86cc-b895d43252d2]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:10:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9dbb87b4-b538-4572-b55e-edd0cfa7cd57 tempest-GroupsTest-972710143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4aad7870-5bd8-4a7c-a37c-119a2a965de5 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:25 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4aad7870-5bd8-4a7c-a37c-119a2a965de5 Jun 24 05:10:25 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:26 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9dbb87b4-b538-4572-b55e-edd0cfa7cd57 tempest-GroupsTest-972710143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4aad7870-5bd8-4a7c-a37c-119a2a965de5" returned: 0 in 0.818s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9dbb87b4-b538-4572-b55e-edd0cfa7cd57 tempest-GroupsTest-972710143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4aad7870-5bd8-4a7c-a37c-119a2a965de5 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:26 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4aad7870-5bd8-4a7c-a37c-119a2a965de5 Jun 24 05:10:26 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-336a7638-c037-42ae-b882-5e7ea329bd5c req-1c001789-5f6d-400f-9d48-415ee98867eb tempest-TestStampPattern-152240646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:10:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-336a7638-c037-42ae-b882-5e7ea329bd5c req-1c001789-5f6d-400f-9d48-415ee98867eb tempest-TestStampPattern-152240646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:10:26 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb45818-97e5-418d-bf38-e09ac7cfc985]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:10:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-336a7638-c037-42ae-b882-5e7ea329bd5c req-1c001789-5f6d-400f-9d48-415ee98867eb tempest-TestStampPattern-152240646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-1a6bc804-759b-45dd-a3c1-ea242ab133b9 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:26 devstack sudo[107752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-1a6bc804-759b-45dd-a3c1-ea242ab133b9 Jun 24 05:10:26 devstack sudo[107752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:26 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-22b37b23-e2e4-49f4-af45-e041ae5f0ffe tempest-TestInstancesWithCinderVolumes-1434125260 None] Acquiring lock "cinder-435de2bf-d394-4aa9-86a9-a0c9765d13f3-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:10:27 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-22b37b23-e2e4-49f4-af45-e041ae5f0ffe tempest-TestInstancesWithCinderVolumes-1434125260 None] Lock "cinder-435de2bf-d394-4aa9-86a9-a0c9765d13f3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:10:27 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-22b37b23-e2e4-49f4-af45-e041ae5f0ffe tempest-TestInstancesWithCinderVolumes-1434125260 None] Acquiring lock "cinder-quobyte-435de2bf-d394-4aa9-86a9-a0c9765d13f3" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:10:27 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-22b37b23-e2e4-49f4-af45-e041ae5f0ffe tempest-TestInstancesWithCinderVolumes-1434125260 None] Lock "cinder-quobyte-435de2bf-d394-4aa9-86a9-a0c9765d13f3" acquired by "delete_volume" :: waited 0.018s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:10:27 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9dbb87b4-b538-4572-b55e-edd0cfa7cd57 tempest-GroupsTest-972710143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4aad7870-5bd8-4a7c-a37c-119a2a965de5" returned: 0 in 0.726s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:27 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9dbb87b4-b538-4572-b55e-edd0cfa7cd57 tempest-GroupsTest-972710143 None] Lock "cinder-quobyte-4aad7870-5bd8-4a7c-a37c-119a2a965de5" released by "delete_volume" :: held 1.589s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:10:27 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9dbb87b4-b538-4572-b55e-edd0cfa7cd57 tempest-GroupsTest-972710143 None] Acquiring lock "cinder-quobyte-da964880-fbff-46c7-b4b2-3f04af31b261" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:10:27 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[7679584e-a322-4437-badf-7b731ff8432d]: (4, 'raw') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:10:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-22b37b23-e2e4-49f4-af45-e041ae5f0ffe tempest-TestInstancesWithCinderVolumes-1434125260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-435de2bf-d394-4aa9-86a9-a0c9765d13f3 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:27 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9dbb87b4-b538-4572-b55e-edd0cfa7cd57 tempest-GroupsTest-972710143 None] Lock "cinder-quobyte-da964880-fbff-46c7-b4b2-3f04af31b261" acquired by "delete_volume" :: waited 0.033s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:10:27 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[370c2242-deea-48be-8551-7a59ca57678b]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:10:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9dbb87b4-b538-4572-b55e-edd0cfa7cd57 tempest-GroupsTest-972710143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-da964880-fbff-46c7-b4b2-3f04af31b261 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:27 devstack sudo[107755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-435de2bf-d394-4aa9-86a9-a0c9765d13f3 Jun 24 05:10:27 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:27 devstack sudo[107756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-da964880-fbff-46c7-b4b2-3f04af31b261 Jun 24 05:10:27 devstack sudo[107756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:27 devstack sudo[107752]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-336a7638-c037-42ae-b882-5e7ea329bd5c req-1c001789-5f6d-400f-9d48-415ee98867eb tempest-TestStampPattern-152240646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-1a6bc804-759b-45dd-a3c1-ea242ab133b9" returned: 0 in 0.807s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-336a7638-c037-42ae-b882-5e7ea329bd5c req-1c001789-5f6d-400f-9d48-415ee98867eb tempest-TestStampPattern-152240646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.839s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:10:27 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-336a7638-c037-42ae-b882-5e7ea329bd5c req-1c001789-5f6d-400f-9d48-415ee98867eb tempest-TestStampPattern-152240646 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05', 'name': 'volume-1a6bc804-759b-45dd-a3c1-ea242ab133b9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3d3abdd9-92ff-4f6a-ac90-1ca79a0ed2ab', 'enforce_multipath': True} {{(pid=93830) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 05:10:27 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-336a7638-c037-42ae-b882-5e7ea329bd5c req-1c001789-5f6d-400f-9d48-415ee98867eb tempest-TestStampPattern-152240646 None] attachment_update completed successfully. Jun 24 05:10:27 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-22b37b23-e2e4-49f4-af45-e041ae5f0ffe tempest-TestInstancesWithCinderVolumes-1434125260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-435de2bf-d394-4aa9-86a9-a0c9765d13f3" returned: 0 in 0.867s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-22b37b23-e2e4-49f4-af45-e041ae5f0ffe tempest-TestInstancesWithCinderVolumes-1434125260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-435de2bf-d394-4aa9-86a9-a0c9765d13f3 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:28 devstack sudo[107756]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9dbb87b4-b538-4572-b55e-edd0cfa7cd57 tempest-GroupsTest-972710143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-da964880-fbff-46c7-b4b2-3f04af31b261" returned: 0 in 0.834s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9dbb87b4-b538-4572-b55e-edd0cfa7cd57 tempest-GroupsTest-972710143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-da964880-fbff-46c7-b4b2-3f04af31b261 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:28 devstack sudo[107837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-da964880-fbff-46c7-b4b2-3f04af31b261 Jun 24 05:10:28 devstack sudo[107837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:28 devstack sudo[107836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-435de2bf-d394-4aa9-86a9-a0c9765d13f3 Jun 24 05:10:28 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:28 devstack sudo[107837]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9dbb87b4-b538-4572-b55e-edd0cfa7cd57 tempest-GroupsTest-972710143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-da964880-fbff-46c7-b4b2-3f04af31b261" returned: 0 in 0.654s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:28 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9dbb87b4-b538-4572-b55e-edd0cfa7cd57 tempest-GroupsTest-972710143 None] Lock "cinder-quobyte-da964880-fbff-46c7-b4b2-3f04af31b261" released by "delete_volume" :: held 1.542s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:10:28 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-9dbb87b4-b538-4572-b55e-edd0cfa7cd57 tempest-GroupsTest-972710143 None] Created reservations ['96f25616-cc9f-474d-aca4-44324b94167d'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:10:28 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-22b37b23-e2e4-49f4-af45-e041ae5f0ffe tempest-TestInstancesWithCinderVolumes-1434125260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-435de2bf-d394-4aa9-86a9-a0c9765d13f3" returned: 1 in 0.786s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-22b37b23-e2e4-49f4-af45-e041ae5f0ffe tempest-TestInstancesWithCinderVolumes-1434125260 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-435de2bf-d394-4aa9-86a9-a0c9765d13f3' failed. Not Retrying. {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 05:10:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-22b37b23-e2e4-49f4-af45-e041ae5f0ffe tempest-TestInstancesWithCinderVolumes-1434125260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-435de2bf-d394-4aa9-86a9-a0c9765d13f3 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:28 devstack sudo[108163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-435de2bf-d394-4aa9-86a9-a0c9765d13f3 Jun 24 05:10:28 devstack sudo[108163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:28 devstack cinder-volume[93830]: WARNING cinder.quota [None req-9dbb87b4-b538-4572-b55e-edd0cfa7cd57 tempest-GroupsTest-972710143 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1352219405 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1352219405, it is now deprecated. Please use the default quota class for default quota. Jun 24 05:10:28 devstack cinder-volume[93830]: WARNING cinder.quota [None req-9dbb87b4-b538-4572-b55e-edd0cfa7cd57 tempest-GroupsTest-972710143 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1352219405 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1352219405, it is now deprecated. Please use the default quota class for default quota. Jun 24 05:10:28 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-9dbb87b4-b538-4572-b55e-edd0cfa7cd57 tempest-GroupsTest-972710143 None] Created reservations ['5ef3cfc6-6648-4288-b949-10f3edb34a44', '13be9f0b-9045-44af-854f-7cc17c4b0117', 'c5344ca3-96f1-4665-8ac2-7eb66459b58f', '83fea021-82e4-48c4-9094-f32aec094647'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:10:28 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-9dbb87b4-b538-4572-b55e-edd0cfa7cd57 tempest-GroupsTest-972710143 None] Created reservations ['dfa2e2a4-4bae-4d55-afb2-1a16e80399e2', '4269609d-2cc6-4528-a916-32e5e4ac930b', '165f1bba-f4eb-4b71-91d9-2cdf58f77de3', 'fb1aab10-61e0-4e1a-848d-1745e0475600'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:10:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9dbb87b4-b538-4572-b55e-edd0cfa7cd57 tempest-GroupsTest-972710143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:10:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9dbb87b4-b538-4572-b55e-edd0cfa7cd57 tempest-GroupsTest-972710143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:10:29 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-9dbb87b4-b538-4572-b55e-edd0cfa7cd57 tempest-GroupsTest-972710143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:10:29 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-9dbb87b4-b538-4572-b55e-edd0cfa7cd57 tempest-GroupsTest-972710143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:10:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9dbb87b4-b538-4572-b55e-edd0cfa7cd57 tempest-GroupsTest-972710143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:10:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9dbb87b4-b538-4572-b55e-edd0cfa7cd57 tempest-GroupsTest-972710143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:29 devstack sudo[108165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:10:29 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:29 devstack sudo[108163]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-22b37b23-e2e4-49f4-af45-e041ae5f0ffe tempest-TestInstancesWithCinderVolumes-1434125260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-435de2bf-d394-4aa9-86a9-a0c9765d13f3" returned: 0 in 0.738s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:29 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-22b37b23-e2e4-49f4-af45-e041ae5f0ffe tempest-TestInstancesWithCinderVolumes-1434125260 None] Lock "cinder-quobyte-435de2bf-d394-4aa9-86a9-a0c9765d13f3" released by "delete_volume" :: held 2.466s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:10:29 devstack cinder-volume[93830]: WARNING cinder.quota [None req-22b37b23-e2e4-49f4-af45-e041ae5f0ffe tempest-TestInstancesWithCinderVolumes-1434125260 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1956810971-142457746 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1956810971-142457746, it is now deprecated. Please use the default quota class for default quota. Jun 24 05:10:29 devstack cinder-volume[93830]: WARNING cinder.quota [None req-22b37b23-e2e4-49f4-af45-e041ae5f0ffe tempest-TestInstancesWithCinderVolumes-1434125260 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1956810971-142457746 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1956810971-142457746, it is now deprecated. Please use the default quota class for default quota. Jun 24 05:10:29 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-22b37b23-e2e4-49f4-af45-e041ae5f0ffe tempest-TestInstancesWithCinderVolumes-1434125260 None] Created reservations ['ec67ca55-c92a-4fdd-b505-cc4b30bafaf4', '2e98f08b-529c-4681-9532-ff187cd3cd66', 'd76479ee-6f4f-465b-8611-ab64a3f60ed7', 'bacb8531-2b6a-4598-bea6-216a2add5273'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:10:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-22b37b23-e2e4-49f4-af45-e041ae5f0ffe tempest-TestInstancesWithCinderVolumes-1434125260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:10:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-22b37b23-e2e4-49f4-af45-e041ae5f0ffe tempest-TestInstancesWithCinderVolumes-1434125260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:10:29 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-22b37b23-e2e4-49f4-af45-e041ae5f0ffe tempest-TestInstancesWithCinderVolumes-1434125260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:10:29 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-22b37b23-e2e4-49f4-af45-e041ae5f0ffe tempest-TestInstancesWithCinderVolumes-1434125260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:10:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-22b37b23-e2e4-49f4-af45-e041ae5f0ffe tempest-TestInstancesWithCinderVolumes-1434125260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:10:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-22b37b23-e2e4-49f4-af45-e041ae5f0ffe tempest-TestInstancesWithCinderVolumes-1434125260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:29 devstack sudo[108177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:10:29 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:29 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9dbb87b4-b538-4572-b55e-edd0cfa7cd57 tempest-GroupsTest-972710143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.770s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:29 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-9dbb87b4-b538-4572-b55e-edd0cfa7cd57 tempest-GroupsTest-972710143 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:10:29 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-9dbb87b4-b538-4572-b55e-edd0cfa7cd57 tempest-GroupsTest-972710143 None] Delete group completed successfully. Jun 24 05:10:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-22b37b23-e2e4-49f4-af45-e041ae5f0ffe tempest-TestInstancesWithCinderVolumes-1434125260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.783s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:30 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-22b37b23-e2e4-49f4-af45-e041ae5f0ffe tempest-TestInstancesWithCinderVolumes-1434125260 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:10:30 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:30 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-22b37b23-e2e4-49f4-af45-e041ae5f0ffe tempest-TestInstancesWithCinderVolumes-1434125260 None] Deleted volume successfully. Jun 24 05:10:30 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-22b37b23-e2e4-49f4-af45-e041ae5f0ffe tempest-TestInstancesWithCinderVolumes-1434125260 None] Lock "cinder-435de2bf-d394-4aa9-86a9-a0c9765d13f3-delete_volume" released by "delete_volume" :: held 3.527s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:10:34 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-098781cb-26c9-4731-bd29-6ce853bc54f7 req-01ae5fff-d5be-4223-94ec-cc6f365ccb52 tempest-TestStampPattern-152240646 None] Terminate volume connection completed successfully. Jun 24 05:10:34 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-098781cb-26c9-4731-bd29-6ce853bc54f7 req-01ae5fff-d5be-4223-94ec-cc6f365ccb52 tempest-TestStampPattern-152240646 None] Deleting attachment 3d3abdd9-92ff-4f6a-ac90-1ca79a0ed2ab. {{(pid=93830) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 05:10:35 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-26899898-7d31-463b-8006-7623d3245dcb tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:10:35 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-26899898-7d31-463b-8006-7623d3245dcb tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Flow 'volume_create_manager' (563d68a8-746f-433b-9e55-e3c1918acba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:10:35 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-26899898-7d31-463b-8006-7623d3245dcb tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0fc2614-0f56-4fba-80cf-edb08c3bd945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:10:35 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-26899898-7d31-463b-8006-7623d3245dcb tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0fc2614-0f56-4fba-80cf-edb08c3bd945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-853464701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3762723-9a3e-4116-8a5b-868aa9eb86a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35f9dea6fad44404bbb39e9b2dc402e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:10:36Z,use_quota=True,user_id='81d3fe86f5e840249afbacc98f77d900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(075ff2b1-98a8-465d-b4a6-17d7ad887542),volume_type_id=075ff2b1-98a8-465d-b4a6-17d7ad887542)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:10:35 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-26899898-7d31-463b-8006-7623d3245dcb tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bf5aad0-ccdb-4564-9ff7-6a43595fb910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:10:35 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-26899898-7d31-463b-8006-7623d3245dcb tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bf5aad0-ccdb-4564-9ff7-6a43595fb910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:10:35 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-26899898-7d31-463b-8006-7623d3245dcb tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1727d5b5-f4d6-4ed1-b2ff-a79c864f903f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:10:35 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-26899898-7d31-463b-8006-7623d3245dcb tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1727d5b5-f4d6-4ed1-b2ff-a79c864f903f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3762723-9a3e-4116-8a5b-868aa9eb86a7', 'volume_name': 'volume-c3762723-9a3e-4116-8a5b-868aa9eb86a7', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:10:35 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-26899898-7d31-463b-8006-7623d3245dcb tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a8073c5-ee45-4f28-8991-263348230f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:10:35 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-26899898-7d31-463b-8006-7623d3245dcb tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a8073c5-ee45-4f28-8991-263348230f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:10:35 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-26899898-7d31-463b-8006-7623d3245dcb tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (264fa678-2789-4985-ba2c-5a5c2ac22e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:10:35 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-26899898-7d31-463b-8006-7623d3245dcb tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Volume c3762723-9a3e-4116-8a5b-868aa9eb86a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3762723-9a3e-4116-8a5b-868aa9eb86a7', 'volume_size': 1} Jun 24 05:10:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-26899898-7d31-463b-8006-7623d3245dcb tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:10:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-26899898-7d31-463b-8006-7623d3245dcb tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:10:35 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-26899898-7d31-463b-8006-7623d3245dcb tempest-VolumeRetypeWithoutMigrationTest-185023636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-853464701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3762723-9a3e-4116-8a5b-868aa9eb86a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35f9dea6fad44404bbb39e9b2dc402e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:10:36Z,use_quota=True,user_id='81d3fe86f5e840249afbacc98f77d900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(075ff2b1-98a8-465d-b4a6-17d7ad887542),volume_type_id=075ff2b1-98a8-465d-b4a6-17d7ad887542)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:10:35 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-26899898-7d31-463b-8006-7623d3245dcb tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Creating volume c3762723-9a3e-4116-8a5b-868aa9eb86a7 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:10:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-26899898-7d31-463b-8006-7623d3245dcb tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:10:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-26899898-7d31-463b-8006-7623d3245dcb tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:10:35 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-26899898-7d31-463b-8006-7623d3245dcb tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:10:35 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-26899898-7d31-463b-8006-7623d3245dcb tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:10:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-26899898-7d31-463b-8006-7623d3245dcb tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:10:35 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-26899898-7d31-463b-8006-7623d3245dcb tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:10:35 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-26899898-7d31-463b-8006-7623d3245dcb tempest-VolumeRetypeWithoutMigrationTest-185023636 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:10:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-26899898-7d31-463b-8006-7623d3245dcb tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c3762723-9a3e-4116-8a5b-868aa9eb86a7 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:35 devstack sudo[108271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c3762723-9a3e-4116-8a5b-868aa9eb86a7 1073741824 Jun 24 05:10:35 devstack sudo[108271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:36 devstack sudo[108271]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-26899898-7d31-463b-8006-7623d3245dcb tempest-VolumeRetypeWithoutMigrationTest-185023636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c3762723-9a3e-4116-8a5b-868aa9eb86a7 1073741824" returned: 0 in 0.940s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-26899898-7d31-463b-8006-7623d3245dcb tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c3762723-9a3e-4116-8a5b-868aa9eb86a7 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:36 devstack sudo[108277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c3762723-9a3e-4116-8a5b-868aa9eb86a7 Jun 24 05:10:36 devstack sudo[108277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:37 devstack sudo[108277]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-26899898-7d31-463b-8006-7623d3245dcb tempest-VolumeRetypeWithoutMigrationTest-185023636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c3762723-9a3e-4116-8a5b-868aa9eb86a7" returned: 0 in 0.861s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:37 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-26899898-7d31-463b-8006-7623d3245dcb tempest-VolumeRetypeWithoutMigrationTest-185023636 None] <== create_volume: return (1853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:10:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-26899898-7d31-463b-8006-7623d3245dcb tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.855s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:10:37 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-26899898-7d31-463b-8006-7623d3245dcb tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (264fa678-2789-4985-ba2c-5a5c2ac22e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3762723-9a3e-4116-8a5b-868aa9eb86a7', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:10:37 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-26899898-7d31-463b-8006-7623d3245dcb tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8f28b2a-0a74-498a-af5e-66bf3daec5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:10:37 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-26899898-7d31-463b-8006-7623d3245dcb tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Volume volume-c3762723-9a3e-4116-8a5b-868aa9eb86a7 (c3762723-9a3e-4116-8a5b-868aa9eb86a7): created successfully Jun 24 05:10:37 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-26899898-7d31-463b-8006-7623d3245dcb tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8f28b2a-0a74-498a-af5e-66bf3daec5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:10:37 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-26899898-7d31-463b-8006-7623d3245dcb tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Flow 'volume_create_manager' (563d68a8-746f-433b-9e55-e3c1918acba8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:10:37 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-26899898-7d31-463b-8006-7623d3245dcb tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Created volume successfully. Jun 24 05:10:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-ee0cc720-c079-428b-b473-4b6db1c54b32 tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:10:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-ee0cc720-c079-428b-b473-4b6db1c54b32 tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:10:39 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-ee0cc720-c079-428b-b473-4b6db1c54b32 tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:10:39 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-ee0cc720-c079-428b-b473-4b6db1c54b32 tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:10:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-ee0cc720-c079-428b-b473-4b6db1c54b32 tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:10:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ee0cc720-c079-428b-b473-4b6db1c54b32 tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:39 devstack sudo[108323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:10:39 devstack sudo[108323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:40 devstack sudo[108323]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ee0cc720-c079-428b-b473-4b6db1c54b32 tempest-VolumeRetypeWithoutMigrationTest-185023636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.691s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:40 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-ee0cc720-c079-428b-b473-4b6db1c54b32 tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:10:40 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-ee0cc720-c079-428b-b473-4b6db1c54b32 tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Retype volume completed successfully. Jun 24 05:10:40 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-edd619c6-90d5-4d5b-bdb4-80f9dd994933 tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Acquiring lock "cinder-c3762723-9a3e-4116-8a5b-868aa9eb86a7-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:10:40 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-edd619c6-90d5-4d5b-bdb4-80f9dd994933 tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Lock "cinder-c3762723-9a3e-4116-8a5b-868aa9eb86a7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:10:40 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-edd619c6-90d5-4d5b-bdb4-80f9dd994933 tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Acquiring lock "cinder-quobyte-c3762723-9a3e-4116-8a5b-868aa9eb86a7" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:10:40 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-edd619c6-90d5-4d5b-bdb4-80f9dd994933 tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Lock "cinder-quobyte-c3762723-9a3e-4116-8a5b-868aa9eb86a7" acquired by "delete_volume" :: waited 0.016s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:10:40 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[291d52fd-7c9a-48a3-b59a-4010a4a09a98]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:10:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-edd619c6-90d5-4d5b-bdb4-80f9dd994933 tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c3762723-9a3e-4116-8a5b-868aa9eb86a7 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:40 devstack sudo[108330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c3762723-9a3e-4116-8a5b-868aa9eb86a7 Jun 24 05:10:40 devstack sudo[108330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:41 devstack sudo[108330]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-edd619c6-90d5-4d5b-bdb4-80f9dd994933 tempest-VolumeRetypeWithoutMigrationTest-185023636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c3762723-9a3e-4116-8a5b-868aa9eb86a7" returned: 0 in 0.818s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-edd619c6-90d5-4d5b-bdb4-80f9dd994933 tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c3762723-9a3e-4116-8a5b-868aa9eb86a7 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:41 devstack sudo[108335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c3762723-9a3e-4116-8a5b-868aa9eb86a7 Jun 24 05:10:41 devstack sudo[108335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:42 devstack sudo[108335]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-edd619c6-90d5-4d5b-bdb4-80f9dd994933 tempest-VolumeRetypeWithoutMigrationTest-185023636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c3762723-9a3e-4116-8a5b-868aa9eb86a7" returned: 0 in 0.736s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:42 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-edd619c6-90d5-4d5b-bdb4-80f9dd994933 tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Lock "cinder-quobyte-c3762723-9a3e-4116-8a5b-868aa9eb86a7" released by "delete_volume" :: held 1.599s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:10:42 devstack cinder-volume[93830]: WARNING cinder.quota [None req-edd619c6-90d5-4d5b-bdb4-80f9dd994933 tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 24 05:10:42 devstack cinder-volume[93830]: WARNING cinder.quota [None req-edd619c6-90d5-4d5b-bdb4-80f9dd994933 tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 24 05:10:42 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-edd619c6-90d5-4d5b-bdb4-80f9dd994933 tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Created reservations ['79c7cea0-8bcb-4e93-90db-5ef4594e9ef9', '66444ff4-7765-43e4-85d8-13a95ca6c970', 'bba35345-a5b4-4e20-a13e-8ca63a5aa7bc', 'd940fad0-aab8-4822-aedc-4217f931e6d9'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:10:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-edd619c6-90d5-4d5b-bdb4-80f9dd994933 tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:10:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-edd619c6-90d5-4d5b-bdb4-80f9dd994933 tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:10:42 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-edd619c6-90d5-4d5b-bdb4-80f9dd994933 tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:10:42 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-edd619c6-90d5-4d5b-bdb4-80f9dd994933 tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:10:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-edd619c6-90d5-4d5b-bdb4-80f9dd994933 tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:10:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-edd619c6-90d5-4d5b-bdb4-80f9dd994933 tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:42 devstack sudo[108338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:10:42 devstack sudo[108338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:43 devstack sudo[108338]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-edd619c6-90d5-4d5b-bdb4-80f9dd994933 tempest-VolumeRetypeWithoutMigrationTest-185023636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.680s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:43 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-edd619c6-90d5-4d5b-bdb4-80f9dd994933 tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:10:43 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-edd619c6-90d5-4d5b-bdb4-80f9dd994933 tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Deleted volume successfully. Jun 24 05:10:43 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-edd619c6-90d5-4d5b-bdb4-80f9dd994933 tempest-VolumeRetypeWithoutMigrationTest-185023636 None] Lock "cinder-c3762723-9a3e-4116-8a5b-868aa9eb86a7-delete_volume" released by "delete_volume" :: held 2.488s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:10:44 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-ee77c28b-6668-40e8-b9c5-ed243a6f51cf tempest-TestStampPattern-152240646 None] Acquiring lock "cinder-1a6bc804-759b-45dd-a3c1-ea242ab133b9-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:10:44 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-ee77c28b-6668-40e8-b9c5-ed243a6f51cf tempest-TestStampPattern-152240646 None] Lock "cinder-1a6bc804-759b-45dd-a3c1-ea242ab133b9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:10:44 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-ee77c28b-6668-40e8-b9c5-ed243a6f51cf tempest-TestStampPattern-152240646 None] Acquiring lock "cinder-quobyte-1a6bc804-759b-45dd-a3c1-ea242ab133b9" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:10:44 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-ee77c28b-6668-40e8-b9c5-ed243a6f51cf tempest-TestStampPattern-152240646 None] Lock "cinder-quobyte-1a6bc804-759b-45dd-a3c1-ea242ab133b9" acquired by "delete_volume" :: waited 0.019s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:10:44 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa444c2-6c6d-44fa-b072-e6f1030749bd]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:10:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ee77c28b-6668-40e8-b9c5-ed243a6f51cf tempest-TestStampPattern-152240646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-1a6bc804-759b-45dd-a3c1-ea242ab133b9 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:44 devstack sudo[108341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-1a6bc804-759b-45dd-a3c1-ea242ab133b9 Jun 24 05:10:44 devstack sudo[108341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:45 devstack sudo[108341]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ee77c28b-6668-40e8-b9c5-ed243a6f51cf tempest-TestStampPattern-152240646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-1a6bc804-759b-45dd-a3c1-ea242ab133b9" returned: 0 in 0.833s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ee77c28b-6668-40e8-b9c5-ed243a6f51cf tempest-TestStampPattern-152240646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-1a6bc804-759b-45dd-a3c1-ea242ab133b9 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:45 devstack sudo[108347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-1a6bc804-759b-45dd-a3c1-ea242ab133b9 Jun 24 05:10:45 devstack sudo[108347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:45 devstack sudo[108347]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ee77c28b-6668-40e8-b9c5-ed243a6f51cf tempest-TestStampPattern-152240646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-1a6bc804-759b-45dd-a3c1-ea242ab133b9" returned: 0 in 0.687s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:45 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-ee77c28b-6668-40e8-b9c5-ed243a6f51cf tempest-TestStampPattern-152240646 None] Lock "cinder-quobyte-1a6bc804-759b-45dd-a3c1-ea242ab133b9" released by "delete_volume" :: held 1.571s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:10:45 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-ee77c28b-6668-40e8-b9c5-ed243a6f51cf tempest-TestStampPattern-152240646 None] Created reservations ['3603da1c-43ef-405e-9573-eceed845bac1', '9ac962ad-5452-4d0c-a23f-f1419d30cb7c', 'e376eb07-aba7-429f-9ebb-cc1729c5c127', '8e9d9b8e-3080-4018-9002-56eb6fd15f30'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:10:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-ee77c28b-6668-40e8-b9c5-ed243a6f51cf tempest-TestStampPattern-152240646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:10:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-ee77c28b-6668-40e8-b9c5-ed243a6f51cf tempest-TestStampPattern-152240646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:10:46 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-ee77c28b-6668-40e8-b9c5-ed243a6f51cf tempest-TestStampPattern-152240646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:10:46 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-ee77c28b-6668-40e8-b9c5-ed243a6f51cf tempest-TestStampPattern-152240646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:10:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-ee77c28b-6668-40e8-b9c5-ed243a6f51cf tempest-TestStampPattern-152240646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:10:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ee77c28b-6668-40e8-b9c5-ed243a6f51cf tempest-TestStampPattern-152240646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:46 devstack sudo[108350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:10:46 devstack sudo[108350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:46 devstack sudo[108350]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ee77c28b-6668-40e8-b9c5-ed243a6f51cf tempest-TestStampPattern-152240646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.697s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:46 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-ee77c28b-6668-40e8-b9c5-ed243a6f51cf tempest-TestStampPattern-152240646 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:10:46 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-ee77c28b-6668-40e8-b9c5-ed243a6f51cf tempest-TestStampPattern-152240646 None] Deleted volume successfully. Jun 24 05:10:46 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-65c52967-7a86-48b8-915f-9e50f503a4e6 tempest-TestStampPattern-152240646 None] Acquiring lock "cinder-4fd1dc34-cdc5-4516-a335-271a2f775ae4-delete_snapshot" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:10:46 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-ee77c28b-6668-40e8-b9c5-ed243a6f51cf tempest-TestStampPattern-152240646 None] Lock "cinder-1a6bc804-759b-45dd-a3c1-ea242ab133b9-delete_volume" released by "delete_volume" :: held 2.617s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:10:46 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-65c52967-7a86-48b8-915f-9e50f503a4e6 tempest-TestStampPattern-152240646 None] Lock "cinder-4fd1dc34-cdc5-4516-a335-271a2f775ae4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:10:46 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-65c52967-7a86-48b8-915f-9e50f503a4e6 tempest-TestStampPattern-152240646 None] Acquiring lock "cinder-quobyte-20fcf990-b55f-4270-9b50-10eacc6473db" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:10:46 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-65c52967-7a86-48b8-915f-9e50f503a4e6 tempest-TestStampPattern-152240646 None] Lock "cinder-quobyte-20fcf990-b55f-4270-9b50-10eacc6473db" acquired by "delete_snapshot" :: waited 0.064s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:10:46 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-65c52967-7a86-48b8-915f-9e50f503a4e6 tempest-TestStampPattern-152240646 None] Acquiring lock "cinder-quobyte-4fd1dc34-cdc5-4516-a335-271a2f775ae4" by "_delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:10:46 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-65c52967-7a86-48b8-915f-9e50f503a4e6 tempest-TestStampPattern-152240646 None] Lock "cinder-quobyte-4fd1dc34-cdc5-4516-a335-271a2f775ae4" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:10:46 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-65c52967-7a86-48b8-915f-9e50f503a4e6 tempest-TestStampPattern-152240646 None] Deleting offline snapshot 4fd1dc34-cdc5-4516-a335-271a2f775ae4 of volume 20fcf990-b55f-4270-9b50-10eacc6473db {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 05:10:46 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-65c52967-7a86-48b8-915f-9e50f503a4e6 tempest-TestStampPattern-152240646 None] snapshot_file for this snap is: volume-20fcf990-b55f-4270-9b50-10eacc6473db.4fd1dc34-cdc5-4516-a335-271a2f775ae4 {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 05:10:46 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c11b78-02a6-4b66-a027-6d303a51738e]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:10:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-65c52967-7a86-48b8-915f-9e50f503a4e6 tempest-TestStampPattern-152240646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db.4fd1dc34-cdc5-4516-a335-271a2f775ae4 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:47 devstack sudo[108353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db.4fd1dc34-cdc5-4516-a335-271a2f775ae4 Jun 24 05:10:47 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:47 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-65c52967-7a86-48b8-915f-9e50f503a4e6 tempest-TestStampPattern-152240646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db.4fd1dc34-cdc5-4516-a335-271a2f775ae4" returned: 0 in 0.875s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:47 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-65c52967-7a86-48b8-915f-9e50f503a4e6 tempest-TestStampPattern-152240646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20fcf990-b55f-4270-9b50-10eacc6473db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:10:47 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[15de40be-602c-4992-af4f-292a2c42ee76]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:10:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-65c52967-7a86-48b8-915f-9e50f503a4e6 tempest-TestStampPattern-152240646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:47 devstack sudo[108358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db Jun 24 05:10:47 devstack sudo[108358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:48 devstack sudo[108358]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-65c52967-7a86-48b8-915f-9e50f503a4e6 tempest-TestStampPattern-152240646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db" returned: 0 in 0.911s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-65c52967-7a86-48b8-915f-9e50f503a4e6 tempest-TestStampPattern-152240646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db.4fd1dc34-cdc5-4516-a335-271a2f775ae4 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:48 devstack sudo[108364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db.4fd1dc34-cdc5-4516-a335-271a2f775ae4 Jun 24 05:10:48 devstack sudo[108364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:49 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-2be10c3c-5581-4103-93ba-dbe1cc917764 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:10:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2be10c3c-5581-4103-93ba-dbe1cc917764 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Flow 'volume_create_manager' (057bd9ac-0251-4dfd-b2e9-35664c3b589d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:10:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2be10c3c-5581-4103-93ba-dbe1cc917764 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75996078-094f-412b-8524-6aae70b91e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:10:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2be10c3c-5581-4103-93ba-dbe1cc917764 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75996078-094f-412b-8524-6aae70b91e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1393147810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24b54de5-aa1a-4d40-b5e3-045f034c948b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f3cc9efd8b74933b37657dda1cd3ebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:10:49Z,use_quota=True,user_id='3cc5f7c605cd4bf9a36e0379e2035be1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:10:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2be10c3c-5581-4103-93ba-dbe1cc917764 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c63224b9-1cf4-4c0e-8807-0e28991fa7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:10:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2be10c3c-5581-4103-93ba-dbe1cc917764 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c63224b9-1cf4-4c0e-8807-0e28991fa7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:10:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2be10c3c-5581-4103-93ba-dbe1cc917764 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b19b72ce-f1b6-4369-853b-7330a31b6683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:10:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2be10c3c-5581-4103-93ba-dbe1cc917764 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b19b72ce-f1b6-4369-853b-7330a31b6683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24b54de5-aa1a-4d40-b5e3-045f034c948b', 'volume_name': 'volume-24b54de5-aa1a-4d40-b5e3-045f034c948b', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:10:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2be10c3c-5581-4103-93ba-dbe1cc917764 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bd59c0b-2af7-49c5-8dff-64e77553475c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:10:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2be10c3c-5581-4103-93ba-dbe1cc917764 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bd59c0b-2af7-49c5-8dff-64e77553475c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:10:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2be10c3c-5581-4103-93ba-dbe1cc917764 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (391a5e3e-e694-4134-801b-c566377a3bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:10:49 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-2be10c3c-5581-4103-93ba-dbe1cc917764 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Volume 24b54de5-aa1a-4d40-b5e3-045f034c948b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24b54de5-aa1a-4d40-b5e3-045f034c948b', 'volume_size': 1} Jun 24 05:10:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-2be10c3c-5581-4103-93ba-dbe1cc917764 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:10:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-2be10c3c-5581-4103-93ba-dbe1cc917764 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:10:49 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-2be10c3c-5581-4103-93ba-dbe1cc917764 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1393147810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24b54de5-aa1a-4d40-b5e3-045f034c948b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f3cc9efd8b74933b37657dda1cd3ebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:10:49Z,use_quota=True,user_id='3cc5f7c605cd4bf9a36e0379e2035be1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:10:49 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-2be10c3c-5581-4103-93ba-dbe1cc917764 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Creating volume 24b54de5-aa1a-4d40-b5e3-045f034c948b {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:10:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-2be10c3c-5581-4103-93ba-dbe1cc917764 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:10:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-2be10c3c-5581-4103-93ba-dbe1cc917764 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:10:49 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-2be10c3c-5581-4103-93ba-dbe1cc917764 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:10:49 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-2be10c3c-5581-4103-93ba-dbe1cc917764 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:10:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-2be10c3c-5581-4103-93ba-dbe1cc917764 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:10:49 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-2be10c3c-5581-4103-93ba-dbe1cc917764 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:10:49 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-2be10c3c-5581-4103-93ba-dbe1cc917764 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:10:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2be10c3c-5581-4103-93ba-dbe1cc917764 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:49 devstack sudo[108366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b 1073741824 Jun 24 05:10:49 devstack sudo[108366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:49 devstack sudo[108364]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-65c52967-7a86-48b8-915f-9e50f503a4e6 tempest-TestStampPattern-152240646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db.4fd1dc34-cdc5-4516-a335-271a2f775ae4" returned: 0 in 0.902s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-65c52967-7a86-48b8-915f-9e50f503a4e6 tempest-TestStampPattern-152240646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db.4fd1dc34-cdc5-4516-a335-271a2f775ae4 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:49 devstack sudo[108372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db.4fd1dc34-cdc5-4516-a335-271a2f775ae4 Jun 24 05:10:49 devstack sudo[108372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:50 devstack sudo[108366]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2be10c3c-5581-4103-93ba-dbe1cc917764 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b 1073741824" returned: 0 in 1.175s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2be10c3c-5581-4103-93ba-dbe1cc917764 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:50 devstack sudo[108379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b Jun 24 05:10:50 devstack sudo[108379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:50 devstack sudo[108372]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-65c52967-7a86-48b8-915f-9e50f503a4e6 tempest-TestStampPattern-152240646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db.4fd1dc34-cdc5-4516-a335-271a2f775ae4" returned: 0 in 0.884s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:50 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-65c52967-7a86-48b8-915f-9e50f503a4e6 tempest-TestStampPattern-152240646 None] Lock "cinder-quobyte-4fd1dc34-cdc5-4516-a335-271a2f775ae4" released by "_delete_snapshot" :: held 3.723s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:10:50 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-65c52967-7a86-48b8-915f-9e50f503a4e6 tempest-TestStampPattern-152240646 None] Lock "cinder-quobyte-20fcf990-b55f-4270-9b50-10eacc6473db" released by "delete_snapshot" :: held 3.747s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:10:50 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-65c52967-7a86-48b8-915f-9e50f503a4e6 tempest-TestStampPattern-152240646 None] Created reservations ['8574342b-9aff-4fde-8143-46ec0af90bfb', '4741e2af-772e-4a6c-8d46-42b32b0e05ba', '5a3bcc46-2059-48dd-abf5-b8dad5df4c39', '94014b0e-e677-4f75-a3c6-b5af4abf732d'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:10:50 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-65c52967-7a86-48b8-915f-9e50f503a4e6 tempest-TestStampPattern-152240646 None] Delete snapshot completed successfully. Jun 24 05:10:50 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-65c52967-7a86-48b8-915f-9e50f503a4e6 tempest-TestStampPattern-152240646 None] Lock "cinder-4fd1dc34-cdc5-4516-a335-271a2f775ae4-delete_snapshot" released by "delete_snapshot" :: held 3.945s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:10:51 devstack sudo[108379]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2be10c3c-5581-4103-93ba-dbe1cc917764 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b" returned: 0 in 0.837s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:51 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-2be10c3c-5581-4103-93ba-dbe1cc917764 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] <== create_volume: return (2084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:10:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-2be10c3c-5581-4103-93ba-dbe1cc917764 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.087s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:10:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2be10c3c-5581-4103-93ba-dbe1cc917764 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (391a5e3e-e694-4134-801b-c566377a3bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24b54de5-aa1a-4d40-b5e3-045f034c948b', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:10:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2be10c3c-5581-4103-93ba-dbe1cc917764 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edc996aa-151e-47ab-9150-7f20118bacf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:10:51 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-2be10c3c-5581-4103-93ba-dbe1cc917764 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Volume volume-24b54de5-aa1a-4d40-b5e3-045f034c948b (24b54de5-aa1a-4d40-b5e3-045f034c948b): created successfully Jun 24 05:10:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2be10c3c-5581-4103-93ba-dbe1cc917764 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edc996aa-151e-47ab-9150-7f20118bacf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:10:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2be10c3c-5581-4103-93ba-dbe1cc917764 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Flow 'volume_create_manager' (057bd9ac-0251-4dfd-b2e9-35664c3b589d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:10:51 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-2be10c3c-5581-4103-93ba-dbe1cc917764 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Created volume successfully. Jun 24 05:10:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-128872ca-cb0e-4aaa-b629-fa37738f219a tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:10:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-128872ca-cb0e-4aaa-b629-fa37738f219a tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:10:52 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-128872ca-cb0e-4aaa-b629-fa37738f219a tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Creating offline snapshot e47829e4-b7cd-4daa-868b-019422fc0577 of volume 24b54de5-aa1a-4d40-b5e3-045f034c948b {{(pid=93830) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 05:10:52 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[f797298e-cbe1-446a-8fc9-5810705f32a7]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:10:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-128872ca-cb0e-4aaa-b629-fa37738f219a tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:52 devstack sudo[108384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b Jun 24 05:10:52 devstack sudo[108384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:54 devstack sudo[108384]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-128872ca-cb0e-4aaa-b629-fa37738f219a tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b" returned: 0 in 1.400s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-128872ca-cb0e-4aaa-b629-fa37738f219a tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b.e47829e4-b7cd-4daa-868b-019422fc0577 1G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:54 devstack sudo[108454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b.e47829e4-b7cd-4daa-868b-019422fc0577 1G Jun 24 05:10:54 devstack sudo[108454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:55 devstack sudo[108454]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-128872ca-cb0e-4aaa-b629-fa37738f219a tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b.e47829e4-b7cd-4daa-868b-019422fc0577 1G" returned: 0 in 1.028s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-128872ca-cb0e-4aaa-b629-fa37738f219a tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24b54de5-aa1a-4d40-b5e3-045f034c948b -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b.e47829e4-b7cd-4daa-868b-019422fc0577 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:55 devstack sudo[108486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24b54de5-aa1a-4d40-b5e3-045f034c948b -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b.e47829e4-b7cd-4daa-868b-019422fc0577 Jun 24 05:10:55 devstack sudo[108486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:56 devstack sudo[108486]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-128872ca-cb0e-4aaa-b629-fa37738f219a tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24b54de5-aa1a-4d40-b5e3-045f034c948b -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b.e47829e4-b7cd-4daa-868b-019422fc0577" returned: 0 in 0.829s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:56 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-128872ca-cb0e-4aaa-b629-fa37738f219a tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b.e47829e4-b7cd-4daa-868b-019422fc0577 is being set with open permissions: ugo+rw Jun 24 05:10:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-128872ca-cb0e-4aaa-b629-fa37738f219a tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b.e47829e4-b7cd-4daa-868b-019422fc0577 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:56 devstack sudo[108492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b.e47829e4-b7cd-4daa-868b-019422fc0577 Jun 24 05:10:56 devstack sudo[108492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:56 devstack sudo[108492]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-128872ca-cb0e-4aaa-b629-fa37738f219a tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b.e47829e4-b7cd-4daa-868b-019422fc0577" returned: 0 in 0.681s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-128872ca-cb0e-4aaa-b629-fa37738f219a tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:56 devstack sudo[108495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b.info Jun 24 05:10:56 devstack sudo[108495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:57 devstack sudo[108495]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-128872ca-cb0e-4aaa-b629-fa37738f219a tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b.info" returned: 0 in 0.687s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:57 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-128872ca-cb0e-4aaa-b629-fa37738f219a tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b.info is being set with open permissions: ugo+rw Jun 24 05:10:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-128872ca-cb0e-4aaa-b629-fa37738f219a tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:57 devstack sudo[108498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b.info Jun 24 05:10:57 devstack sudo[108498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:58 devstack sudo[108498]: pam_unix(sudo:session): session closed for user root Jun 24 05:10:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-128872ca-cb0e-4aaa-b629-fa37738f219a tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b.info" returned: 0 in 0.688s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:10:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-128872ca-cb0e-4aaa-b629-fa37738f219a tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.433s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:10:58 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-128872ca-cb0e-4aaa-b629-fa37738f219a tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Create snapshot completed successfully Jun 24 05:10:59 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-faf0cc06-3ee5-45f1-912d-ce08827f765c tempest-TestStampPattern-152240646 None] Acquiring lock "cinder-20fcf990-b55f-4270-9b50-10eacc6473db-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:10:59 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-faf0cc06-3ee5-45f1-912d-ce08827f765c tempest-TestStampPattern-152240646 None] Lock "cinder-20fcf990-b55f-4270-9b50-10eacc6473db-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:10:59 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-faf0cc06-3ee5-45f1-912d-ce08827f765c tempest-TestStampPattern-152240646 None] Acquiring lock "cinder-quobyte-20fcf990-b55f-4270-9b50-10eacc6473db" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:10:59 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-faf0cc06-3ee5-45f1-912d-ce08827f765c tempest-TestStampPattern-152240646 None] Lock "cinder-quobyte-20fcf990-b55f-4270-9b50-10eacc6473db" acquired by "delete_volume" :: waited 0.019s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:10:59 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca84c6ac-7f6e-4c1e-bd6c-83c70d90d9f8]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:10:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-faf0cc06-3ee5-45f1-912d-ce08827f765c tempest-TestStampPattern-152240646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:59 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-6c714943-263a-4d7a-9dc8-61769737a447 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Acquiring lock "cinder-e47829e4-b7cd-4daa-868b-019422fc0577-delete_snapshot" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:10:59 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-6c714943-263a-4d7a-9dc8-61769737a447 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Lock "cinder-e47829e4-b7cd-4daa-868b-019422fc0577-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:10:59 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-6c714943-263a-4d7a-9dc8-61769737a447 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Acquiring lock "cinder-quobyte-24b54de5-aa1a-4d40-b5e3-045f034c948b" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:10:59 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-6c714943-263a-4d7a-9dc8-61769737a447 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Lock "cinder-quobyte-24b54de5-aa1a-4d40-b5e3-045f034c948b" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:10:59 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-6c714943-263a-4d7a-9dc8-61769737a447 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Acquiring lock "cinder-quobyte-e47829e4-b7cd-4daa-868b-019422fc0577" by "_delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:10:59 devstack sudo[108501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db Jun 24 05:10:59 devstack sudo[108501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:10:59 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-6c714943-263a-4d7a-9dc8-61769737a447 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Lock "cinder-quobyte-e47829e4-b7cd-4daa-868b-019422fc0577" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:10:59 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-6c714943-263a-4d7a-9dc8-61769737a447 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Deleting offline snapshot e47829e4-b7cd-4daa-868b-019422fc0577 of volume 24b54de5-aa1a-4d40-b5e3-045f034c948b {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 05:10:59 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-6c714943-263a-4d7a-9dc8-61769737a447 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] snapshot_file for this snap is: volume-24b54de5-aa1a-4d40-b5e3-045f034c948b.e47829e4-b7cd-4daa-868b-019422fc0577 {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 05:10:59 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[e029c4a6-6466-4dff-8208-e251d704bd47]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:10:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6c714943-263a-4d7a-9dc8-61769737a447 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b.e47829e4-b7cd-4daa-868b-019422fc0577 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:10:59 devstack sudo[108503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b.e47829e4-b7cd-4daa-868b-019422fc0577 Jun 24 05:10:59 devstack sudo[108503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:11:00 devstack sudo[108501]: pam_unix(sudo:session): session closed for user root Jun 24 05:11:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-faf0cc06-3ee5-45f1-912d-ce08827f765c tempest-TestStampPattern-152240646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db" returned: 0 in 1.123s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:11:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-faf0cc06-3ee5-45f1-912d-ce08827f765c tempest-TestStampPattern-152240646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:11:00 devstack sudo[108512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db Jun 24 05:11:00 devstack sudo[108512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:11:00 devstack sudo[108503]: pam_unix(sudo:session): session closed for user root Jun 24 05:11:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6c714943-263a-4d7a-9dc8-61769737a447 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b.e47829e4-b7cd-4daa-868b-019422fc0577" returned: 0 in 1.070s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:11:00 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-6c714943-263a-4d7a-9dc8-61769737a447 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24b54de5-aa1a-4d40-b5e3-045f034c948b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:11:00 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[2798f971-86e5-42e4-b668-e3ad420a96aa]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:11:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6c714943-263a-4d7a-9dc8-61769737a447 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:11:01 devstack sudo[108516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b Jun 24 05:11:01 devstack sudo[108516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:11:01 devstack sudo[108512]: pam_unix(sudo:session): session closed for user root Jun 24 05:11:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-faf0cc06-3ee5-45f1-912d-ce08827f765c tempest-TestStampPattern-152240646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-20fcf990-b55f-4270-9b50-10eacc6473db" returned: 0 in 0.710s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:11:01 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-faf0cc06-3ee5-45f1-912d-ce08827f765c tempest-TestStampPattern-152240646 None] Lock "cinder-quobyte-20fcf990-b55f-4270-9b50-10eacc6473db" released by "delete_volume" :: held 1.922s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:11:01 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-faf0cc06-3ee5-45f1-912d-ce08827f765c tempest-TestStampPattern-152240646 None] Created reservations ['4105c0d2-b45d-4697-8818-ea61ef3e78ad', '50c53380-d6d4-4668-b855-445bb2cf8118', '9d5a2f9c-cb1b-4a87-b6d8-5e6ecb52d3be', '6e99a56d-4e92-40d3-9733-6449d4eb5af3'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:11:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-faf0cc06-3ee5-45f1-912d-ce08827f765c tempest-TestStampPattern-152240646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:11:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-faf0cc06-3ee5-45f1-912d-ce08827f765c tempest-TestStampPattern-152240646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:11:01 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-faf0cc06-3ee5-45f1-912d-ce08827f765c tempest-TestStampPattern-152240646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:11:01 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-faf0cc06-3ee5-45f1-912d-ce08827f765c tempest-TestStampPattern-152240646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:11:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-faf0cc06-3ee5-45f1-912d-ce08827f765c tempest-TestStampPattern-152240646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:11:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-faf0cc06-3ee5-45f1-912d-ce08827f765c tempest-TestStampPattern-152240646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:11:01 devstack sudo[108519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:11:01 devstack sudo[108519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:11:01 devstack sudo[108516]: pam_unix(sudo:session): session closed for user root Jun 24 05:11:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6c714943-263a-4d7a-9dc8-61769737a447 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b" returned: 0 in 0.912s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:11:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6c714943-263a-4d7a-9dc8-61769737a447 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b.e47829e4-b7cd-4daa-868b-019422fc0577 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:11:01 devstack sudo[108524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b.e47829e4-b7cd-4daa-868b-019422fc0577 Jun 24 05:11:01 devstack sudo[108524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:11:02 devstack sudo[108519]: pam_unix(sudo:session): session closed for user root Jun 24 05:11:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-faf0cc06-3ee5-45f1-912d-ce08827f765c tempest-TestStampPattern-152240646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.906s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:11:02 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-faf0cc06-3ee5-45f1-912d-ce08827f765c tempest-TestStampPattern-152240646 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:11:02 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-faf0cc06-3ee5-45f1-912d-ce08827f765c tempest-TestStampPattern-152240646 None] Deleted volume successfully. Jun 24 05:11:02 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-faf0cc06-3ee5-45f1-912d-ce08827f765c tempest-TestStampPattern-152240646 None] Lock "cinder-20fcf990-b55f-4270-9b50-10eacc6473db-delete_volume" released by "delete_volume" :: held 3.085s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:11:02 devstack sudo[108524]: pam_unix(sudo:session): session closed for user root Jun 24 05:11:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6c714943-263a-4d7a-9dc8-61769737a447 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b.e47829e4-b7cd-4daa-868b-019422fc0577" returned: 0 in 0.966s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:11:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6c714943-263a-4d7a-9dc8-61769737a447 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b.e47829e4-b7cd-4daa-868b-019422fc0577 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:11:02 devstack sudo[108531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b.e47829e4-b7cd-4daa-868b-019422fc0577 Jun 24 05:11:02 devstack sudo[108531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:11:03 devstack sudo[108531]: pam_unix(sudo:session): session closed for user root Jun 24 05:11:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6c714943-263a-4d7a-9dc8-61769737a447 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b.e47829e4-b7cd-4daa-868b-019422fc0577" returned: 0 in 0.778s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:11:03 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-6c714943-263a-4d7a-9dc8-61769737a447 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Lock "cinder-quobyte-e47829e4-b7cd-4daa-868b-019422fc0577" released by "_delete_snapshot" :: held 3.866s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:11:03 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-6c714943-263a-4d7a-9dc8-61769737a447 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Lock "cinder-quobyte-24b54de5-aa1a-4d40-b5e3-045f034c948b" released by "delete_snapshot" :: held 3.903s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:11:03 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-6c714943-263a-4d7a-9dc8-61769737a447 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Created reservations ['b91ef5c6-d76d-4e06-b223-81d2062f1d36', '53e2cf45-0c7f-465d-89bb-1d46d0546345', '62e397e2-1990-4496-8540-e17636920c7c', 'd940b5d6-0b4d-47fe-b07e-2c3180a9896b'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:11:03 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-6c714943-263a-4d7a-9dc8-61769737a447 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Delete snapshot completed successfully. Jun 24 05:11:03 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-6c714943-263a-4d7a-9dc8-61769737a447 tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Lock "cinder-e47829e4-b7cd-4daa-868b-019422fc0577-delete_snapshot" released by "delete_snapshot" :: held 4.086s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:11:04 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-701720a9-eb1b-48a4-8d19-dad1e411c19d tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Acquiring lock "cinder-24b54de5-aa1a-4d40-b5e3-045f034c948b-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:11:04 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-701720a9-eb1b-48a4-8d19-dad1e411c19d tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Lock "cinder-24b54de5-aa1a-4d40-b5e3-045f034c948b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:11:04 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-701720a9-eb1b-48a4-8d19-dad1e411c19d tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Acquiring lock "cinder-quobyte-24b54de5-aa1a-4d40-b5e3-045f034c948b" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:11:04 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-701720a9-eb1b-48a4-8d19-dad1e411c19d tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Lock "cinder-quobyte-24b54de5-aa1a-4d40-b5e3-045f034c948b" acquired by "delete_volume" :: waited 0.019s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:11:04 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0212f7-dc3e-4090-a588-3dcecc74d7d7]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:11:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-701720a9-eb1b-48a4-8d19-dad1e411c19d tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:11:04 devstack sudo[108535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b Jun 24 05:11:04 devstack sudo[108535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:11:05 devstack sudo[108535]: pam_unix(sudo:session): session closed for user root Jun 24 05:11:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-701720a9-eb1b-48a4-8d19-dad1e411c19d tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b" returned: 0 in 0.945s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:11:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-701720a9-eb1b-48a4-8d19-dad1e411c19d tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:11:05 devstack sudo[108547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b Jun 24 05:11:05 devstack sudo[108547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:11:05 devstack sudo[108547]: pam_unix(sudo:session): session closed for user root Jun 24 05:11:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-701720a9-eb1b-48a4-8d19-dad1e411c19d tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-24b54de5-aa1a-4d40-b5e3-045f034c948b" returned: 0 in 0.828s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:11:06 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-701720a9-eb1b-48a4-8d19-dad1e411c19d tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Lock "cinder-quobyte-24b54de5-aa1a-4d40-b5e3-045f034c948b" released by "delete_volume" :: held 1.869s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:11:06 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-701720a9-eb1b-48a4-8d19-dad1e411c19d tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Created reservations ['031e211c-a006-4b42-a3c9-ccf0c51d1bee', '6713936d-1681-42a9-aae1-8c3d821520ca', '8969eb53-bf42-4035-b7ec-4f290c6be7b3', '0028ba18-690c-4226-ad3a-4a01d21a6038'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:11:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-701720a9-eb1b-48a4-8d19-dad1e411c19d tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:11:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-701720a9-eb1b-48a4-8d19-dad1e411c19d tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:11:06 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-701720a9-eb1b-48a4-8d19-dad1e411c19d tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:11:06 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-701720a9-eb1b-48a4-8d19-dad1e411c19d tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:11:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-701720a9-eb1b-48a4-8d19-dad1e411c19d tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:11:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-701720a9-eb1b-48a4-8d19-dad1e411c19d tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:11:06 devstack sudo[108550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:11:06 devstack sudo[108550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:11:07 devstack sudo[108550]: pam_unix(sudo:session): session closed for user root Jun 24 05:11:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-701720a9-eb1b-48a4-8d19-dad1e411c19d tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.910s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:11:07 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-701720a9-eb1b-48a4-8d19-dad1e411c19d tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:11:07 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-701720a9-eb1b-48a4-8d19-dad1e411c19d tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Deleted volume successfully. Jun 24 05:11:07 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-701720a9-eb1b-48a4-8d19-dad1e411c19d tempest-VolumeSnapshotQuotasNegativeTestJSON-1588648800 None] Lock "cinder-24b54de5-aa1a-4d40-b5e3-045f034c948b-delete_volume" released by "delete_volume" :: held 3.099s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:11:09 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 05:11:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:11:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:11:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:11:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:11:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:11:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:11:09 devstack sudo[108555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:11:09 devstack sudo[108555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:11:10 devstack sudo[108555]: pam_unix(sudo:session): session closed for user root Jun 24 05:11:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.946s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:11:10 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:11:10 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager._thread_info {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 05:11:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread count: 29 {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 05:11:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread info: [<_MainThread(MainThread, started 130211312517248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 05:11:16 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:SELECT=75,cinder:UPDATE=91,cinder:INSERT=22,cinder:DELETE=5 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:11:17 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:UPDATE=81,cinder:DELETE=4,cinder:SELECT=76,cinder:INSERT=18 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:11:29 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:11:30 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Flow 'volume_create_manager' (c2cda04d-d4e6-4677-a48b-729b7312f574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:11:30 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb99b439-e74d-40ab-8ba2-f287410ef124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:11:30 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb99b439-e74d-40ab-8ba2-f287410ef124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2019416318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb5bd68e-64b9-4db9-9721-1403fffc9a46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b683bf63f4fa4e7e99a89fe3e35406bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:11:30Z,use_quota=True,user_id='8de96fac6bc14be5a88fc2fef76a29d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:11:30 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7248f90-16ad-45a1-85f8-893643c7474b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:11:30 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7248f90-16ad-45a1-85f8-893643c7474b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:11:30 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc0a9137-139d-40c4-8f6a-6e8116fa0cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:11:30 devstack cinder-volume[93830]: DEBUG cinder.image.glance [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Creating Keystone auth plugin from conf {{(pid=93830) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 24 05:11:30 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc0a9137-139d-40c4-8f6a-6e8116fa0cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bb5bd68e-64b9-4db9-9721-1403fffc9a46', 'volume_name': 'volume-bb5bd68e-64b9-4db9-9721-1403fffc9a46', 'volume_size': 1, 'image_id': 'f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f7b9466e67614ef6a2783f0123a80489', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'created_at': datetime.datetime(2026, 6, 24, 2, 51, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 51, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:11:30 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83f055ad-eba1-4788-a617-c1bec4d718a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:11:30 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83f055ad-eba1-4788-a617-c1bec4d718a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:11:30 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ffc402f-deb9-4340-8e1c-08840f05ba1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:11:30 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Volume bb5bd68e-64b9-4db9-9721-1403fffc9a46: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bb5bd68e-64b9-4db9-9721-1403fffc9a46', 'volume_size': 1, 'image_id': 'f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f7b9466e67614ef6a2783f0123a80489', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'created_at': datetime.datetime(2026, 6, 24, 2, 51, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 51, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 24 05:11:30 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Trying to clone bb5bd68e-64b9-4db9-9721-1403fffc9a46 from image f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'metadata': {}}]). {{(pid=93830) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 24 05:11:31 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_tfwmn28mdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93830) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 24 05:11:31 devstack cinder-volume[93830]: INFO cinder.image.image_utils [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Image download 20.69 MB at 20.69 MB/s Jun 24 05:11:31 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba581af-aa14-422a-bd7f-2af5e3dbba44]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:11:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_tfwmn28mdevstack@QuobyteHD {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:11:31 devstack sudo[108695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_tfwmn28mdevstack@QuobyteHD Jun 24 05:11:31 devstack sudo[108695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:11:32 devstack sudo[108695]: pam_unix(sudo:session): session closed for user root Jun 24 05:11:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_tfwmn28mdevstack@QuobyteHD" returned: 0 in 1.177s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:11:32 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Temporary image f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1 is fetched for user 8de96fac6bc14be5a88fc2fef76a29d8. {{(pid=93830) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 24 05:11:32 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[12826dbf-7428-45c9-9bd5-d9e771f30163]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:11:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_tfwmn28mdevstack@QuobyteHD {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:11:32 devstack sudo[108710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_tfwmn28mdevstack@QuobyteHD Jun 24 05:11:32 devstack sudo[108710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:11:33 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0ffe57d-7b15-41bf-b2b9-1500628964f0 tempest-TestMinimumBasicScenario-62037080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:11:33 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e0ffe57d-7b15-41bf-b2b9-1500628964f0 tempest-TestMinimumBasicScenario-62037080 None] Flow 'volume_create_manager' (18afa038-5ae8-4476-99e4-bbbaa6140d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:11:33 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e0ffe57d-7b15-41bf-b2b9-1500628964f0 tempest-TestMinimumBasicScenario-62037080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28b5ea3c-30a2-4906-aab2-f4a65797a491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:11:33 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e0ffe57d-7b15-41bf-b2b9-1500628964f0 tempest-TestMinimumBasicScenario-62037080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28b5ea3c-30a2-4906-aab2-f4a65797a491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-432432483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9699b94-47a4-4bf6-8a8a-ca350e22e385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9ef719f636541ef857c32c85f74ee98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:11:34Z,use_quota=True,user_id='ae769ca2949942e9a6f122975f36f0ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:11:33 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e0ffe57d-7b15-41bf-b2b9-1500628964f0 tempest-TestMinimumBasicScenario-62037080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8b39e4d-ddd9-40e2-b5a7-01f8e7086b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:11:33 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e0ffe57d-7b15-41bf-b2b9-1500628964f0 tempest-TestMinimumBasicScenario-62037080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8b39e4d-ddd9-40e2-b5a7-01f8e7086b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:11:33 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e0ffe57d-7b15-41bf-b2b9-1500628964f0 tempest-TestMinimumBasicScenario-62037080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (000b17b5-2a0c-40fb-b061-eb24134d9e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:11:33 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e0ffe57d-7b15-41bf-b2b9-1500628964f0 tempest-TestMinimumBasicScenario-62037080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (000b17b5-2a0c-40fb-b061-eb24134d9e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9699b94-47a4-4bf6-8a8a-ca350e22e385', 'volume_name': 'volume-b9699b94-47a4-4bf6-8a8a-ca350e22e385', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:11:33 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e0ffe57d-7b15-41bf-b2b9-1500628964f0 tempest-TestMinimumBasicScenario-62037080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acc8d43a-d950-403c-8b41-8a4f80596843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:11:33 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e0ffe57d-7b15-41bf-b2b9-1500628964f0 tempest-TestMinimumBasicScenario-62037080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acc8d43a-d950-403c-8b41-8a4f80596843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:11:33 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e0ffe57d-7b15-41bf-b2b9-1500628964f0 tempest-TestMinimumBasicScenario-62037080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edc009e4-9290-497b-b2fb-88b1434350d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:11:33 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-e0ffe57d-7b15-41bf-b2b9-1500628964f0 tempest-TestMinimumBasicScenario-62037080 None] Volume b9699b94-47a4-4bf6-8a8a-ca350e22e385: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9699b94-47a4-4bf6-8a8a-ca350e22e385', 'volume_size': 1} Jun 24 05:11:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e0ffe57d-7b15-41bf-b2b9-1500628964f0 tempest-TestMinimumBasicScenario-62037080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:11:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e0ffe57d-7b15-41bf-b2b9-1500628964f0 tempest-TestMinimumBasicScenario-62037080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:11:33 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e0ffe57d-7b15-41bf-b2b9-1500628964f0 tempest-TestMinimumBasicScenario-62037080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-432432483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9699b94-47a4-4bf6-8a8a-ca350e22e385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9ef719f636541ef857c32c85f74ee98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:11:34Z,use_quota=True,user_id='ae769ca2949942e9a6f122975f36f0ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:11:33 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-e0ffe57d-7b15-41bf-b2b9-1500628964f0 tempest-TestMinimumBasicScenario-62037080 None] Creating volume b9699b94-47a4-4bf6-8a8a-ca350e22e385 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:11:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e0ffe57d-7b15-41bf-b2b9-1500628964f0 tempest-TestMinimumBasicScenario-62037080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:11:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e0ffe57d-7b15-41bf-b2b9-1500628964f0 tempest-TestMinimumBasicScenario-62037080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:11:33 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e0ffe57d-7b15-41bf-b2b9-1500628964f0 tempest-TestMinimumBasicScenario-62037080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:11:33 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e0ffe57d-7b15-41bf-b2b9-1500628964f0 tempest-TestMinimumBasicScenario-62037080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:11:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e0ffe57d-7b15-41bf-b2b9-1500628964f0 tempest-TestMinimumBasicScenario-62037080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:11:33 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e0ffe57d-7b15-41bf-b2b9-1500628964f0 tempest-TestMinimumBasicScenario-62037080 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:11:33 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-e0ffe57d-7b15-41bf-b2b9-1500628964f0 tempest-TestMinimumBasicScenario-62037080 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:11:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e0ffe57d-7b15-41bf-b2b9-1500628964f0 tempest-TestMinimumBasicScenario-62037080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b9699b94-47a4-4bf6-8a8a-ca350e22e385 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:11:34 devstack sudo[108710]: pam_unix(sudo:session): session closed for user root Jun 24 05:11:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_tfwmn28mdevstack@QuobyteHD" returned: 0 in 1.369s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:11:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:11:34 devstack sudo[108742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b9699b94-47a4-4bf6-8a8a-ca350e22e385 1073741824 Jun 24 05:11:34 devstack sudo[108742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:11:34 devstack sudo[108742]: pam_unix(sudo:session): session closed for user root Jun 24 05:11:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e0ffe57d-7b15-41bf-b2b9-1500628964f0 tempest-TestMinimumBasicScenario-62037080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b9699b94-47a4-4bf6-8a8a-ca350e22e385 1073741824" returned: 0 in 0.976s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:11:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e0ffe57d-7b15-41bf-b2b9-1500628964f0 tempest-TestMinimumBasicScenario-62037080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b9699b94-47a4-4bf6-8a8a-ca350e22e385 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:11:35 devstack sudo[108748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b9699b94-47a4-4bf6-8a8a-ca350e22e385 Jun 24 05:11:35 devstack sudo[108748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:11:36 devstack sudo[108748]: pam_unix(sudo:session): session closed for user root Jun 24 05:11:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e0ffe57d-7b15-41bf-b2b9-1500628964f0 tempest-TestMinimumBasicScenario-62037080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b9699b94-47a4-4bf6-8a8a-ca350e22e385" returned: 0 in 1.033s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:11:36 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e0ffe57d-7b15-41bf-b2b9-1500628964f0 tempest-TestMinimumBasicScenario-62037080 None] <== create_volume: return (2073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:11:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e0ffe57d-7b15-41bf-b2b9-1500628964f0 tempest-TestMinimumBasicScenario-62037080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.079s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:11:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.012s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:11:36 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2019416318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb5bd68e-64b9-4db9-9721-1403fffc9a46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b683bf63f4fa4e7e99a89fe3e35406bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:11:30Z,use_quota=True,user_id='8de96fac6bc14be5a88fc2fef76a29d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:11:36 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Creating volume bb5bd68e-64b9-4db9-9721-1403fffc9a46 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:11:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:11:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:11:36 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:11:36 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:11:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:11:36 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:11:36 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:11:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bb5bd68e-64b9-4db9-9721-1403fffc9a46 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:11:36 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e0ffe57d-7b15-41bf-b2b9-1500628964f0 tempest-TestMinimumBasicScenario-62037080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edc009e4-9290-497b-b2fb-88b1434350d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9699b94-47a4-4bf6-8a8a-ca350e22e385', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:11:36 devstack sudo[108751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bb5bd68e-64b9-4db9-9721-1403fffc9a46 1073741824 Jun 24 05:11:36 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e0ffe57d-7b15-41bf-b2b9-1500628964f0 tempest-TestMinimumBasicScenario-62037080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55fac6a6-0c03-4770-9114-6d8deacdabaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:11:36 devstack sudo[108751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:11:36 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-e0ffe57d-7b15-41bf-b2b9-1500628964f0 tempest-TestMinimumBasicScenario-62037080 None] Volume volume-b9699b94-47a4-4bf6-8a8a-ca350e22e385 (b9699b94-47a4-4bf6-8a8a-ca350e22e385): created successfully Jun 24 05:11:36 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e0ffe57d-7b15-41bf-b2b9-1500628964f0 tempest-TestMinimumBasicScenario-62037080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55fac6a6-0c03-4770-9114-6d8deacdabaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:11:36 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e0ffe57d-7b15-41bf-b2b9-1500628964f0 tempest-TestMinimumBasicScenario-62037080 None] Flow 'volume_create_manager' (18afa038-5ae8-4476-99e4-bbbaa6140d6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:11:36 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-e0ffe57d-7b15-41bf-b2b9-1500628964f0 tempest-TestMinimumBasicScenario-62037080 None] Created volume successfully. Jun 24 05:11:37 devstack sudo[108751]: pam_unix(sudo:session): session closed for user root Jun 24 05:11:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bb5bd68e-64b9-4db9-9721-1403fffc9a46 1073741824" returned: 0 in 1.339s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:11:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bb5bd68e-64b9-4db9-9721-1403fffc9a46 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:11:37 devstack sudo[108759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bb5bd68e-64b9-4db9-9721-1403fffc9a46 Jun 24 05:11:37 devstack sudo[108759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:11:38 devstack sudo[108759]: pam_unix(sudo:session): session closed for user root Jun 24 05:11:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bb5bd68e-64b9-4db9-9721-1403fffc9a46" returned: 0 in 1.019s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:11:38 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] <== create_volume: return (2415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:11:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.422s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:11:38 devstack cinder-volume[93830]: DEBUG cinder.volume.volume_utils [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Attempting download of f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1 ((None, [{'url': 'file:///opt/stack/data/glance/images/f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'metadata': {}}])) to volume bb5bd68e-64b9-4db9-9721-1403fffc9a46. {{(pid=93830) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 24 05:11:38 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34d63d2-6a21-4446-9ea2-f14e0c72d05e]: (4, 'raw') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:11:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_tn58b_gg {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:11:38 devstack sudo[108762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_tn58b_gg Jun 24 05:11:38 devstack sudo[108762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:11:39 devstack sudo[108762]: pam_unix(sudo:session): session closed for user root Jun 24 05:11:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_tn58b_gg" returned: 0 in 0.971s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:11:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_tn58b_gg {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:11:39 devstack sudo[108766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_tn58b_gg Jun 24 05:11:39 devstack sudo[108766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:11:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-c6dd8d02-5a1c-4dee-8475-bd194b4bf9ee req-611bc3f4-ee34-459b-9e23-7ef30fdab353 tempest-TestMinimumBasicScenario-62037080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:11:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-c6dd8d02-5a1c-4dee-8475-bd194b4bf9ee req-611bc3f4-ee34-459b-9e23-7ef30fdab353 tempest-TestMinimumBasicScenario-62037080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:11:40 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c15ee86-1bb6-467f-bffb-95ef1f6b03fc]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:11:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-c6dd8d02-5a1c-4dee-8475-bd194b4bf9ee req-611bc3f4-ee34-459b-9e23-7ef30fdab353 tempest-TestMinimumBasicScenario-62037080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b9699b94-47a4-4bf6-8a8a-ca350e22e385 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:11:40 devstack sudo[108777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b9699b94-47a4-4bf6-8a8a-ca350e22e385 Jun 24 05:11:40 devstack sudo[108777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:11:40 devstack sudo[108766]: pam_unix(sudo:session): session closed for user root Jun 24 05:11:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_tn58b_gg" returned: 1 in 1.117s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:11:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_tn58b_gg' failed. Not Retrying. {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 05:11:40 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7c5760-86af-44e1-90e5-e2ef8f9339d0]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:11:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_tfwmn28mdevstack@QuobyteHD {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:11:40 devstack sudo[108781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_tfwmn28mdevstack@QuobyteHD Jun 24 05:11:40 devstack sudo[108781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:11:41 devstack sudo[108777]: pam_unix(sudo:session): session closed for user root Jun 24 05:11:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-c6dd8d02-5a1c-4dee-8475-bd194b4bf9ee req-611bc3f4-ee34-459b-9e23-7ef30fdab353 tempest-TestMinimumBasicScenario-62037080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b9699b94-47a4-4bf6-8a8a-ca350e22e385" returned: 0 in 1.408s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:11:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-c6dd8d02-5a1c-4dee-8475-bd194b4bf9ee req-611bc3f4-ee34-459b-9e23-7ef30fdab353 tempest-TestMinimumBasicScenario-62037080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.433s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:11:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-c6dd8d02-5a1c-4dee-8475-bd194b4bf9ee req-611bc3f4-ee34-459b-9e23-7ef30fdab353 tempest-TestMinimumBasicScenario-62037080 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05', 'name': 'volume-b9699b94-47a4-4bf6-8a8a-ca350e22e385', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6df40f9b-19ce-45e6-ac99-8888abcbf8ae', 'enforce_multipath': True} {{(pid=93830) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 05:11:41 devstack sudo[108781]: pam_unix(sudo:session): session closed for user root Jun 24 05:11:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_tfwmn28mdevstack@QuobyteHD" returned: 0 in 1.258s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:11:41 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1 was qcow2, converting to raw {{(pid=93830) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 24 05:11:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_tfwmn28mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bb5bd68e-64b9-4db9-9721-1403fffc9a46 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:11:41 devstack sudo[108809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_tfwmn28mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bb5bd68e-64b9-4db9-9721-1403fffc9a46 Jun 24 05:11:41 devstack sudo[108809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:11:42 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-c6dd8d02-5a1c-4dee-8475-bd194b4bf9ee req-611bc3f4-ee34-459b-9e23-7ef30fdab353 tempest-TestMinimumBasicScenario-62037080 None] attachment_update completed successfully. Jun 24 05:11:42 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e5e9626-2e04-4804-82eb-edf9548b6b50 tempest-SnapshotDependencyTests-2077334849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:11:42 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7e5e9626-2e04-4804-82eb-edf9548b6b50 tempest-SnapshotDependencyTests-2077334849 None] Flow 'volume_create_manager' (58b1d75d-85cf-4dbe-829e-27ee262dc94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:11:42 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7e5e9626-2e04-4804-82eb-edf9548b6b50 tempest-SnapshotDependencyTests-2077334849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f96a4d85-42d0-4a74-95d9-f3c8d8c86a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:11:42 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7e5e9626-2e04-4804-82eb-edf9548b6b50 tempest-SnapshotDependencyTests-2077334849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f96a4d85-42d0-4a74-95d9-f3c8d8c86a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-67724922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa13b0be-1d50-43ae-a2df-47e40d6e85d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093fe50c881b4ea2b3e9b736aaa18964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:11:43Z,use_quota=True,user_id='7b09f23356cc44d29ad7a2615004c745',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:11:42 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7e5e9626-2e04-4804-82eb-edf9548b6b50 tempest-SnapshotDependencyTests-2077334849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fb94135-2ae0-4afb-9e43-463b1477fe10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:11:42 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7e5e9626-2e04-4804-82eb-edf9548b6b50 tempest-SnapshotDependencyTests-2077334849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fb94135-2ae0-4afb-9e43-463b1477fe10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:11:42 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7e5e9626-2e04-4804-82eb-edf9548b6b50 tempest-SnapshotDependencyTests-2077334849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (230f1870-be1a-4e80-852e-7576a4eeb4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:11:42 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7e5e9626-2e04-4804-82eb-edf9548b6b50 tempest-SnapshotDependencyTests-2077334849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (230f1870-be1a-4e80-852e-7576a4eeb4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa13b0be-1d50-43ae-a2df-47e40d6e85d9', 'volume_name': 'volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:11:42 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7e5e9626-2e04-4804-82eb-edf9548b6b50 tempest-SnapshotDependencyTests-2077334849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d121e3d6-b582-47eb-ab93-224d3991f985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:11:42 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7e5e9626-2e04-4804-82eb-edf9548b6b50 tempest-SnapshotDependencyTests-2077334849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d121e3d6-b582-47eb-ab93-224d3991f985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:11:42 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7e5e9626-2e04-4804-82eb-edf9548b6b50 tempest-SnapshotDependencyTests-2077334849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (731be4c4-6ddc-47b8-a2b4-041d88ddc58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:11:42 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-7e5e9626-2e04-4804-82eb-edf9548b6b50 tempest-SnapshotDependencyTests-2077334849 None] Volume aa13b0be-1d50-43ae-a2df-47e40d6e85d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9', 'volume_size': 1} Jun 24 05:11:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7e5e9626-2e04-4804-82eb-edf9548b6b50 tempest-SnapshotDependencyTests-2077334849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:11:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7e5e9626-2e04-4804-82eb-edf9548b6b50 tempest-SnapshotDependencyTests-2077334849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:11:42 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7e5e9626-2e04-4804-82eb-edf9548b6b50 tempest-SnapshotDependencyTests-2077334849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-67724922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa13b0be-1d50-43ae-a2df-47e40d6e85d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093fe50c881b4ea2b3e9b736aaa18964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:11:43Z,use_quota=True,user_id='7b09f23356cc44d29ad7a2615004c745',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:11:42 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-7e5e9626-2e04-4804-82eb-edf9548b6b50 tempest-SnapshotDependencyTests-2077334849 None] Creating volume aa13b0be-1d50-43ae-a2df-47e40d6e85d9 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:11:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7e5e9626-2e04-4804-82eb-edf9548b6b50 tempest-SnapshotDependencyTests-2077334849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:11:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7e5e9626-2e04-4804-82eb-edf9548b6b50 tempest-SnapshotDependencyTests-2077334849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:11:42 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7e5e9626-2e04-4804-82eb-edf9548b6b50 tempest-SnapshotDependencyTests-2077334849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:11:42 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7e5e9626-2e04-4804-82eb-edf9548b6b50 tempest-SnapshotDependencyTests-2077334849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:11:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7e5e9626-2e04-4804-82eb-edf9548b6b50 tempest-SnapshotDependencyTests-2077334849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:11:42 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7e5e9626-2e04-4804-82eb-edf9548b6b50 tempest-SnapshotDependencyTests-2077334849 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:11:42 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-7e5e9626-2e04-4804-82eb-edf9548b6b50 tempest-SnapshotDependencyTests-2077334849 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:11:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7e5e9626-2e04-4804-82eb-edf9548b6b50 tempest-SnapshotDependencyTests-2077334849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:11:42 devstack sudo[108881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9 1073741824 Jun 24 05:11:42 devstack sudo[108881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:11:43 devstack sudo[108881]: pam_unix(sudo:session): session closed for user root Jun 24 05:11:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7e5e9626-2e04-4804-82eb-edf9548b6b50 tempest-SnapshotDependencyTests-2077334849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9 1073741824" returned: 0 in 0.970s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:11:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7e5e9626-2e04-4804-82eb-edf9548b6b50 tempest-SnapshotDependencyTests-2077334849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:11:43 devstack sudo[109207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9 Jun 24 05:11:43 devstack sudo[109207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:11:43 devstack sudo[108809]: pam_unix(sudo:session): session closed for user root Jun 24 05:11:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_tfwmn28mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bb5bd68e-64b9-4db9-9721-1403fffc9a46" returned: 0 in 1.995s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:11:43 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_tfwmn28mdevstack@QuobyteHD, size 112.00 MB, duration 2.00 sec, destination /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bb5bd68e-64b9-4db9-9721-1403fffc9a46 {{(pid=93830) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 05:11:43 devstack cinder-volume[93830]: INFO cinder.image.image_utils [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Converted 112.00 MB image at 56.11 MB/s Jun 24 05:11:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bb5bd68e-64b9-4db9-9721-1403fffc9a46 1G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:11:43 devstack sudo[109209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bb5bd68e-64b9-4db9-9721-1403fffc9a46 1G Jun 24 05:11:44 devstack sudo[109209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:11:44 devstack sudo[109207]: pam_unix(sudo:session): session closed for user root Jun 24 05:11:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7e5e9626-2e04-4804-82eb-edf9548b6b50 tempest-SnapshotDependencyTests-2077334849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9" returned: 0 in 0.667s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:11:44 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7e5e9626-2e04-4804-82eb-edf9548b6b50 tempest-SnapshotDependencyTests-2077334849 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:11:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7e5e9626-2e04-4804-82eb-edf9548b6b50 tempest-SnapshotDependencyTests-2077334849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.698s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:11:44 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7e5e9626-2e04-4804-82eb-edf9548b6b50 tempest-SnapshotDependencyTests-2077334849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (731be4c4-6ddc-47b8-a2b4-041d88ddc58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:11:44 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7e5e9626-2e04-4804-82eb-edf9548b6b50 tempest-SnapshotDependencyTests-2077334849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c84221f-8d45-4af4-a54a-d72b0ece13a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:11:44 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-7e5e9626-2e04-4804-82eb-edf9548b6b50 tempest-SnapshotDependencyTests-2077334849 None] Volume volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9 (aa13b0be-1d50-43ae-a2df-47e40d6e85d9): created successfully Jun 24 05:11:44 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7e5e9626-2e04-4804-82eb-edf9548b6b50 tempest-SnapshotDependencyTests-2077334849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c84221f-8d45-4af4-a54a-d72b0ece13a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:11:44 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7e5e9626-2e04-4804-82eb-edf9548b6b50 tempest-SnapshotDependencyTests-2077334849 None] Flow 'volume_create_manager' (58b1d75d-85cf-4dbe-829e-27ee262dc94b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:11:44 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-7e5e9626-2e04-4804-82eb-edf9548b6b50 tempest-SnapshotDependencyTests-2077334849 None] Created volume successfully. Jun 24 05:11:44 devstack sudo[109209]: pam_unix(sudo:session): session closed for user root Jun 24 05:11:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bb5bd68e-64b9-4db9-9721-1403fffc9a46 1G" returned: 0 in 0.727s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:11:44 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d9d2e4-9508-457d-841d-0304b31705f9]: (4, 'raw') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:11:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bb5bd68e-64b9-4db9-9721-1403fffc9a46 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:11:44 devstack sudo[109215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bb5bd68e-64b9-4db9-9721-1403fffc9a46 Jun 24 05:11:44 devstack sudo[109215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:11:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-be99fe4e-c63a-48c6-997e-8afb17d5186c tempest-SnapshotDependencyTests-2077334849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:11:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-be99fe4e-c63a-48c6-997e-8afb17d5186c tempest-SnapshotDependencyTests-2077334849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:11:45 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-be99fe4e-c63a-48c6-997e-8afb17d5186c tempest-SnapshotDependencyTests-2077334849 None] Creating offline snapshot 60f6fdba-7dda-48e7-8ced-89ad3aaa5dd9 of volume aa13b0be-1d50-43ae-a2df-47e40d6e85d9 {{(pid=93830) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 05:11:45 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29071dd-60fa-4ec3-b28e-b6cb4af03b0d]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:11:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-be99fe4e-c63a-48c6-997e-8afb17d5186c tempest-SnapshotDependencyTests-2077334849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:11:45 devstack sudo[109218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9 Jun 24 05:11:45 devstack sudo[109218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:11:45 devstack sudo[109215]: pam_unix(sudo:session): session closed for user root Jun 24 05:11:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bb5bd68e-64b9-4db9-9721-1403fffc9a46" returned: 0 in 0.765s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:11:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bb5bd68e-64b9-4db9-9721-1403fffc9a46 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:11:45 devstack sudo[109222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bb5bd68e-64b9-4db9-9721-1403fffc9a46 Jun 24 05:11:45 devstack sudo[109222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:11:45 devstack sudo[109218]: pam_unix(sudo:session): session closed for user root Jun 24 05:11:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-be99fe4e-c63a-48c6-997e-8afb17d5186c tempest-SnapshotDependencyTests-2077334849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9" returned: 0 in 0.812s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:11:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-be99fe4e-c63a-48c6-997e-8afb17d5186c tempest-SnapshotDependencyTests-2077334849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9.60f6fdba-7dda-48e7-8ced-89ad3aaa5dd9 1G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:11:45 devstack sudo[109227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9.60f6fdba-7dda-48e7-8ced-89ad3aaa5dd9 1G Jun 24 05:11:45 devstack sudo[109227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:11:46 devstack sudo[109222]: pam_unix(sudo:session): session closed for user root Jun 24 05:11:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bb5bd68e-64b9-4db9-9721-1403fffc9a46" returned: 1 in 0.784s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:11:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bb5bd68e-64b9-4db9-9721-1403fffc9a46' failed. Not Retrying. {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 05:11:46 devstack cinder-volume[93830]: DEBUG cinder.volume.volume_utils [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Downloaded image f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1 ((None, [{'url': 'file:///opt/stack/data/glance/images/f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'metadata': {}}])) to volume bb5bd68e-64b9-4db9-9721-1403fffc9a46 successfully. {{(pid=93830) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 24 05:11:46 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Temporary image f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1 for user 8de96fac6bc14be5a88fc2fef76a29d8 is deleted. {{(pid=93830) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 24 05:11:46 devstack cinder-volume[93830]: DEBUG cinder.volume.volume_utils [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Marking volume bb5bd68e-64b9-4db9-9721-1403fffc9a46 as bootable. {{(pid=93830) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 24 05:11:46 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Copying metadata from image f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1 to bb5bd68e-64b9-4db9-9721-1403fffc9a46. {{(pid=93830) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 24 05:11:46 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Creating volume glance metadata for volume bb5bd68e-64b9-4db9-9721-1403fffc9a46 backed by image f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93830) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 24 05:11:46 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ffc402f-deb9-4340-8e1c-08840f05ba1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb5bd68e-64b9-4db9-9721-1403fffc9a46', 'volume_size': 1, 'image_id': 'f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f7b9466e67614ef6a2783f0123a80489', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'created_at': datetime.datetime(2026, 6, 24, 2, 51, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 51, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:11:46 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e5cbc92-d768-4498-88be-658c2a75458b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:11:46 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Volume volume-bb5bd68e-64b9-4db9-9721-1403fffc9a46 (bb5bd68e-64b9-4db9-9721-1403fffc9a46): created successfully Jun 24 05:11:46 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e5cbc92-d768-4498-88be-658c2a75458b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:11:46 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Flow 'volume_create_manager' (c2cda04d-d4e6-4677-a48b-729b7312f574) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:11:46 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-5f3656ec-10de-41c1-bcec-c3433dccd256 tempest-VolumesImageMetadata-489899974 None] Created volume successfully. Jun 24 05:11:46 devstack sudo[109227]: pam_unix(sudo:session): session closed for user root Jun 24 05:11:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-be99fe4e-c63a-48c6-997e-8afb17d5186c tempest-SnapshotDependencyTests-2077334849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9.60f6fdba-7dda-48e7-8ced-89ad3aaa5dd9 1G" returned: 0 in 0.802s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:11:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-be99fe4e-c63a-48c6-997e-8afb17d5186c tempest-SnapshotDependencyTests-2077334849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9.60f6fdba-7dda-48e7-8ced-89ad3aaa5dd9 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:11:46 devstack sudo[109235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9.60f6fdba-7dda-48e7-8ced-89ad3aaa5dd9 Jun 24 05:11:46 devstack sudo[109235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:11:47 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-67ba7a7b-a592-4ba1-8a75-06f6b0e928df tempest-VolumesImageMetadata-489899974 None] Acquiring lock "cinder-bb5bd68e-64b9-4db9-9721-1403fffc9a46-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:11:47 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-67ba7a7b-a592-4ba1-8a75-06f6b0e928df tempest-VolumesImageMetadata-489899974 None] Lock "cinder-bb5bd68e-64b9-4db9-9721-1403fffc9a46-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:11:47 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-67ba7a7b-a592-4ba1-8a75-06f6b0e928df tempest-VolumesImageMetadata-489899974 None] Acquiring lock "cinder-quobyte-bb5bd68e-64b9-4db9-9721-1403fffc9a46" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:11:47 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-67ba7a7b-a592-4ba1-8a75-06f6b0e928df tempest-VolumesImageMetadata-489899974 None] Lock "cinder-quobyte-bb5bd68e-64b9-4db9-9721-1403fffc9a46" acquired by "delete_volume" :: waited 0.017s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:11:47 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9a228d-e06e-48fb-bf1b-80ff1c3b3f02]: (4, 'raw') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:11:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-67ba7a7b-a592-4ba1-8a75-06f6b0e928df tempest-VolumesImageMetadata-489899974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bb5bd68e-64b9-4db9-9721-1403fffc9a46 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:11:47 devstack sudo[109240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bb5bd68e-64b9-4db9-9721-1403fffc9a46 Jun 24 05:11:47 devstack sudo[109240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:11:47 devstack sudo[109235]: pam_unix(sudo:session): session closed for user root Jun 24 05:11:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-be99fe4e-c63a-48c6-997e-8afb17d5186c tempest-SnapshotDependencyTests-2077334849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9.60f6fdba-7dda-48e7-8ced-89ad3aaa5dd9" returned: 0 in 0.829s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:11:47 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-be99fe4e-c63a-48c6-997e-8afb17d5186c tempest-SnapshotDependencyTests-2077334849 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9.60f6fdba-7dda-48e7-8ced-89ad3aaa5dd9 is being set with open permissions: ugo+rw Jun 24 05:11:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-be99fe4e-c63a-48c6-997e-8afb17d5186c tempest-SnapshotDependencyTests-2077334849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9.60f6fdba-7dda-48e7-8ced-89ad3aaa5dd9 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:11:47 devstack sudo[109244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9.60f6fdba-7dda-48e7-8ced-89ad3aaa5dd9 Jun 24 05:11:47 devstack sudo[109244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:11:48 devstack sudo[109240]: pam_unix(sudo:session): session closed for user root Jun 24 05:11:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-67ba7a7b-a592-4ba1-8a75-06f6b0e928df tempest-VolumesImageMetadata-489899974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bb5bd68e-64b9-4db9-9721-1403fffc9a46" returned: 0 in 1.056s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:11:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-67ba7a7b-a592-4ba1-8a75-06f6b0e928df tempest-VolumesImageMetadata-489899974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bb5bd68e-64b9-4db9-9721-1403fffc9a46 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:11:48 devstack sudo[109244]: pam_unix(sudo:session): session closed for user root Jun 24 05:11:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-be99fe4e-c63a-48c6-997e-8afb17d5186c tempest-SnapshotDependencyTests-2077334849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9.60f6fdba-7dda-48e7-8ced-89ad3aaa5dd9" returned: 0 in 0.994s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:11:48 devstack sudo[109249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bb5bd68e-64b9-4db9-9721-1403fffc9a46 Jun 24 05:11:48 devstack sudo[109249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:11:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-be99fe4e-c63a-48c6-997e-8afb17d5186c tempest-SnapshotDependencyTests-2077334849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:11:48 devstack sudo[109251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9.info Jun 24 05:11:48 devstack sudo[109251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:11:49 devstack sudo[109251]: pam_unix(sudo:session): session closed for user root Jun 24 05:11:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-be99fe4e-c63a-48c6-997e-8afb17d5186c tempest-SnapshotDependencyTests-2077334849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9.info" returned: 0 in 0.785s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:11:49 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-be99fe4e-c63a-48c6-997e-8afb17d5186c tempest-SnapshotDependencyTests-2077334849 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9.info is being set with open permissions: ugo+rw Jun 24 05:11:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-be99fe4e-c63a-48c6-997e-8afb17d5186c tempest-SnapshotDependencyTests-2077334849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:11:49 devstack sudo[109249]: pam_unix(sudo:session): session closed for user root Jun 24 05:11:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-67ba7a7b-a592-4ba1-8a75-06f6b0e928df tempest-VolumesImageMetadata-489899974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bb5bd68e-64b9-4db9-9721-1403fffc9a46" returned: 1 in 0.933s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:11:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-67ba7a7b-a592-4ba1-8a75-06f6b0e928df tempest-VolumesImageMetadata-489899974 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bb5bd68e-64b9-4db9-9721-1403fffc9a46' failed. Not Retrying. {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 05:11:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-67ba7a7b-a592-4ba1-8a75-06f6b0e928df tempest-VolumesImageMetadata-489899974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bb5bd68e-64b9-4db9-9721-1403fffc9a46 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:11:49 devstack sudo[109263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9.info Jun 24 05:11:49 devstack sudo[109263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:11:49 devstack sudo[109264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bb5bd68e-64b9-4db9-9721-1403fffc9a46 Jun 24 05:11:49 devstack sudo[109264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:11:50 devstack sudo[109263]: pam_unix(sudo:session): session closed for user root Jun 24 05:11:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-be99fe4e-c63a-48c6-997e-8afb17d5186c tempest-SnapshotDependencyTests-2077334849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9.info" returned: 0 in 0.756s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:11:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-be99fe4e-c63a-48c6-997e-8afb17d5186c tempest-SnapshotDependencyTests-2077334849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.089s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:11:50 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-be99fe4e-c63a-48c6-997e-8afb17d5186c tempest-SnapshotDependencyTests-2077334849 None] Create snapshot completed successfully Jun 24 05:11:50 devstack sudo[109264]: pam_unix(sudo:session): session closed for user root Jun 24 05:11:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-67ba7a7b-a592-4ba1-8a75-06f6b0e928df tempest-VolumesImageMetadata-489899974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bb5bd68e-64b9-4db9-9721-1403fffc9a46" returned: 0 in 0.882s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:11:50 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-67ba7a7b-a592-4ba1-8a75-06f6b0e928df tempest-VolumesImageMetadata-489899974 None] Lock "cinder-quobyte-bb5bd68e-64b9-4db9-9721-1403fffc9a46" released by "delete_volume" :: held 2.963s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:11:50 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-67ba7a7b-a592-4ba1-8a75-06f6b0e928df tempest-VolumesImageMetadata-489899974 None] Created reservations ['2e53ae83-6413-4b54-a253-64cdce1a9126', '7f5ddab5-0787-408f-8c19-3533ae998a95', '2a365a06-8c9a-4fe3-af94-9b890b8d0352', '3c70a4b9-9a3f-4407-ac0b-aa786f171375'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:11:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-67ba7a7b-a592-4ba1-8a75-06f6b0e928df tempest-VolumesImageMetadata-489899974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:11:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-67ba7a7b-a592-4ba1-8a75-06f6b0e928df tempest-VolumesImageMetadata-489899974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:11:50 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-67ba7a7b-a592-4ba1-8a75-06f6b0e928df tempest-VolumesImageMetadata-489899974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:11:50 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-67ba7a7b-a592-4ba1-8a75-06f6b0e928df tempest-VolumesImageMetadata-489899974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:11:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-67ba7a7b-a592-4ba1-8a75-06f6b0e928df tempest-VolumesImageMetadata-489899974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:11:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-67ba7a7b-a592-4ba1-8a75-06f6b0e928df tempest-VolumesImageMetadata-489899974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:11:50 devstack sudo[109272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:11:50 devstack sudo[109272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:11:51 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:11:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Flow 'volume_create_manager' (f1176d40-12c3-4a13-90f6-29ad20e19c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:11:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb3912bb-a65f-4ad1-aa1e-a351d67efeb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:11:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb3912bb-a65f-4ad1-aa1e-a351d67efeb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3df9e30-c087-4f08-a2db-3b16b53552bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093fe50c881b4ea2b3e9b736aaa18964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=60f6fdba-7dda-48e7-8ced-89ad3aaa5dd9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:11:51Z,use_quota=True,user_id='7b09f23356cc44d29ad7a2615004c745',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:11:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea53060e-8ac1-4f08-9030-e0abec071047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:11:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea53060e-8ac1-4f08-9030-e0abec071047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:11:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b15df2ed-26db-4df8-af8d-a3be69c17e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:11:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b15df2ed-26db-4df8-af8d-a3be69c17e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd3df9e30-c087-4f08-a2db-3b16b53552bd', 'volume_name': 'volume-d3df9e30-c087-4f08-a2db-3b16b53552bd', 'volume_size': 1, 'snapshot_id': '60f6fdba-7dda-48e7-8ced-89ad3aaa5dd9'}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:11:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfefd642-a6dc-4144-a0df-af5276ee216c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:11:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfefd642-a6dc-4144-a0df-af5276ee216c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:11:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdf183d7-463d-4582-b081-200acf36eea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:11:51 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Volume d3df9e30-c087-4f08-a2db-3b16b53552bd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d3df9e30-c087-4f08-a2db-3b16b53552bd', 'volume_size': 1, 'snapshot_id': '60f6fdba-7dda-48e7-8ced-89ad3aaa5dd9'} Jun 24 05:11:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:11:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:11:51 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Acquiring lock "cinder-quobyte-60f6fdba-7dda-48e7-8ced-89ad3aaa5dd9-d3df9e30-c087-4f08-a2db-3b16b53552bd" by "_create_volume_from_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:11:51 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Lock "cinder-quobyte-60f6fdba-7dda-48e7-8ced-89ad3aaa5dd9-d3df9e30-c087-4f08-a2db-3b16b53552bd" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:11:51 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Creating volume d3df9e30-c087-4f08-a2db-3b16b53552bd from snapshot 60f6fdba-7dda-48e7-8ced-89ad3aaa5dd9 {{(pid=93830) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 24 05:11:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:11:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:11:51 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:11:51 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:11:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:11:51 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:11:51 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Acquiring lock "cinder-quobyte-d3df9e30-c087-4f08-a2db-3b16b53552bd" by "_copy_volume_from_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:11:51 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Lock "cinder-quobyte-d3df9e30-c087-4f08-a2db-3b16b53552bd" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:11:51 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] snapshot: 60f6fdba-7dda-48e7-8ced-89ad3aaa5dd9, volume: d3df9e30-c087-4f08-a2db-3b16b53552bd, {{(pid=93830) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 05:11:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:11:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:11:51 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:11:51 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:11:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:11:51 devstack sudo[109272]: pam_unix(sudo:session): session closed for user root Jun 24 05:11:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-67ba7a7b-a592-4ba1-8a75-06f6b0e928df tempest-VolumesImageMetadata-489899974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 1.011s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:11:51 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-67ba7a7b-a592-4ba1-8a75-06f6b0e928df tempest-VolumesImageMetadata-489899974 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:11:51 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc24b3f-7649-4df5-aad8-5eaf331b7ddb]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:11:51 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-67ba7a7b-a592-4ba1-8a75-06f6b0e928df tempest-VolumesImageMetadata-489899974 None] Deleted volume successfully. Jun 24 05:11:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9.60f6fdba-7dda-48e7-8ced-89ad3aaa5dd9 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:11:51 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-67ba7a7b-a592-4ba1-8a75-06f6b0e928df tempest-VolumesImageMetadata-489899974 None] Lock "cinder-bb5bd68e-64b9-4db9-9721-1403fffc9a46-delete_volume" released by "delete_volume" :: held 4.272s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:11:51 devstack sudo[109275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9.60f6fdba-7dda-48e7-8ced-89ad3aaa5dd9 Jun 24 05:11:51 devstack sudo[109275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:11:52 devstack sudo[109275]: pam_unix(sudo:session): session closed for user root Jun 24 05:11:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9.60f6fdba-7dda-48e7-8ced-89ad3aaa5dd9" returned: 0 in 0.992s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:11:52 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:11:52 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9 {{(pid=93830) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 05:11:52 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Creating direct copy from snapshot {{(pid=93830) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 05:11:52 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba58ad8a-ccbd-4b9a-b356-6585a8df62b3]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:11:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:11:52 devstack sudo[109282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9 Jun 24 05:11:52 devstack sudo[109282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:11:53 devstack sudo[109282]: pam_unix(sudo:session): session closed for user root Jun 24 05:11:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9" returned: 0 in 0.897s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:11:53 devstack cinder-volume[93830]: DEBUG cinder.utils [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Path /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d3df9e30-c087-4f08-a2db-3b16b53552bd not found in is_blk_device check {{(pid=93830) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 05:11:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d3df9e30-c087-4f08-a2db-3b16b53552bd {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:11:53 devstack sudo[109287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d3df9e30-c087-4f08-a2db-3b16b53552bd Jun 24 05:11:53 devstack sudo[109287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:11:54 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-915789d8-2696-493f-9dbe-30475913b0a5 tempest-SnapshotMetadataTestJSON-130633975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:11:54 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-915789d8-2696-493f-9dbe-30475913b0a5 tempest-SnapshotMetadataTestJSON-130633975 None] Flow 'volume_create_manager' (dfa8d68d-db4f-446a-a3cd-f7f0d72092de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:11:54 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-915789d8-2696-493f-9dbe-30475913b0a5 tempest-SnapshotMetadataTestJSON-130633975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ab9e201-0c7d-477a-a3ea-76cd4a061ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:11:54 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-915789d8-2696-493f-9dbe-30475913b0a5 tempest-SnapshotMetadataTestJSON-130633975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ab9e201-0c7d-477a-a3ea-76cd4a061ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-471097554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fd8fe70-c7dc-488d-8791-a915c724f74b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5eeb544b80d4729b8ea1966d0d9d30b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:11:55Z,use_quota=True,user_id='81879533ca2d484d8280aa6b93701bc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:11:54 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-915789d8-2696-493f-9dbe-30475913b0a5 tempest-SnapshotMetadataTestJSON-130633975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95fd7d00-2f30-4e14-aa5f-8b6656712a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:11:54 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-915789d8-2696-493f-9dbe-30475913b0a5 tempest-SnapshotMetadataTestJSON-130633975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95fd7d00-2f30-4e14-aa5f-8b6656712a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:11:54 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-915789d8-2696-493f-9dbe-30475913b0a5 tempest-SnapshotMetadataTestJSON-130633975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (142135f2-12c8-4a10-9fa3-f584c303feb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:11:54 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-915789d8-2696-493f-9dbe-30475913b0a5 tempest-SnapshotMetadataTestJSON-130633975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (142135f2-12c8-4a10-9fa3-f584c303feb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fd8fe70-c7dc-488d-8791-a915c724f74b', 'volume_name': 'volume-9fd8fe70-c7dc-488d-8791-a915c724f74b', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:11:54 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-915789d8-2696-493f-9dbe-30475913b0a5 tempest-SnapshotMetadataTestJSON-130633975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39915379-150f-47bb-82f0-a2d0115ae9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:11:54 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-915789d8-2696-493f-9dbe-30475913b0a5 tempest-SnapshotMetadataTestJSON-130633975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39915379-150f-47bb-82f0-a2d0115ae9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:11:54 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-915789d8-2696-493f-9dbe-30475913b0a5 tempest-SnapshotMetadataTestJSON-130633975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (553a5a3b-7157-4889-b7a0-c45829c0cd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:11:54 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-915789d8-2696-493f-9dbe-30475913b0a5 tempest-SnapshotMetadataTestJSON-130633975 None] Volume 9fd8fe70-c7dc-488d-8791-a915c724f74b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fd8fe70-c7dc-488d-8791-a915c724f74b', 'volume_size': 1} Jun 24 05:11:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-915789d8-2696-493f-9dbe-30475913b0a5 tempest-SnapshotMetadataTestJSON-130633975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:11:59 devstack sudo[109287]: pam_unix(sudo:session): session closed for user root Jun 24 05:11:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d3df9e30-c087-4f08-a2db-3b16b53552bd" returned: 0 in 5.662s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:11:59 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[b837896b-f1ca-49b2-aa95-2c592a482aef]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:11:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:11:59 devstack sudo[109303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9 Jun 24 05:11:59 devstack sudo[109303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:11:59 devstack sudo[109303]: pam_unix(sudo:session): session closed for user root Jun 24 05:11:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9" returned: 0 in 0.915s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:11:59 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Image conversion details: src /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9, size 1024.00 MB, duration 5.66 sec, destination /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d3df9e30-c087-4f08-a2db-3b16b53552bd {{(pid=93830) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 05:11:59 devstack cinder-volume[93830]: INFO cinder.image.image_utils [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Converted 1024.00 MB image at 180.81 MB/s Jun 24 05:11:59 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d3df9e30-c087-4f08-a2db-3b16b53552bd is being set with open permissions: ugo+rw Jun 24 05:11:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d3df9e30-c087-4f08-a2db-3b16b53552bd {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:00 devstack sudo[109308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d3df9e30-c087-4f08-a2db-3b16b53552bd Jun 24 05:12:00 devstack sudo[109308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:00 devstack sudo[109308]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d3df9e30-c087-4f08-a2db-3b16b53552bd" returned: 0 in 0.642s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:00 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Lock "cinder-quobyte-d3df9e30-c087-4f08-a2db-3b16b53552bd" released by "_copy_volume_from_snapshot" :: held 9.267s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:12:00 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Lock "cinder-quobyte-60f6fdba-7dda-48e7-8ced-89ad3aaa5dd9-d3df9e30-c087-4f08-a2db-3b16b53552bd" released by "_create_volume_from_snapshot" :: held 9.318s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:12:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.340s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:12:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-915789d8-2696-493f-9dbe-30475913b0a5 tempest-SnapshotMetadataTestJSON-130633975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.789s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:12:00 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-915789d8-2696-493f-9dbe-30475913b0a5 tempest-SnapshotMetadataTestJSON-130633975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-471097554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fd8fe70-c7dc-488d-8791-a915c724f74b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5eeb544b80d4729b8ea1966d0d9d30b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:11:55Z,use_quota=True,user_id='81879533ca2d484d8280aa6b93701bc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:12:00 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-915789d8-2696-493f-9dbe-30475913b0a5 tempest-SnapshotMetadataTestJSON-130633975 None] Creating volume 9fd8fe70-c7dc-488d-8791-a915c724f74b {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:12:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-915789d8-2696-493f-9dbe-30475913b0a5 tempest-SnapshotMetadataTestJSON-130633975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:12:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-915789d8-2696-493f-9dbe-30475913b0a5 tempest-SnapshotMetadataTestJSON-130633975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:12:00 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-915789d8-2696-493f-9dbe-30475913b0a5 tempest-SnapshotMetadataTestJSON-130633975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:12:00 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-915789d8-2696-493f-9dbe-30475913b0a5 tempest-SnapshotMetadataTestJSON-130633975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:12:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-915789d8-2696-493f-9dbe-30475913b0a5 tempest-SnapshotMetadataTestJSON-130633975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:12:00 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-915789d8-2696-493f-9dbe-30475913b0a5 tempest-SnapshotMetadataTestJSON-130633975 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:12:00 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-915789d8-2696-493f-9dbe-30475913b0a5 tempest-SnapshotMetadataTestJSON-130633975 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:12:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-915789d8-2696-493f-9dbe-30475913b0a5 tempest-SnapshotMetadataTestJSON-130633975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:00 devstack sudo[109312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b 1073741824 Jun 24 05:12:00 devstack sudo[109312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdf183d7-463d-4582-b081-200acf36eea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3df9e30-c087-4f08-a2db-3b16b53552bd', 'volume_size': 1, 'snapshot_id': '60f6fdba-7dda-48e7-8ced-89ad3aaa5dd9'}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:12:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2386f8a6-f6bb-4bdf-9efd-11f314d06e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:12:00 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Volume volume-d3df9e30-c087-4f08-a2db-3b16b53552bd (d3df9e30-c087-4f08-a2db-3b16b53552bd): created successfully Jun 24 05:12:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2386f8a6-f6bb-4bdf-9efd-11f314d06e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:12:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Flow 'volume_create_manager' (f1176d40-12c3-4a13-90f6-29ad20e19c17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:12:00 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-dda6de71-18e2-451c-88df-9e4a7975b54c tempest-SnapshotDependencyTests-2077334849 None] Created volume successfully. Jun 24 05:12:01 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-0a4a75dc-2aaf-4321-8683-e1b2e7da2d3e tempest-SnapshotDependencyTests-2077334849 None] Acquiring lock "cinder-60f6fdba-7dda-48e7-8ced-89ad3aaa5dd9-delete_snapshot" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:12:01 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-0a4a75dc-2aaf-4321-8683-e1b2e7da2d3e tempest-SnapshotDependencyTests-2077334849 None] Lock "cinder-60f6fdba-7dda-48e7-8ced-89ad3aaa5dd9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:12:01 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-0a4a75dc-2aaf-4321-8683-e1b2e7da2d3e tempest-SnapshotDependencyTests-2077334849 None] Acquiring lock "cinder-quobyte-aa13b0be-1d50-43ae-a2df-47e40d6e85d9" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:12:01 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-0a4a75dc-2aaf-4321-8683-e1b2e7da2d3e tempest-SnapshotDependencyTests-2077334849 None] Lock "cinder-quobyte-aa13b0be-1d50-43ae-a2df-47e40d6e85d9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:12:01 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-0a4a75dc-2aaf-4321-8683-e1b2e7da2d3e tempest-SnapshotDependencyTests-2077334849 None] Acquiring lock "cinder-quobyte-60f6fdba-7dda-48e7-8ced-89ad3aaa5dd9" by "_delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:12:01 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-0a4a75dc-2aaf-4321-8683-e1b2e7da2d3e tempest-SnapshotDependencyTests-2077334849 None] Lock "cinder-quobyte-60f6fdba-7dda-48e7-8ced-89ad3aaa5dd9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:12:01 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-0a4a75dc-2aaf-4321-8683-e1b2e7da2d3e tempest-SnapshotDependencyTests-2077334849 None] Deleting offline snapshot 60f6fdba-7dda-48e7-8ced-89ad3aaa5dd9 of volume aa13b0be-1d50-43ae-a2df-47e40d6e85d9 {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 05:12:01 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-0a4a75dc-2aaf-4321-8683-e1b2e7da2d3e tempest-SnapshotDependencyTests-2077334849 None] snapshot_file for this snap is: volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9.60f6fdba-7dda-48e7-8ced-89ad3aaa5dd9 {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 05:12:01 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[8419c6d8-27e7-4598-85b1-c6bdc5131f8a]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:12:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0a4a75dc-2aaf-4321-8683-e1b2e7da2d3e tempest-SnapshotDependencyTests-2077334849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9.60f6fdba-7dda-48e7-8ced-89ad3aaa5dd9 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:01 devstack sudo[109317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9.60f6fdba-7dda-48e7-8ced-89ad3aaa5dd9 Jun 24 05:12:01 devstack sudo[109317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:01 devstack sudo[109312]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-915789d8-2696-493f-9dbe-30475913b0a5 tempest-SnapshotMetadataTestJSON-130633975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b 1073741824" returned: 0 in 0.894s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-915789d8-2696-493f-9dbe-30475913b0a5 tempest-SnapshotMetadataTestJSON-130633975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:01 devstack sudo[109320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b Jun 24 05:12:01 devstack sudo[109320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:02 devstack sudo[109317]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0a4a75dc-2aaf-4321-8683-e1b2e7da2d3e tempest-SnapshotDependencyTests-2077334849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9.60f6fdba-7dda-48e7-8ced-89ad3aaa5dd9" returned: 0 in 0.851s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:02 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-0a4a75dc-2aaf-4321-8683-e1b2e7da2d3e tempest-SnapshotDependencyTests-2077334849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:12:02 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f082d28-3aef-4242-97d1-a7f910cc3769]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:12:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0a4a75dc-2aaf-4321-8683-e1b2e7da2d3e tempest-SnapshotDependencyTests-2077334849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:02 devstack sudo[109320]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-915789d8-2696-493f-9dbe-30475913b0a5 tempest-SnapshotMetadataTestJSON-130633975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b" returned: 0 in 0.626s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:02 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-915789d8-2696-493f-9dbe-30475913b0a5 tempest-SnapshotMetadataTestJSON-130633975 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:12:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-915789d8-2696-493f-9dbe-30475913b0a5 tempest-SnapshotMetadataTestJSON-130633975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.563s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:12:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-915789d8-2696-493f-9dbe-30475913b0a5 tempest-SnapshotMetadataTestJSON-130633975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (553a5a3b-7157-4889-b7a0-c45829c0cd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fd8fe70-c7dc-488d-8791-a915c724f74b', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:12:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-915789d8-2696-493f-9dbe-30475913b0a5 tempest-SnapshotMetadataTestJSON-130633975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a0a51b2-c70c-4bfe-a199-e17a3fc115a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:12:02 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-915789d8-2696-493f-9dbe-30475913b0a5 tempest-SnapshotMetadataTestJSON-130633975 None] Volume volume-9fd8fe70-c7dc-488d-8791-a915c724f74b (9fd8fe70-c7dc-488d-8791-a915c724f74b): created successfully Jun 24 05:12:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-915789d8-2696-493f-9dbe-30475913b0a5 tempest-SnapshotMetadataTestJSON-130633975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a0a51b2-c70c-4bfe-a199-e17a3fc115a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:12:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-915789d8-2696-493f-9dbe-30475913b0a5 tempest-SnapshotMetadataTestJSON-130633975 None] Flow 'volume_create_manager' (dfa8d68d-db4f-446a-a3cd-f7f0d72092de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:12:02 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-915789d8-2696-493f-9dbe-30475913b0a5 tempest-SnapshotMetadataTestJSON-130633975 None] Created volume successfully. Jun 24 05:12:02 devstack sudo[109326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9 Jun 24 05:12:02 devstack sudo[109326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a181f377-0bdc-4e3f-9c36-b3616f502989 tempest-SnapshotMetadataTestJSON-130633975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:12:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a181f377-0bdc-4e3f-9c36-b3616f502989 tempest-SnapshotMetadataTestJSON-130633975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:12:02 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-a181f377-0bdc-4e3f-9c36-b3616f502989 tempest-SnapshotMetadataTestJSON-130633975 None] Creating offline snapshot 80776aad-b265-498a-be3e-611a82b0703d of volume 9fd8fe70-c7dc-488d-8791-a915c724f74b {{(pid=93830) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 05:12:02 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[380ea6f7-084a-4ab6-8097-46d95ab0d8c2]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:12:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a181f377-0bdc-4e3f-9c36-b3616f502989 tempest-SnapshotMetadataTestJSON-130633975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:03 devstack sudo[109355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b Jun 24 05:12:03 devstack sudo[109355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:03 devstack sudo[109326]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0a4a75dc-2aaf-4321-8683-e1b2e7da2d3e tempest-SnapshotDependencyTests-2077334849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9" returned: 0 in 0.868s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0a4a75dc-2aaf-4321-8683-e1b2e7da2d3e tempest-SnapshotDependencyTests-2077334849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9.60f6fdba-7dda-48e7-8ced-89ad3aaa5dd9 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:03 devstack sudo[109357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9.60f6fdba-7dda-48e7-8ced-89ad3aaa5dd9 Jun 24 05:12:03 devstack sudo[109357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:03 devstack sudo[109355]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a181f377-0bdc-4e3f-9c36-b3616f502989 tempest-SnapshotMetadataTestJSON-130633975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b" returned: 0 in 0.869s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a181f377-0bdc-4e3f-9c36-b3616f502989 tempest-SnapshotMetadataTestJSON-130633975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b.80776aad-b265-498a-be3e-611a82b0703d 1G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:03 devstack sudo[109366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b.80776aad-b265-498a-be3e-611a82b0703d 1G Jun 24 05:12:03 devstack sudo[109366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:03 devstack sudo[109357]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0a4a75dc-2aaf-4321-8683-e1b2e7da2d3e tempest-SnapshotDependencyTests-2077334849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9.60f6fdba-7dda-48e7-8ced-89ad3aaa5dd9" returned: 0 in 0.809s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0a4a75dc-2aaf-4321-8683-e1b2e7da2d3e tempest-SnapshotDependencyTests-2077334849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9.60f6fdba-7dda-48e7-8ced-89ad3aaa5dd9 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:03 devstack sudo[109368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9.60f6fdba-7dda-48e7-8ced-89ad3aaa5dd9 Jun 24 05:12:03 devstack sudo[109368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:04 devstack sudo[109368]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0a4a75dc-2aaf-4321-8683-e1b2e7da2d3e tempest-SnapshotDependencyTests-2077334849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9.60f6fdba-7dda-48e7-8ced-89ad3aaa5dd9" returned: 0 in 0.724s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:04 devstack sudo[109366]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a181f377-0bdc-4e3f-9c36-b3616f502989 tempest-SnapshotMetadataTestJSON-130633975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b.80776aad-b265-498a-be3e-611a82b0703d 1G" returned: 0 in 0.865s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a181f377-0bdc-4e3f-9c36-b3616f502989 tempest-SnapshotMetadataTestJSON-130633975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fd8fe70-c7dc-488d-8791-a915c724f74b -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b.80776aad-b265-498a-be3e-611a82b0703d {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:04 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-0a4a75dc-2aaf-4321-8683-e1b2e7da2d3e tempest-SnapshotDependencyTests-2077334849 None] Lock "cinder-quobyte-60f6fdba-7dda-48e7-8ced-89ad3aaa5dd9" released by "_delete_snapshot" :: held 3.374s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:12:04 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-0a4a75dc-2aaf-4321-8683-e1b2e7da2d3e tempest-SnapshotDependencyTests-2077334849 None] Lock "cinder-quobyte-aa13b0be-1d50-43ae-a2df-47e40d6e85d9" released by "delete_snapshot" :: held 3.401s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:12:04 devstack sudo[109381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fd8fe70-c7dc-488d-8791-a915c724f74b -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b.80776aad-b265-498a-be3e-611a82b0703d Jun 24 05:12:04 devstack sudo[109381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:04 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-0a4a75dc-2aaf-4321-8683-e1b2e7da2d3e tempest-SnapshotDependencyTests-2077334849 None] Created reservations ['dc13cfe2-dc3d-4b5c-9da4-db184c8b768a', '1e9a22c6-bd67-4060-addb-cacd3f9ced80', 'e5300939-b1e1-4c9b-a6b8-90cc1321d2f3', '6874a354-2766-46e7-9fe4-45aedc9ecb81'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:12:04 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-0a4a75dc-2aaf-4321-8683-e1b2e7da2d3e tempest-SnapshotDependencyTests-2077334849 None] Delete snapshot completed successfully. Jun 24 05:12:04 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-0a4a75dc-2aaf-4321-8683-e1b2e7da2d3e tempest-SnapshotDependencyTests-2077334849 None] Lock "cinder-60f6fdba-7dda-48e7-8ced-89ad3aaa5dd9-delete_snapshot" released by "delete_snapshot" :: held 3.543s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:12:05 devstack sudo[109381]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a181f377-0bdc-4e3f-9c36-b3616f502989 tempest-SnapshotMetadataTestJSON-130633975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fd8fe70-c7dc-488d-8791-a915c724f74b -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b.80776aad-b265-498a-be3e-611a82b0703d" returned: 0 in 0.750s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:05 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-a181f377-0bdc-4e3f-9c36-b3616f502989 tempest-SnapshotMetadataTestJSON-130633975 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b.80776aad-b265-498a-be3e-611a82b0703d is being set with open permissions: ugo+rw Jun 24 05:12:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a181f377-0bdc-4e3f-9c36-b3616f502989 tempest-SnapshotMetadataTestJSON-130633975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b.80776aad-b265-498a-be3e-611a82b0703d {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:05 devstack sudo[109387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b.80776aad-b265-498a-be3e-611a82b0703d Jun 24 05:12:05 devstack sudo[109387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:05 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-50b2d85e-61e8-40dc-b2e1-5a582a9a04e0 tempest-SnapshotDependencyTests-2077334849 None] Acquiring lock "cinder-aa13b0be-1d50-43ae-a2df-47e40d6e85d9-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:12:05 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-50b2d85e-61e8-40dc-b2e1-5a582a9a04e0 tempest-SnapshotDependencyTests-2077334849 None] Lock "cinder-aa13b0be-1d50-43ae-a2df-47e40d6e85d9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:12:05 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-50b2d85e-61e8-40dc-b2e1-5a582a9a04e0 tempest-SnapshotDependencyTests-2077334849 None] Acquiring lock "cinder-quobyte-aa13b0be-1d50-43ae-a2df-47e40d6e85d9" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:12:05 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-50b2d85e-61e8-40dc-b2e1-5a582a9a04e0 tempest-SnapshotDependencyTests-2077334849 None] Lock "cinder-quobyte-aa13b0be-1d50-43ae-a2df-47e40d6e85d9" acquired by "delete_volume" :: waited 0.014s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:12:05 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2de04e-7840-4a9c-a42d-3283bc21525a]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:12:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-50b2d85e-61e8-40dc-b2e1-5a582a9a04e0 tempest-SnapshotDependencyTests-2077334849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:05 devstack sudo[109417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9 Jun 24 05:12:05 devstack sudo[109417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:06 devstack sudo[109387]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a181f377-0bdc-4e3f-9c36-b3616f502989 tempest-SnapshotMetadataTestJSON-130633975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b.80776aad-b265-498a-be3e-611a82b0703d" returned: 0 in 1.098s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a181f377-0bdc-4e3f-9c36-b3616f502989 tempest-SnapshotMetadataTestJSON-130633975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:06 devstack sudo[109447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b.info Jun 24 05:12:06 devstack sudo[109447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:06 devstack sudo[109417]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-50b2d85e-61e8-40dc-b2e1-5a582a9a04e0 tempest-SnapshotDependencyTests-2077334849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9" returned: 0 in 0.935s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-50b2d85e-61e8-40dc-b2e1-5a582a9a04e0 tempest-SnapshotDependencyTests-2077334849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:06 devstack sudo[109455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9 Jun 24 05:12:06 devstack sudo[109455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:07 devstack sudo[109447]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a181f377-0bdc-4e3f-9c36-b3616f502989 tempest-SnapshotMetadataTestJSON-130633975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b.info" returned: 0 in 1.018s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:07 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-a181f377-0bdc-4e3f-9c36-b3616f502989 tempest-SnapshotMetadataTestJSON-130633975 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b.info is being set with open permissions: ugo+rw Jun 24 05:12:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a181f377-0bdc-4e3f-9c36-b3616f502989 tempest-SnapshotMetadataTestJSON-130633975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:07 devstack sudo[109510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b.info Jun 24 05:12:07 devstack sudo[109510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-50b2d85e-61e8-40dc-b2e1-5a582a9a04e0 tempest-SnapshotDependencyTests-2077334849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-aa13b0be-1d50-43ae-a2df-47e40d6e85d9" returned: 0 in 1.144s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:07 devstack sudo[109455]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:07 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-50b2d85e-61e8-40dc-b2e1-5a582a9a04e0 tempest-SnapshotDependencyTests-2077334849 None] Lock "cinder-quobyte-aa13b0be-1d50-43ae-a2df-47e40d6e85d9" released by "delete_volume" :: held 2.201s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:12:08 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-50b2d85e-61e8-40dc-b2e1-5a582a9a04e0 tempest-SnapshotDependencyTests-2077334849 None] Created reservations ['235915b7-4017-4050-bbc9-049379cac6be', 'e4cf5d63-8f87-4ef9-9cd1-72f3178474fe', 'ee64bf7b-1855-474e-be2d-0c3bbe1c9324', '2c6802ea-350c-438e-8c36-dadd77f26576'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:12:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-50b2d85e-61e8-40dc-b2e1-5a582a9a04e0 tempest-SnapshotDependencyTests-2077334849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:12:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-50b2d85e-61e8-40dc-b2e1-5a582a9a04e0 tempest-SnapshotDependencyTests-2077334849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:12:08 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-50b2d85e-61e8-40dc-b2e1-5a582a9a04e0 tempest-SnapshotDependencyTests-2077334849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:12:08 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-50b2d85e-61e8-40dc-b2e1-5a582a9a04e0 tempest-SnapshotDependencyTests-2077334849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:12:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-50b2d85e-61e8-40dc-b2e1-5a582a9a04e0 tempest-SnapshotDependencyTests-2077334849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:12:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-50b2d85e-61e8-40dc-b2e1-5a582a9a04e0 tempest-SnapshotDependencyTests-2077334849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:08 devstack sudo[109525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:12:08 devstack sudo[109525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:08 devstack sudo[109510]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a181f377-0bdc-4e3f-9c36-b3616f502989 tempest-SnapshotMetadataTestJSON-130633975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b.info" returned: 0 in 0.932s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a181f377-0bdc-4e3f-9c36-b3616f502989 tempest-SnapshotMetadataTestJSON-130633975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.660s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:12:08 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-a181f377-0bdc-4e3f-9c36-b3616f502989 tempest-SnapshotMetadataTestJSON-130633975 None] Create snapshot completed successfully Jun 24 05:12:08 devstack sudo[109525]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-50b2d85e-61e8-40dc-b2e1-5a582a9a04e0 tempest-SnapshotDependencyTests-2077334849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.662s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:08 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-50b2d85e-61e8-40dc-b2e1-5a582a9a04e0 tempest-SnapshotDependencyTests-2077334849 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:12:08 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-50b2d85e-61e8-40dc-b2e1-5a582a9a04e0 tempest-SnapshotDependencyTests-2077334849 None] Deleted volume successfully. Jun 24 05:12:08 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-50b2d85e-61e8-40dc-b2e1-5a582a9a04e0 tempest-SnapshotDependencyTests-2077334849 None] Lock "cinder-aa13b0be-1d50-43ae-a2df-47e40d6e85d9-delete_volume" released by "delete_volume" :: held 3.214s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:12:09 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f8aff72e-6a96-4a6e-9194-386bc98bd169 tempest-SnapshotDependencyTests-2077334849 None] Acquiring lock "cinder-d3df9e30-c087-4f08-a2db-3b16b53552bd-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:12:09 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f8aff72e-6a96-4a6e-9194-386bc98bd169 tempest-SnapshotDependencyTests-2077334849 None] Lock "cinder-d3df9e30-c087-4f08-a2db-3b16b53552bd-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:12:09 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f8aff72e-6a96-4a6e-9194-386bc98bd169 tempest-SnapshotDependencyTests-2077334849 None] Acquiring lock "cinder-quobyte-d3df9e30-c087-4f08-a2db-3b16b53552bd" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:12:09 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f8aff72e-6a96-4a6e-9194-386bc98bd169 tempest-SnapshotDependencyTests-2077334849 None] Lock "cinder-quobyte-d3df9e30-c087-4f08-a2db-3b16b53552bd" acquired by "delete_volume" :: waited 0.031s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:12:09 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[50efbe9a-89bf-484d-ac76-6807829f2751]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:12:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f8aff72e-6a96-4a6e-9194-386bc98bd169 tempest-SnapshotDependencyTests-2077334849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d3df9e30-c087-4f08-a2db-3b16b53552bd {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:09 devstack sudo[109531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d3df9e30-c087-4f08-a2db-3b16b53552bd Jun 24 05:12:09 devstack sudo[109531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:09 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 05:12:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:12:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:12:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:12:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:12:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:12:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:09 devstack sudo[109533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:12:09 devstack sudo[109533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:10 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-83b81a3e-bd75-4f48-8fe4-5aa9137e672e tempest-SnapshotMetadataTestJSON-130633975 None] Acquiring lock "cinder-80776aad-b265-498a-be3e-611a82b0703d-delete_snapshot" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:12:10 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-83b81a3e-bd75-4f48-8fe4-5aa9137e672e tempest-SnapshotMetadataTestJSON-130633975 None] Lock "cinder-80776aad-b265-498a-be3e-611a82b0703d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:12:10 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-83b81a3e-bd75-4f48-8fe4-5aa9137e672e tempest-SnapshotMetadataTestJSON-130633975 None] Acquiring lock "cinder-quobyte-9fd8fe70-c7dc-488d-8791-a915c724f74b" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:12:10 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-83b81a3e-bd75-4f48-8fe4-5aa9137e672e tempest-SnapshotMetadataTestJSON-130633975 None] Lock "cinder-quobyte-9fd8fe70-c7dc-488d-8791-a915c724f74b" acquired by "delete_snapshot" :: waited 0.033s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:12:10 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-83b81a3e-bd75-4f48-8fe4-5aa9137e672e tempest-SnapshotMetadataTestJSON-130633975 None] Acquiring lock "cinder-quobyte-80776aad-b265-498a-be3e-611a82b0703d" by "_delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:12:10 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-83b81a3e-bd75-4f48-8fe4-5aa9137e672e tempest-SnapshotMetadataTestJSON-130633975 None] Lock "cinder-quobyte-80776aad-b265-498a-be3e-611a82b0703d" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:12:10 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-83b81a3e-bd75-4f48-8fe4-5aa9137e672e tempest-SnapshotMetadataTestJSON-130633975 None] Deleting offline snapshot 80776aad-b265-498a-be3e-611a82b0703d of volume 9fd8fe70-c7dc-488d-8791-a915c724f74b {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 05:12:10 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-83b81a3e-bd75-4f48-8fe4-5aa9137e672e tempest-SnapshotMetadataTestJSON-130633975 None] snapshot_file for this snap is: volume-9fd8fe70-c7dc-488d-8791-a915c724f74b.80776aad-b265-498a-be3e-611a82b0703d {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 05:12:10 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[adaae51a-dcf7-4df3-b82f-f001bea666d1]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:12:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-83b81a3e-bd75-4f48-8fe4-5aa9137e672e tempest-SnapshotMetadataTestJSON-130633975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b.80776aad-b265-498a-be3e-611a82b0703d {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:10 devstack sudo[109533]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.843s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:10 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:12:10 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager._thread_info {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 05:12:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread count: 29 {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 05:12:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread info: [<_MainThread(MainThread, started 130211312517248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 05:12:10 devstack sudo[109531]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f8aff72e-6a96-4a6e-9194-386bc98bd169 tempest-SnapshotDependencyTests-2077334849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d3df9e30-c087-4f08-a2db-3b16b53552bd" returned: 0 in 1.257s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f8aff72e-6a96-4a6e-9194-386bc98bd169 tempest-SnapshotDependencyTests-2077334849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d3df9e30-c087-4f08-a2db-3b16b53552bd {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:10 devstack sudo[109541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b.80776aad-b265-498a-be3e-611a82b0703d Jun 24 05:12:10 devstack sudo[109541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:10 devstack sudo[109542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d3df9e30-c087-4f08-a2db-3b16b53552bd Jun 24 05:12:10 devstack sudo[109542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:11 devstack sudo[109542]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f8aff72e-6a96-4a6e-9194-386bc98bd169 tempest-SnapshotDependencyTests-2077334849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d3df9e30-c087-4f08-a2db-3b16b53552bd" returned: 0 in 0.718s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:11 devstack sudo[109541]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-83b81a3e-bd75-4f48-8fe4-5aa9137e672e tempest-SnapshotMetadataTestJSON-130633975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b.80776aad-b265-498a-be3e-611a82b0703d" returned: 0 in 0.872s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:11 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-83b81a3e-bd75-4f48-8fe4-5aa9137e672e tempest-SnapshotMetadataTestJSON-130633975 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9fd8fe70-c7dc-488d-8791-a915c724f74b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:12:11 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f8aff72e-6a96-4a6e-9194-386bc98bd169 tempest-SnapshotDependencyTests-2077334849 None] Lock "cinder-quobyte-d3df9e30-c087-4f08-a2db-3b16b53552bd" released by "delete_volume" :: held 2.062s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:12:11 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c7bcfc-81e0-4493-a44b-3ef14a1dd833]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:12:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-83b81a3e-bd75-4f48-8fe4-5aa9137e672e tempest-SnapshotMetadataTestJSON-130633975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:11 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-f8aff72e-6a96-4a6e-9194-386bc98bd169 tempest-SnapshotDependencyTests-2077334849 None] Created reservations ['60bfecea-c7df-4c63-a5a6-9078a42e607f', '6330d36e-b320-41eb-97e3-20a34a910a8e', 'a892d67e-b8b5-4f3c-bed5-1c01a61e8ff2', '6e6068eb-d300-473f-9dab-5eced8f59359'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:12:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f8aff72e-6a96-4a6e-9194-386bc98bd169 tempest-SnapshotDependencyTests-2077334849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:12:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f8aff72e-6a96-4a6e-9194-386bc98bd169 tempest-SnapshotDependencyTests-2077334849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:12:11 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f8aff72e-6a96-4a6e-9194-386bc98bd169 tempest-SnapshotDependencyTests-2077334849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:12:11 devstack sudo[109550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b Jun 24 05:12:11 devstack sudo[109550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:11 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f8aff72e-6a96-4a6e-9194-386bc98bd169 tempest-SnapshotDependencyTests-2077334849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:12:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f8aff72e-6a96-4a6e-9194-386bc98bd169 tempest-SnapshotDependencyTests-2077334849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:12:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f8aff72e-6a96-4a6e-9194-386bc98bd169 tempest-SnapshotDependencyTests-2077334849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:11 devstack sudo[109552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:12:11 devstack sudo[109552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:12 devstack sudo[109550]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-83b81a3e-bd75-4f48-8fe4-5aa9137e672e tempest-SnapshotMetadataTestJSON-130633975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b" returned: 0 in 0.817s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-83b81a3e-bd75-4f48-8fe4-5aa9137e672e tempest-SnapshotMetadataTestJSON-130633975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b.80776aad-b265-498a-be3e-611a82b0703d {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:12 devstack sudo[109558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b.80776aad-b265-498a-be3e-611a82b0703d Jun 24 05:12:12 devstack sudo[109558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:12 devstack sudo[109552]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f8aff72e-6a96-4a6e-9194-386bc98bd169 tempest-SnapshotDependencyTests-2077334849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.746s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:12 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-f8aff72e-6a96-4a6e-9194-386bc98bd169 tempest-SnapshotDependencyTests-2077334849 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:12:12 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-f8aff72e-6a96-4a6e-9194-386bc98bd169 tempest-SnapshotDependencyTests-2077334849 None] Deleted volume successfully. Jun 24 05:12:12 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f8aff72e-6a96-4a6e-9194-386bc98bd169 tempest-SnapshotDependencyTests-2077334849 None] Lock "cinder-d3df9e30-c087-4f08-a2db-3b16b53552bd-delete_volume" released by "delete_volume" :: held 3.183s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:12:13 devstack sudo[109558]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-83b81a3e-bd75-4f48-8fe4-5aa9137e672e tempest-SnapshotMetadataTestJSON-130633975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b.80776aad-b265-498a-be3e-611a82b0703d" returned: 0 in 0.795s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-83b81a3e-bd75-4f48-8fe4-5aa9137e672e tempest-SnapshotMetadataTestJSON-130633975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b.80776aad-b265-498a-be3e-611a82b0703d {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:13 devstack sudo[109563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b.80776aad-b265-498a-be3e-611a82b0703d Jun 24 05:12:13 devstack sudo[109563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:13 devstack sudo[109563]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-83b81a3e-bd75-4f48-8fe4-5aa9137e672e tempest-SnapshotMetadataTestJSON-130633975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b.80776aad-b265-498a-be3e-611a82b0703d" returned: 0 in 0.673s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:13 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-83b81a3e-bd75-4f48-8fe4-5aa9137e672e tempest-SnapshotMetadataTestJSON-130633975 None] Lock "cinder-quobyte-80776aad-b265-498a-be3e-611a82b0703d" released by "_delete_snapshot" :: held 3.293s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:12:13 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-83b81a3e-bd75-4f48-8fe4-5aa9137e672e tempest-SnapshotMetadataTestJSON-130633975 None] Lock "cinder-quobyte-9fd8fe70-c7dc-488d-8791-a915c724f74b" released by "delete_snapshot" :: held 3.339s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:12:13 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-83b81a3e-bd75-4f48-8fe4-5aa9137e672e tempest-SnapshotMetadataTestJSON-130633975 None] Created reservations ['675cdde7-106c-4542-aad6-12faf23c3556', '7a272a4c-672e-404a-9087-e4cb80758544', 'b9822ce8-0d0e-4c24-a4aa-2a01ceb86f82', '56d48977-6af3-47de-bc7c-be721fad4d04'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:12:13 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-83b81a3e-bd75-4f48-8fe4-5aa9137e672e tempest-SnapshotMetadataTestJSON-130633975 None] Delete snapshot completed successfully. Jun 24 05:12:13 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-83b81a3e-bd75-4f48-8fe4-5aa9137e672e tempest-SnapshotMetadataTestJSON-130633975 None] Lock "cinder-80776aad-b265-498a-be3e-611a82b0703d-delete_snapshot" released by "delete_snapshot" :: held 3.504s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:12:14 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-c78db420-0eef-46e7-b773-650500497c91 tempest-SnapshotMetadataTestJSON-130633975 None] Acquiring lock "cinder-9fd8fe70-c7dc-488d-8791-a915c724f74b-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:12:14 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-c78db420-0eef-46e7-b773-650500497c91 tempest-SnapshotMetadataTestJSON-130633975 None] Lock "cinder-9fd8fe70-c7dc-488d-8791-a915c724f74b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:12:14 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-c78db420-0eef-46e7-b773-650500497c91 tempest-SnapshotMetadataTestJSON-130633975 None] Acquiring lock "cinder-quobyte-9fd8fe70-c7dc-488d-8791-a915c724f74b" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:12:14 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-c78db420-0eef-46e7-b773-650500497c91 tempest-SnapshotMetadataTestJSON-130633975 None] Lock "cinder-quobyte-9fd8fe70-c7dc-488d-8791-a915c724f74b" acquired by "delete_volume" :: waited 0.026s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:12:14 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3cdbfa2-c3ba-472b-856c-b48d8ab341aa]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:12:14 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c78db420-0eef-46e7-b773-650500497c91 tempest-SnapshotMetadataTestJSON-130633975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:15 devstack sudo[109567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b Jun 24 05:12:15 devstack sudo[109567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:15 devstack sudo[109567]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c78db420-0eef-46e7-b773-650500497c91 tempest-SnapshotMetadataTestJSON-130633975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b" returned: 0 in 1.010s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c78db420-0eef-46e7-b773-650500497c91 tempest-SnapshotMetadataTestJSON-130633975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:15 devstack sudo[109572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b Jun 24 05:12:15 devstack sudo[109572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:16 devstack sudo[109572]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c78db420-0eef-46e7-b773-650500497c91 tempest-SnapshotMetadataTestJSON-130633975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9fd8fe70-c7dc-488d-8791-a915c724f74b" returned: 0 in 0.670s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:16 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-c78db420-0eef-46e7-b773-650500497c91 tempest-SnapshotMetadataTestJSON-130633975 None] Lock "cinder-quobyte-9fd8fe70-c7dc-488d-8791-a915c724f74b" released by "delete_volume" :: held 1.747s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:12:16 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-c78db420-0eef-46e7-b773-650500497c91 tempest-SnapshotMetadataTestJSON-130633975 None] Created reservations ['3d71ee7e-8032-4565-bb63-587355bdf552', 'a99d12ae-69f7-4a64-ac2e-2894d38fa48d', 'b2305306-fb86-44bb-a858-305673b6e805', 'dcf0d962-a217-4f0c-99f9-cf1f31c86568'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:12:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-c78db420-0eef-46e7-b773-650500497c91 tempest-SnapshotMetadataTestJSON-130633975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:12:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-c78db420-0eef-46e7-b773-650500497c91 tempest-SnapshotMetadataTestJSON-130633975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:12:16 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-c78db420-0eef-46e7-b773-650500497c91 tempest-SnapshotMetadataTestJSON-130633975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:12:16 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-c78db420-0eef-46e7-b773-650500497c91 tempest-SnapshotMetadataTestJSON-130633975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:12:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-c78db420-0eef-46e7-b773-650500497c91 tempest-SnapshotMetadataTestJSON-130633975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:12:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c78db420-0eef-46e7-b773-650500497c91 tempest-SnapshotMetadataTestJSON-130633975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:16 devstack sudo[109576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:12:16 devstack sudo[109576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:17 devstack sudo[109576]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c78db420-0eef-46e7-b773-650500497c91 tempest-SnapshotMetadataTestJSON-130633975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.921s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:17 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-c78db420-0eef-46e7-b773-650500497c91 tempest-SnapshotMetadataTestJSON-130633975 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:12:17 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-c78db420-0eef-46e7-b773-650500497c91 tempest-SnapshotMetadataTestJSON-130633975 None] Deleted volume successfully. Jun 24 05:12:17 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-c78db420-0eef-46e7-b773-650500497c91 tempest-SnapshotMetadataTestJSON-130633975 None] Lock "cinder-9fd8fe70-c7dc-488d-8791-a915c724f74b-delete_volume" released by "delete_volume" :: held 3.038s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:12:21 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fbd6494-7f8e-49fa-9db4-4e1162a36743 tempest-VolumesDeleteCascade-1326074240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:12:21 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4fbd6494-7f8e-49fa-9db4-4e1162a36743 tempest-VolumesDeleteCascade-1326074240 None] Flow 'volume_create_manager' (1bdb7f06-49be-4115-9dda-d04fcbb1d641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:12:21 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4fbd6494-7f8e-49fa-9db4-4e1162a36743 tempest-VolumesDeleteCascade-1326074240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4316f21-091d-4f88-92ce-fd955229ae06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:12:21 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4fbd6494-7f8e-49fa-9db4-4e1162a36743 tempest-VolumesDeleteCascade-1326074240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4316f21-091d-4f88-92ce-fd955229ae06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1774511568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=493829f3-2832-4b7a-8b23-1ec8d8871c01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc787d0be5d9407fb354959d5500ac0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:12:21Z,use_quota=True,user_id='5a86c8170a1846afab6e825183c4f414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:12:21 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4fbd6494-7f8e-49fa-9db4-4e1162a36743 tempest-VolumesDeleteCascade-1326074240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dd19d35-040f-4f0f-aac8-849d8d37fdfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:12:21 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4fbd6494-7f8e-49fa-9db4-4e1162a36743 tempest-VolumesDeleteCascade-1326074240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dd19d35-040f-4f0f-aac8-849d8d37fdfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:12:21 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4fbd6494-7f8e-49fa-9db4-4e1162a36743 tempest-VolumesDeleteCascade-1326074240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40641437-29b7-461c-8ec8-72224cc878ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:12:21 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4fbd6494-7f8e-49fa-9db4-4e1162a36743 tempest-VolumesDeleteCascade-1326074240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40641437-29b7-461c-8ec8-72224cc878ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '493829f3-2832-4b7a-8b23-1ec8d8871c01', 'volume_name': 'volume-493829f3-2832-4b7a-8b23-1ec8d8871c01', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:12:21 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4fbd6494-7f8e-49fa-9db4-4e1162a36743 tempest-VolumesDeleteCascade-1326074240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93385b2c-eec5-4140-b664-7bcc51dd60a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:12:21 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4fbd6494-7f8e-49fa-9db4-4e1162a36743 tempest-VolumesDeleteCascade-1326074240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93385b2c-eec5-4140-b664-7bcc51dd60a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:12:21 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4fbd6494-7f8e-49fa-9db4-4e1162a36743 tempest-VolumesDeleteCascade-1326074240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcbc98b9-c00d-4490-863a-a94abc9f153d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:12:21 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-4fbd6494-7f8e-49fa-9db4-4e1162a36743 tempest-VolumesDeleteCascade-1326074240 None] Volume 493829f3-2832-4b7a-8b23-1ec8d8871c01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-493829f3-2832-4b7a-8b23-1ec8d8871c01', 'volume_size': 1} Jun 24 05:12:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4fbd6494-7f8e-49fa-9db4-4e1162a36743 tempest-VolumesDeleteCascade-1326074240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:12:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4fbd6494-7f8e-49fa-9db4-4e1162a36743 tempest-VolumesDeleteCascade-1326074240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:12:21 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-4fbd6494-7f8e-49fa-9db4-4e1162a36743 tempest-VolumesDeleteCascade-1326074240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1774511568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=493829f3-2832-4b7a-8b23-1ec8d8871c01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc787d0be5d9407fb354959d5500ac0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:12:21Z,use_quota=True,user_id='5a86c8170a1846afab6e825183c4f414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:12:21 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-4fbd6494-7f8e-49fa-9db4-4e1162a36743 tempest-VolumesDeleteCascade-1326074240 None] Creating volume 493829f3-2832-4b7a-8b23-1ec8d8871c01 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:12:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4fbd6494-7f8e-49fa-9db4-4e1162a36743 tempest-VolumesDeleteCascade-1326074240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:12:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4fbd6494-7f8e-49fa-9db4-4e1162a36743 tempest-VolumesDeleteCascade-1326074240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:12:21 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-4fbd6494-7f8e-49fa-9db4-4e1162a36743 tempest-VolumesDeleteCascade-1326074240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:12:21 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-4fbd6494-7f8e-49fa-9db4-4e1162a36743 tempest-VolumesDeleteCascade-1326074240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:12:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4fbd6494-7f8e-49fa-9db4-4e1162a36743 tempest-VolumesDeleteCascade-1326074240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:12:21 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-4fbd6494-7f8e-49fa-9db4-4e1162a36743 tempest-VolumesDeleteCascade-1326074240 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:12:21 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-4fbd6494-7f8e-49fa-9db4-4e1162a36743 tempest-VolumesDeleteCascade-1326074240 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:12:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4fbd6494-7f8e-49fa-9db4-4e1162a36743 tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:21 devstack sudo[109585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01 1073741824 Jun 24 05:12:21 devstack sudo[109585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:22 devstack sudo[109585]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4fbd6494-7f8e-49fa-9db4-4e1162a36743 tempest-VolumesDeleteCascade-1326074240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01 1073741824" returned: 0 in 1.008s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4fbd6494-7f8e-49fa-9db4-4e1162a36743 tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:22 devstack sudo[109592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01 Jun 24 05:12:22 devstack sudo[109592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:23 devstack sudo[109592]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4fbd6494-7f8e-49fa-9db4-4e1162a36743 tempest-VolumesDeleteCascade-1326074240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01" returned: 0 in 0.713s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:23 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-4fbd6494-7f8e-49fa-9db4-4e1162a36743 tempest-VolumesDeleteCascade-1326074240 None] <== create_volume: return (1769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:12:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4fbd6494-7f8e-49fa-9db4-4e1162a36743 tempest-VolumesDeleteCascade-1326074240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:12:23 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4fbd6494-7f8e-49fa-9db4-4e1162a36743 tempest-VolumesDeleteCascade-1326074240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcbc98b9-c00d-4490-863a-a94abc9f153d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-493829f3-2832-4b7a-8b23-1ec8d8871c01', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:12:23 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4fbd6494-7f8e-49fa-9db4-4e1162a36743 tempest-VolumesDeleteCascade-1326074240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7864706a-c9a0-4a5a-acdc-9296ab69141c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:12:23 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-4fbd6494-7f8e-49fa-9db4-4e1162a36743 tempest-VolumesDeleteCascade-1326074240 None] Volume volume-493829f3-2832-4b7a-8b23-1ec8d8871c01 (493829f3-2832-4b7a-8b23-1ec8d8871c01): created successfully Jun 24 05:12:23 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4fbd6494-7f8e-49fa-9db4-4e1162a36743 tempest-VolumesDeleteCascade-1326074240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7864706a-c9a0-4a5a-acdc-9296ab69141c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:12:23 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4fbd6494-7f8e-49fa-9db4-4e1162a36743 tempest-VolumesDeleteCascade-1326074240 None] Flow 'volume_create_manager' (1bdb7f06-49be-4115-9dda-d04fcbb1d641) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:12:23 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-4fbd6494-7f8e-49fa-9db4-4e1162a36743 tempest-VolumesDeleteCascade-1326074240 None] Created volume successfully. Jun 24 05:12:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f6f8f7fd-369a-4775-a1bd-7e552ced46f6 tempest-VolumesDeleteCascade-1326074240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:12:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f6f8f7fd-369a-4775-a1bd-7e552ced46f6 tempest-VolumesDeleteCascade-1326074240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:12:23 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-f6f8f7fd-369a-4775-a1bd-7e552ced46f6 tempest-VolumesDeleteCascade-1326074240 None] Creating offline snapshot 3773d86e-aa96-4888-8a4d-9c6fa8a4884a of volume 493829f3-2832-4b7a-8b23-1ec8d8871c01 {{(pid=93830) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 05:12:23 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1267ba8-9405-4e6f-9e08-aca2b970ff46]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:12:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f6f8f7fd-369a-4775-a1bd-7e552ced46f6 tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:23 devstack sudo[109596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01 Jun 24 05:12:23 devstack sudo[109596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:24 devstack sudo[109596]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f6f8f7fd-369a-4775-a1bd-7e552ced46f6 tempest-VolumesDeleteCascade-1326074240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01" returned: 0 in 0.795s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f6f8f7fd-369a-4775-a1bd-7e552ced46f6 tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.3773d86e-aa96-4888-8a4d-9c6fa8a4884a 1G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:24 devstack sudo[109601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.3773d86e-aa96-4888-8a4d-9c6fa8a4884a 1G Jun 24 05:12:24 devstack sudo[109601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:25 devstack sudo[109601]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f6f8f7fd-369a-4775-a1bd-7e552ced46f6 tempest-VolumesDeleteCascade-1326074240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.3773d86e-aa96-4888-8a4d-9c6fa8a4884a 1G" returned: 0 in 0.783s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f6f8f7fd-369a-4775-a1bd-7e552ced46f6 tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-493829f3-2832-4b7a-8b23-1ec8d8871c01 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.3773d86e-aa96-4888-8a4d-9c6fa8a4884a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:25 devstack sudo[109606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-493829f3-2832-4b7a-8b23-1ec8d8871c01 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.3773d86e-aa96-4888-8a4d-9c6fa8a4884a Jun 24 05:12:25 devstack sudo[109606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:25 devstack sudo[109606]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f6f8f7fd-369a-4775-a1bd-7e552ced46f6 tempest-VolumesDeleteCascade-1326074240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-493829f3-2832-4b7a-8b23-1ec8d8871c01 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.3773d86e-aa96-4888-8a4d-9c6fa8a4884a" returned: 0 in 0.672s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:25 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-f6f8f7fd-369a-4775-a1bd-7e552ced46f6 tempest-VolumesDeleteCascade-1326074240 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.3773d86e-aa96-4888-8a4d-9c6fa8a4884a is being set with open permissions: ugo+rw Jun 24 05:12:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f6f8f7fd-369a-4775-a1bd-7e552ced46f6 tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.3773d86e-aa96-4888-8a4d-9c6fa8a4884a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:25 devstack sudo[109614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.3773d86e-aa96-4888-8a4d-9c6fa8a4884a Jun 24 05:12:25 devstack sudo[109614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:26 devstack sudo[109614]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f6f8f7fd-369a-4775-a1bd-7e552ced46f6 tempest-VolumesDeleteCascade-1326074240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.3773d86e-aa96-4888-8a4d-9c6fa8a4884a" returned: 0 in 0.614s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:26 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:SELECT=70,cinder:INSERT=16,cinder:UPDATE=65,cinder:DELETE=7 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:12:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f6f8f7fd-369a-4775-a1bd-7e552ced46f6 tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:26 devstack sudo[109617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.info Jun 24 05:12:26 devstack sudo[109617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:27 devstack sudo[109617]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f6f8f7fd-369a-4775-a1bd-7e552ced46f6 tempest-VolumesDeleteCascade-1326074240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.info" returned: 0 in 0.691s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:27 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-f6f8f7fd-369a-4775-a1bd-7e552ced46f6 tempest-VolumesDeleteCascade-1326074240 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.info is being set with open permissions: ugo+rw Jun 24 05:12:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f6f8f7fd-369a-4775-a1bd-7e552ced46f6 tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:27 devstack sudo[109620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.info Jun 24 05:12:27 devstack sudo[109620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:27 devstack sudo[109620]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f6f8f7fd-369a-4775-a1bd-7e552ced46f6 tempest-VolumesDeleteCascade-1326074240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.info" returned: 0 in 0.679s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f6f8f7fd-369a-4775-a1bd-7e552ced46f6 tempest-VolumesDeleteCascade-1326074240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.344s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:12:27 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-f6f8f7fd-369a-4775-a1bd-7e552ced46f6 tempest-VolumesDeleteCascade-1326074240 None] Create snapshot completed successfully Jun 24 05:12:27 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:UPDATE=70,cinder:SELECT=64,cinder:INSERT=29,cinder:DELETE=6 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:12:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-91ae7834-c0d1-4549-a952-4c0c8aa370ee tempest-VolumesDeleteCascade-1326074240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:12:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-91ae7834-c0d1-4549-a952-4c0c8aa370ee tempest-VolumesDeleteCascade-1326074240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:12:28 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-91ae7834-c0d1-4549-a952-4c0c8aa370ee tempest-VolumesDeleteCascade-1326074240 None] Creating offline snapshot 8b61769a-7e05-43b2-bd58-255af8723e99 of volume 493829f3-2832-4b7a-8b23-1ec8d8871c01 {{(pid=93830) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 05:12:28 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c2920e-810b-47df-9228-d733f83256ce]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:12:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-91ae7834-c0d1-4549-a952-4c0c8aa370ee tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.3773d86e-aa96-4888-8a4d-9c6fa8a4884a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:28 devstack sudo[109623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.3773d86e-aa96-4888-8a4d-9c6fa8a4884a Jun 24 05:12:28 devstack sudo[109623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:29 devstack sudo[109623]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-91ae7834-c0d1-4549-a952-4c0c8aa370ee tempest-VolumesDeleteCascade-1326074240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.3773d86e-aa96-4888-8a4d-9c6fa8a4884a" returned: 0 in 0.826s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:29 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-91ae7834-c0d1-4549-a952-4c0c8aa370ee tempest-VolumesDeleteCascade-1326074240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-493829f3-2832-4b7a-8b23-1ec8d8871c01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:12:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-91ae7834-c0d1-4549-a952-4c0c8aa370ee tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.3773d86e-aa96-4888-8a4d-9c6fa8a4884a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.8b61769a-7e05-43b2-bd58-255af8723e99 1G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:29 devstack sudo[109629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.3773d86e-aa96-4888-8a4d-9c6fa8a4884a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.8b61769a-7e05-43b2-bd58-255af8723e99 1G Jun 24 05:12:29 devstack sudo[109629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:30 devstack sudo[109629]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-91ae7834-c0d1-4549-a952-4c0c8aa370ee tempest-VolumesDeleteCascade-1326074240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.3773d86e-aa96-4888-8a4d-9c6fa8a4884a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.8b61769a-7e05-43b2-bd58-255af8723e99 1G" returned: 0 in 0.871s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-91ae7834-c0d1-4549-a952-4c0c8aa370ee tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.3773d86e-aa96-4888-8a4d-9c6fa8a4884a -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.8b61769a-7e05-43b2-bd58-255af8723e99 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:30 devstack sudo[109637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.3773d86e-aa96-4888-8a4d-9c6fa8a4884a -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.8b61769a-7e05-43b2-bd58-255af8723e99 Jun 24 05:12:30 devstack sudo[109637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:31 devstack sudo[109637]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-91ae7834-c0d1-4549-a952-4c0c8aa370ee tempest-VolumesDeleteCascade-1326074240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.3773d86e-aa96-4888-8a4d-9c6fa8a4884a -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.8b61769a-7e05-43b2-bd58-255af8723e99" returned: 0 in 0.705s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:31 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-91ae7834-c0d1-4549-a952-4c0c8aa370ee tempest-VolumesDeleteCascade-1326074240 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.8b61769a-7e05-43b2-bd58-255af8723e99 is being set with open permissions: ugo+rw Jun 24 05:12:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-91ae7834-c0d1-4549-a952-4c0c8aa370ee tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.8b61769a-7e05-43b2-bd58-255af8723e99 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:31 devstack sudo[109642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.8b61769a-7e05-43b2-bd58-255af8723e99 Jun 24 05:12:31 devstack sudo[109642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:32 devstack sudo[109642]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-91ae7834-c0d1-4549-a952-4c0c8aa370ee tempest-VolumesDeleteCascade-1326074240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.8b61769a-7e05-43b2-bd58-255af8723e99" returned: 0 in 0.723s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-91ae7834-c0d1-4549-a952-4c0c8aa370ee tempest-VolumesDeleteCascade-1326074240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.226s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:12:32 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-91ae7834-c0d1-4549-a952-4c0c8aa370ee tempest-VolumesDeleteCascade-1326074240 None] Create snapshot completed successfully Jun 24 05:12:33 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Acquiring lock "cinder-493829f3-2832-4b7a-8b23-1ec8d8871c01-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:12:33 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Lock "cinder-493829f3-2832-4b7a-8b23-1ec8d8871c01-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:12:33 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Performing cascade delete. {{(pid=93830) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 24 05:12:33 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Acquiring lock "cinder-3773d86e-aa96-4888-8a4d-9c6fa8a4884a-delete_snapshot" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:12:33 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Lock "cinder-3773d86e-aa96-4888-8a4d-9c6fa8a4884a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:12:33 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Acquiring lock "cinder-quobyte-493829f3-2832-4b7a-8b23-1ec8d8871c01" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:12:33 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Lock "cinder-quobyte-493829f3-2832-4b7a-8b23-1ec8d8871c01" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:12:33 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Acquiring lock "cinder-quobyte-3773d86e-aa96-4888-8a4d-9c6fa8a4884a" by "_delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:12:33 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Lock "cinder-quobyte-3773d86e-aa96-4888-8a4d-9c6fa8a4884a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:12:33 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Deleting offline snapshot 3773d86e-aa96-4888-8a4d-9c6fa8a4884a of volume 493829f3-2832-4b7a-8b23-1ec8d8871c01 {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 05:12:33 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] snapshot_file for this snap is: volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.3773d86e-aa96-4888-8a4d-9c6fa8a4884a {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 05:12:33 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e06513b-de69-44a7-8f6f-8da4a8550685]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:12:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.3773d86e-aa96-4888-8a4d-9c6fa8a4884a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:33 devstack sudo[109657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.3773d86e-aa96-4888-8a4d-9c6fa8a4884a Jun 24 05:12:33 devstack sudo[109657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:34 devstack sudo[109657]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.3773d86e-aa96-4888-8a4d-9c6fa8a4884a" returned: 0 in 1.040s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:34 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-493829f3-2832-4b7a-8b23-1ec8d8871c01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:12:34 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b4e534-1619-4802-b2a3-ebee42a9f5f4]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:12:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:34 devstack sudo[109700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01 Jun 24 05:12:34 devstack sudo[109700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:35 devstack sudo[109700]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01" returned: 0 in 0.806s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:35 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a3b7f3-e477-4901-9893-5aa998e0553d]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:12:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.8b61769a-7e05-43b2-bd58-255af8723e99 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:35 devstack sudo[109705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.8b61769a-7e05-43b2-bd58-255af8723e99 Jun 24 05:12:35 devstack sudo[109705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:36 devstack sudo[109705]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.8b61769a-7e05-43b2-bd58-255af8723e99" returned: 0 in 0.843s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:36 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-493829f3-2832-4b7a-8b23-1ec8d8871c01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:12:36 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-a85aa0c8-5444-4d7c-a3d3-38d43542e853 req-0416b736-69ef-4fe0-bba7-f0d6e647f7ae tempest-TestMinimumBasicScenario-62037080 None] Terminate volume connection completed successfully. Jun 24 05:12:36 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-a85aa0c8-5444-4d7c-a3d3-38d43542e853 req-0416b736-69ef-4fe0-bba7-f0d6e647f7ae tempest-TestMinimumBasicScenario-62037080 None] Deleting attachment 6df40f9b-19ce-45e6-ac99-8888abcbf8ae. {{(pid=93830) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 05:12:36 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[e626090a-71ae-418c-bf26-e7da349ac043]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:12:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.3773d86e-aa96-4888-8a4d-9c6fa8a4884a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:36 devstack sudo[109717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.3773d86e-aa96-4888-8a4d-9c6fa8a4884a Jun 24 05:12:36 devstack sudo[109717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:36 devstack sudo[109717]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.3773d86e-aa96-4888-8a4d-9c6fa8a4884a" returned: 0 in 0.773s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:36 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-493829f3-2832-4b7a-8b23-1ec8d8871c01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:12:36 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c95fdd-5c19-40eb-ab03-08fb7ef4c8b8]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:12:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:37 devstack sudo[109722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01 Jun 24 05:12:37 devstack sudo[109722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:37 devstack sudo[109722]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01" returned: 0 in 0.756s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.3773d86e-aa96-4888-8a4d-9c6fa8a4884a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:37 devstack sudo[109727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.3773d86e-aa96-4888-8a4d-9c6fa8a4884a Jun 24 05:12:37 devstack sudo[109727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:38 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-263f7e5a-47e7-47a7-b7a5-ef3297115d04 tempest-TestMinimumBasicScenario-62037080 None] Acquiring lock "cinder-b9699b94-47a4-4bf6-8a8a-ca350e22e385-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:12:38 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-263f7e5a-47e7-47a7-b7a5-ef3297115d04 tempest-TestMinimumBasicScenario-62037080 None] Lock "cinder-b9699b94-47a4-4bf6-8a8a-ca350e22e385-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:12:38 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-263f7e5a-47e7-47a7-b7a5-ef3297115d04 tempest-TestMinimumBasicScenario-62037080 None] Acquiring lock "cinder-quobyte-b9699b94-47a4-4bf6-8a8a-ca350e22e385" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:12:38 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-263f7e5a-47e7-47a7-b7a5-ef3297115d04 tempest-TestMinimumBasicScenario-62037080 None] Lock "cinder-quobyte-b9699b94-47a4-4bf6-8a8a-ca350e22e385" acquired by "delete_volume" :: waited 0.015s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:12:38 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a1aead-6233-426d-b448-c7fe6fd50892]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:12:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-263f7e5a-47e7-47a7-b7a5-ef3297115d04 tempest-TestMinimumBasicScenario-62037080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b9699b94-47a4-4bf6-8a8a-ca350e22e385 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:38 devstack sudo[109729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b9699b94-47a4-4bf6-8a8a-ca350e22e385 Jun 24 05:12:38 devstack sudo[109729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:38 devstack sudo[109727]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.3773d86e-aa96-4888-8a4d-9c6fa8a4884a" returned: 0 in 0.765s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.3773d86e-aa96-4888-8a4d-9c6fa8a4884a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:38 devstack sudo[109734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.3773d86e-aa96-4888-8a4d-9c6fa8a4884a Jun 24 05:12:38 devstack sudo[109734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:38 devstack sudo[109729]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-263f7e5a-47e7-47a7-b7a5-ef3297115d04 tempest-TestMinimumBasicScenario-62037080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b9699b94-47a4-4bf6-8a8a-ca350e22e385" returned: 0 in 0.774s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-263f7e5a-47e7-47a7-b7a5-ef3297115d04 tempest-TestMinimumBasicScenario-62037080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b9699b94-47a4-4bf6-8a8a-ca350e22e385 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:38 devstack sudo[109739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b9699b94-47a4-4bf6-8a8a-ca350e22e385 Jun 24 05:12:38 devstack sudo[109739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:39 devstack sudo[109734]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.3773d86e-aa96-4888-8a4d-9c6fa8a4884a" returned: 0 in 0.644s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-493829f3-2832-4b7a-8b23-1ec8d8871c01 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.8b61769a-7e05-43b2-bd58-255af8723e99 -F qcow2 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:39 devstack sudo[109742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-493829f3-2832-4b7a-8b23-1ec8d8871c01 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.8b61769a-7e05-43b2-bd58-255af8723e99 -F qcow2 Jun 24 05:12:39 devstack sudo[109742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:39 devstack sudo[109739]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-263f7e5a-47e7-47a7-b7a5-ef3297115d04 tempest-TestMinimumBasicScenario-62037080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b9699b94-47a4-4bf6-8a8a-ca350e22e385" returned: 0 in 0.643s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:39 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-263f7e5a-47e7-47a7-b7a5-ef3297115d04 tempest-TestMinimumBasicScenario-62037080 None] Lock "cinder-quobyte-b9699b94-47a4-4bf6-8a8a-ca350e22e385" released by "delete_volume" :: held 1.464s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:12:39 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-263f7e5a-47e7-47a7-b7a5-ef3297115d04 tempest-TestMinimumBasicScenario-62037080 None] Created reservations ['a2e7ae4f-9324-4cef-acc8-814624328c08', 'cf7a7b4b-92d9-4e02-ba8c-881ad7c4a98b', '51a02fe4-26f8-47f4-824f-83145960fe62', '3622aec6-9fd8-4d5c-934b-6395f065982d'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:12:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-263f7e5a-47e7-47a7-b7a5-ef3297115d04 tempest-TestMinimumBasicScenario-62037080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:12:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-263f7e5a-47e7-47a7-b7a5-ef3297115d04 tempest-TestMinimumBasicScenario-62037080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:12:39 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-263f7e5a-47e7-47a7-b7a5-ef3297115d04 tempest-TestMinimumBasicScenario-62037080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:12:39 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-263f7e5a-47e7-47a7-b7a5-ef3297115d04 tempest-TestMinimumBasicScenario-62037080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:12:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-263f7e5a-47e7-47a7-b7a5-ef3297115d04 tempest-TestMinimumBasicScenario-62037080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:12:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-263f7e5a-47e7-47a7-b7a5-ef3297115d04 tempest-TestMinimumBasicScenario-62037080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:39 devstack sudo[109748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:12:39 devstack sudo[109748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:39 devstack sudo[109742]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-493829f3-2832-4b7a-8b23-1ec8d8871c01 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.8b61769a-7e05-43b2-bd58-255af8723e99 -F qcow2" returned: 0 in 0.709s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:39 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Lock "cinder-quobyte-3773d86e-aa96-4888-8a4d-9c6fa8a4884a" released by "_delete_snapshot" :: held 6.538s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:12:39 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Lock "cinder-quobyte-493829f3-2832-4b7a-8b23-1ec8d8871c01" released by "delete_snapshot" :: held 6.561s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:12:39 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Created reservations ['1e190a02-fdcd-481b-99e8-f1ed7f2013a3', '1579b49a-b6f9-45db-bac1-e2bae1ea0ea0', 'd41e95d9-a0ee-46c1-9904-39c7aa875b09', 'd26f63d6-1f86-41be-8555-c46746edb34f'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:12:39 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Delete snapshot completed successfully. Jun 24 05:12:39 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Lock "cinder-3773d86e-aa96-4888-8a4d-9c6fa8a4884a-delete_snapshot" released by "delete_snapshot" :: held 6.709s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:12:39 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Acquiring lock "cinder-8b61769a-7e05-43b2-bd58-255af8723e99-delete_snapshot" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:12:39 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Lock "cinder-8b61769a-7e05-43b2-bd58-255af8723e99-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:12:39 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Acquiring lock "cinder-quobyte-493829f3-2832-4b7a-8b23-1ec8d8871c01" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:12:39 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Lock "cinder-quobyte-493829f3-2832-4b7a-8b23-1ec8d8871c01" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:12:39 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Acquiring lock "cinder-quobyte-8b61769a-7e05-43b2-bd58-255af8723e99" by "_delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:12:39 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Lock "cinder-quobyte-8b61769a-7e05-43b2-bd58-255af8723e99" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:12:39 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Deleting offline snapshot 8b61769a-7e05-43b2-bd58-255af8723e99 of volume 493829f3-2832-4b7a-8b23-1ec8d8871c01 {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 05:12:40 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] snapshot_file for this snap is: volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.8b61769a-7e05-43b2-bd58-255af8723e99 {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 05:12:40 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9361161-711f-4833-a5bb-290a22e39edd]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:12:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.8b61769a-7e05-43b2-bd58-255af8723e99 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:40 devstack sudo[109750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.8b61769a-7e05-43b2-bd58-255af8723e99 Jun 24 05:12:40 devstack sudo[109750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:40 devstack sudo[109748]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-263f7e5a-47e7-47a7-b7a5-ef3297115d04 tempest-TestMinimumBasicScenario-62037080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.656s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:40 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-263f7e5a-47e7-47a7-b7a5-ef3297115d04 tempest-TestMinimumBasicScenario-62037080 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:12:40 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-263f7e5a-47e7-47a7-b7a5-ef3297115d04 tempest-TestMinimumBasicScenario-62037080 None] Deleted volume successfully. Jun 24 05:12:40 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-263f7e5a-47e7-47a7-b7a5-ef3297115d04 tempest-TestMinimumBasicScenario-62037080 None] Lock "cinder-b9699b94-47a4-4bf6-8a8a-ca350e22e385-delete_volume" released by "delete_volume" :: held 2.366s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:12:40 devstack sudo[109750]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.8b61769a-7e05-43b2-bd58-255af8723e99" returned: 0 in 0.856s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:40 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-493829f3-2832-4b7a-8b23-1ec8d8871c01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:12:40 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb8830e-c3df-4ade-b0de-ab968d095cf4]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:12:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:41 devstack sudo[109757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01 Jun 24 05:12:41 devstack sudo[109757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:41 devstack sudo[109757]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01" returned: 0 in 0.955s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.8b61769a-7e05-43b2-bd58-255af8723e99 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:41 devstack sudo[109802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.8b61769a-7e05-43b2-bd58-255af8723e99 Jun 24 05:12:41 devstack sudo[109802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:42 devstack sudo[109802]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.8b61769a-7e05-43b2-bd58-255af8723e99" returned: 0 in 0.902s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.8b61769a-7e05-43b2-bd58-255af8723e99 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:42 devstack sudo[109811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.8b61769a-7e05-43b2-bd58-255af8723e99 Jun 24 05:12:42 devstack sudo[109811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:43 devstack sudo[109811]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01.8b61769a-7e05-43b2-bd58-255af8723e99" returned: 0 in 0.739s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:43 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Lock "cinder-quobyte-8b61769a-7e05-43b2-bd58-255af8723e99" released by "_delete_snapshot" :: held 3.553s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:12:43 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Lock "cinder-quobyte-493829f3-2832-4b7a-8b23-1ec8d8871c01" released by "delete_snapshot" :: held 3.585s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:12:43 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Created reservations ['d3a441f8-3a08-4cff-9e62-104d5ef0bfa7', 'c310c7fc-d513-473b-b739-8c8947c4e6f9', '0c4f800a-7b78-487f-a8ba-9fa6154322d8', 'ab572f06-ef43-4e97-8d87-0bc3096cae69'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:12:43 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Delete snapshot completed successfully. Jun 24 05:12:43 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Lock "cinder-8b61769a-7e05-43b2-bd58-255af8723e99-delete_snapshot" released by "delete_snapshot" :: held 3.763s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:12:43 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Snapshots deleted, issuing volume delete {{(pid=93830) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 24 05:12:43 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Acquiring lock "cinder-quobyte-493829f3-2832-4b7a-8b23-1ec8d8871c01" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:12:43 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Lock "cinder-quobyte-493829f3-2832-4b7a-8b23-1ec8d8871c01" acquired by "delete_volume" :: waited 0.017s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:12:43 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[747ad646-c597-45cf-a4c6-da7be25f7a4e]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:12:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:43 devstack sudo[109818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01 Jun 24 05:12:43 devstack sudo[109818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:44 devstack sudo[109818]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01" returned: 0 in 0.775s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:44 devstack sudo[109823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01 Jun 24 05:12:44 devstack sudo[109823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:45 devstack sudo[109823]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-493829f3-2832-4b7a-8b23-1ec8d8871c01" returned: 0 in 0.638s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:45 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Lock "cinder-quobyte-493829f3-2832-4b7a-8b23-1ec8d8871c01" released by "delete_volume" :: held 1.471s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:12:45 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Created reservations ['a8baf05f-4a43-466c-b14d-d6e4de6fb033', '592b0997-a624-489f-a766-7975785e2e6f', '480cf9bf-d73c-4fe2-9128-2e44e2fb7bb0', '341d9923-3a90-4442-9285-c59a43a44fc0'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:12:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:12:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:12:45 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:12:45 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:12:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:12:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:45 devstack sudo[109827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:12:45 devstack sudo[109827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:45 devstack sudo[109827]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.648s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:45 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:12:45 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Deleted volume successfully. Jun 24 05:12:45 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9dd7fab9-7c00-4c0b-a687-4956e795e96b tempest-VolumesDeleteCascade-1326074240 None] Lock "cinder-493829f3-2832-4b7a-8b23-1ec8d8871c01-delete_volume" released by "delete_volume" :: held 12.832s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:12:46 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f902004-ee36-49f1-8f75-042ef1b88aa6 tempest-VolumesDeleteCascade-1326074240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:12:46 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8f902004-ee36-49f1-8f75-042ef1b88aa6 tempest-VolumesDeleteCascade-1326074240 None] Flow 'volume_create_manager' (e3178c34-c14f-47fb-8f4a-89655156a7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:12:46 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8f902004-ee36-49f1-8f75-042ef1b88aa6 tempest-VolumesDeleteCascade-1326074240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cefae9e8-2f3e-4e65-9108-bce54e454b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:12:46 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8f902004-ee36-49f1-8f75-042ef1b88aa6 tempest-VolumesDeleteCascade-1326074240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cefae9e8-2f3e-4e65-9108-bce54e454b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1957025614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=785c1062-72a6-42b6-983c-e800c9fa00d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc787d0be5d9407fb354959d5500ac0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:12:47Z,use_quota=True,user_id='5a86c8170a1846afab6e825183c4f414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:12:46 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8f902004-ee36-49f1-8f75-042ef1b88aa6 tempest-VolumesDeleteCascade-1326074240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (033136af-0110-4ee1-99fa-886a98b0dfa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:12:46 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8f902004-ee36-49f1-8f75-042ef1b88aa6 tempest-VolumesDeleteCascade-1326074240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (033136af-0110-4ee1-99fa-886a98b0dfa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:12:46 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8f902004-ee36-49f1-8f75-042ef1b88aa6 tempest-VolumesDeleteCascade-1326074240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cdfbaff-db36-4f7c-b687-f0a8a4991031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:12:46 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8f902004-ee36-49f1-8f75-042ef1b88aa6 tempest-VolumesDeleteCascade-1326074240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cdfbaff-db36-4f7c-b687-f0a8a4991031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '785c1062-72a6-42b6-983c-e800c9fa00d3', 'volume_name': 'volume-785c1062-72a6-42b6-983c-e800c9fa00d3', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:12:46 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8f902004-ee36-49f1-8f75-042ef1b88aa6 tempest-VolumesDeleteCascade-1326074240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b5290d1-67aa-4845-963b-c3bd7bc4d725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:12:46 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8f902004-ee36-49f1-8f75-042ef1b88aa6 tempest-VolumesDeleteCascade-1326074240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b5290d1-67aa-4845-963b-c3bd7bc4d725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:12:46 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8f902004-ee36-49f1-8f75-042ef1b88aa6 tempest-VolumesDeleteCascade-1326074240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (874d9a99-87db-4e88-9d1a-803fb8e2dea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:12:46 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-8f902004-ee36-49f1-8f75-042ef1b88aa6 tempest-VolumesDeleteCascade-1326074240 None] Volume 785c1062-72a6-42b6-983c-e800c9fa00d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-785c1062-72a6-42b6-983c-e800c9fa00d3', 'volume_size': 1} Jun 24 05:12:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-8f902004-ee36-49f1-8f75-042ef1b88aa6 tempest-VolumesDeleteCascade-1326074240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:12:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-8f902004-ee36-49f1-8f75-042ef1b88aa6 tempest-VolumesDeleteCascade-1326074240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:12:46 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-8f902004-ee36-49f1-8f75-042ef1b88aa6 tempest-VolumesDeleteCascade-1326074240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1957025614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=785c1062-72a6-42b6-983c-e800c9fa00d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc787d0be5d9407fb354959d5500ac0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:12:47Z,use_quota=True,user_id='5a86c8170a1846afab6e825183c4f414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:12:46 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-8f902004-ee36-49f1-8f75-042ef1b88aa6 tempest-VolumesDeleteCascade-1326074240 None] Creating volume 785c1062-72a6-42b6-983c-e800c9fa00d3 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:12:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-8f902004-ee36-49f1-8f75-042ef1b88aa6 tempest-VolumesDeleteCascade-1326074240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:12:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-8f902004-ee36-49f1-8f75-042ef1b88aa6 tempest-VolumesDeleteCascade-1326074240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:12:46 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-8f902004-ee36-49f1-8f75-042ef1b88aa6 tempest-VolumesDeleteCascade-1326074240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:12:46 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-8f902004-ee36-49f1-8f75-042ef1b88aa6 tempest-VolumesDeleteCascade-1326074240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:12:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-8f902004-ee36-49f1-8f75-042ef1b88aa6 tempest-VolumesDeleteCascade-1326074240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:12:46 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-8f902004-ee36-49f1-8f75-042ef1b88aa6 tempest-VolumesDeleteCascade-1326074240 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:12:46 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-8f902004-ee36-49f1-8f75-042ef1b88aa6 tempest-VolumesDeleteCascade-1326074240 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:12:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8f902004-ee36-49f1-8f75-042ef1b88aa6 tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:46 devstack sudo[109830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3 1073741824 Jun 24 05:12:46 devstack sudo[109830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:47 devstack sudo[109830]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8f902004-ee36-49f1-8f75-042ef1b88aa6 tempest-VolumesDeleteCascade-1326074240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3 1073741824" returned: 0 in 0.793s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8f902004-ee36-49f1-8f75-042ef1b88aa6 tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:47 devstack sudo[109836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3 Jun 24 05:12:47 devstack sudo[109836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:48 devstack sudo[109836]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8f902004-ee36-49f1-8f75-042ef1b88aa6 tempest-VolumesDeleteCascade-1326074240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3" returned: 0 in 0.685s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:48 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-8f902004-ee36-49f1-8f75-042ef1b88aa6 tempest-VolumesDeleteCascade-1326074240 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:12:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-8f902004-ee36-49f1-8f75-042ef1b88aa6 tempest-VolumesDeleteCascade-1326074240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:12:48 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8f902004-ee36-49f1-8f75-042ef1b88aa6 tempest-VolumesDeleteCascade-1326074240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (874d9a99-87db-4e88-9d1a-803fb8e2dea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-785c1062-72a6-42b6-983c-e800c9fa00d3', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:12:48 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8f902004-ee36-49f1-8f75-042ef1b88aa6 tempest-VolumesDeleteCascade-1326074240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10e19bd5-c3ce-4ece-beae-6d6a8f8cc232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:12:48 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-8f902004-ee36-49f1-8f75-042ef1b88aa6 tempest-VolumesDeleteCascade-1326074240 None] Volume volume-785c1062-72a6-42b6-983c-e800c9fa00d3 (785c1062-72a6-42b6-983c-e800c9fa00d3): created successfully Jun 24 05:12:48 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8f902004-ee36-49f1-8f75-042ef1b88aa6 tempest-VolumesDeleteCascade-1326074240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10e19bd5-c3ce-4ece-beae-6d6a8f8cc232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:12:48 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8f902004-ee36-49f1-8f75-042ef1b88aa6 tempest-VolumesDeleteCascade-1326074240 None] Flow 'volume_create_manager' (e3178c34-c14f-47fb-8f4a-89655156a7b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:12:48 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-8f902004-ee36-49f1-8f75-042ef1b88aa6 tempest-VolumesDeleteCascade-1326074240 None] Created volume successfully. Jun 24 05:12:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7afb5ed6-6f7f-4bb8-815b-391601d4a5e1 tempest-VolumesDeleteCascade-1326074240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:12:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7afb5ed6-6f7f-4bb8-815b-391601d4a5e1 tempest-VolumesDeleteCascade-1326074240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:12:49 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-7afb5ed6-6f7f-4bb8-815b-391601d4a5e1 tempest-VolumesDeleteCascade-1326074240 None] Creating offline snapshot 643f47f9-5da3-444e-869c-ddda193f8f8d of volume 785c1062-72a6-42b6-983c-e800c9fa00d3 {{(pid=93830) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 05:12:49 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[082bfd9a-ae11-4d72-88c0-e0797e79a4ab]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:12:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7afb5ed6-6f7f-4bb8-815b-391601d4a5e1 tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:49 devstack sudo[109839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3 Jun 24 05:12:49 devstack sudo[109839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:49 devstack sudo[109839]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7afb5ed6-6f7f-4bb8-815b-391601d4a5e1 tempest-VolumesDeleteCascade-1326074240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3" returned: 0 in 0.789s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7afb5ed6-6f7f-4bb8-815b-391601d4a5e1 tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3.643f47f9-5da3-444e-869c-ddda193f8f8d 1G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:49 devstack sudo[109845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3.643f47f9-5da3-444e-869c-ddda193f8f8d 1G Jun 24 05:12:49 devstack sudo[109845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7afb5ed6-6f7f-4bb8-815b-391601d4a5e1 tempest-VolumesDeleteCascade-1326074240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3.643f47f9-5da3-444e-869c-ddda193f8f8d 1G" returned: 0 in 0.849s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:50 devstack sudo[109845]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7afb5ed6-6f7f-4bb8-815b-391601d4a5e1 tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-785c1062-72a6-42b6-983c-e800c9fa00d3 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3.643f47f9-5da3-444e-869c-ddda193f8f8d {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:50 devstack sudo[109852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-785c1062-72a6-42b6-983c-e800c9fa00d3 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3.643f47f9-5da3-444e-869c-ddda193f8f8d Jun 24 05:12:50 devstack sudo[109852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:51 devstack sudo[109852]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7afb5ed6-6f7f-4bb8-815b-391601d4a5e1 tempest-VolumesDeleteCascade-1326074240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-785c1062-72a6-42b6-983c-e800c9fa00d3 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3.643f47f9-5da3-444e-869c-ddda193f8f8d" returned: 0 in 0.796s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:51 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-7afb5ed6-6f7f-4bb8-815b-391601d4a5e1 tempest-VolumesDeleteCascade-1326074240 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3.643f47f9-5da3-444e-869c-ddda193f8f8d is being set with open permissions: ugo+rw Jun 24 05:12:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7afb5ed6-6f7f-4bb8-815b-391601d4a5e1 tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3.643f47f9-5da3-444e-869c-ddda193f8f8d {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:51 devstack sudo[109858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3.643f47f9-5da3-444e-869c-ddda193f8f8d Jun 24 05:12:51 devstack sudo[109858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:52 devstack sudo[109858]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7afb5ed6-6f7f-4bb8-815b-391601d4a5e1 tempest-VolumesDeleteCascade-1326074240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3.643f47f9-5da3-444e-869c-ddda193f8f8d" returned: 0 in 0.666s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7afb5ed6-6f7f-4bb8-815b-391601d4a5e1 tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:52 devstack sudo[109861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3.info Jun 24 05:12:52 devstack sudo[109861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:52 devstack sudo[109861]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7afb5ed6-6f7f-4bb8-815b-391601d4a5e1 tempest-VolumesDeleteCascade-1326074240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3.info" returned: 0 in 0.690s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:52 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-7afb5ed6-6f7f-4bb8-815b-391601d4a5e1 tempest-VolumesDeleteCascade-1326074240 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3.info is being set with open permissions: ugo+rw Jun 24 05:12:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7afb5ed6-6f7f-4bb8-815b-391601d4a5e1 tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:52 devstack sudo[109865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3.info Jun 24 05:12:52 devstack sudo[109865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:53 devstack sudo[109865]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7afb5ed6-6f7f-4bb8-815b-391601d4a5e1 tempest-VolumesDeleteCascade-1326074240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3.info" returned: 0 in 0.656s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7afb5ed6-6f7f-4bb8-815b-391601d4a5e1 tempest-VolumesDeleteCascade-1326074240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.560s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:12:53 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-7afb5ed6-6f7f-4bb8-815b-391601d4a5e1 tempest-VolumesDeleteCascade-1326074240 None] Create snapshot completed successfully Jun 24 05:12:54 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:12:54 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Flow 'volume_create_manager' (ebcb4c45-9fdd-4978-a6d2-a9fb3965dc35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:12:54 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (917a2174-9d8b-42ad-b443-7c65ada532c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:12:54 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (917a2174-9d8b-42ad-b443-7c65ada532c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:12:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1722290474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2eabb93-8cd1-4865-a11c-c66a6a98222c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc787d0be5d9407fb354959d5500ac0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=643f47f9-5da3-444e-869c-ddda193f8f8d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:12:55Z,use_quota=True,user_id='5a86c8170a1846afab6e825183c4f414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:12:54 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a3ee52-1256-4dfc-b76f-f3576a8e93a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:12:54 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a3ee52-1256-4dfc-b76f-f3576a8e93a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:12:54 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29bff75a-d0f3-4807-a68d-b91a863cd24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:12:54 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29bff75a-d0f3-4807-a68d-b91a863cd24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b2eabb93-8cd1-4865-a11c-c66a6a98222c', 'volume_name': 'volume-b2eabb93-8cd1-4865-a11c-c66a6a98222c', 'volume_size': 1, 'snapshot_id': '643f47f9-5da3-444e-869c-ddda193f8f8d'}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:12:54 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27e31b42-85f6-4e00-b09b-ea4957348f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:12:54 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27e31b42-85f6-4e00-b09b-ea4957348f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:12:54 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56f5d9b1-8c79-4ea0-9e47-05cdf43c92ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:12:54 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Volume b2eabb93-8cd1-4865-a11c-c66a6a98222c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b2eabb93-8cd1-4865-a11c-c66a6a98222c', 'volume_size': 1, 'snapshot_id': '643f47f9-5da3-444e-869c-ddda193f8f8d'} Jun 24 05:12:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:12:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:12:55 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Acquiring lock "cinder-quobyte-643f47f9-5da3-444e-869c-ddda193f8f8d-b2eabb93-8cd1-4865-a11c-c66a6a98222c" by "_create_volume_from_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:12:55 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Lock "cinder-quobyte-643f47f9-5da3-444e-869c-ddda193f8f8d-b2eabb93-8cd1-4865-a11c-c66a6a98222c" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:12:55 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Creating volume b2eabb93-8cd1-4865-a11c-c66a6a98222c from snapshot 643f47f9-5da3-444e-869c-ddda193f8f8d {{(pid=93830) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 24 05:12:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:12:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:12:55 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:12:55 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:12:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:12:55 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:12:55 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Acquiring lock "cinder-quobyte-b2eabb93-8cd1-4865-a11c-c66a6a98222c" by "_copy_volume_from_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:12:55 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Lock "cinder-quobyte-b2eabb93-8cd1-4865-a11c-c66a6a98222c" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:12:55 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] snapshot: 643f47f9-5da3-444e-869c-ddda193f8f8d, volume: b2eabb93-8cd1-4865-a11c-c66a6a98222c, {{(pid=93830) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 05:12:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:12:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:12:55 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:12:55 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:12:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:12:55 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9467d2-612d-4e9c-a225-b2602a2698bb]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:12:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3.643f47f9-5da3-444e-869c-ddda193f8f8d {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:55 devstack sudo[109869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3.643f47f9-5da3-444e-869c-ddda193f8f8d Jun 24 05:12:55 devstack sudo[109869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:55 devstack sudo[109869]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3.643f47f9-5da3-444e-869c-ddda193f8f8d" returned: 0 in 0.822s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:55 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-785c1062-72a6-42b6-983c-e800c9fa00d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:12:55 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3 {{(pid=93830) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 05:12:55 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Creating direct copy from snapshot {{(pid=93830) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 05:12:55 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7fb24e-eca0-4286-9eac-59a3849e3dda]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:12:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:56 devstack sudo[109874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3 Jun 24 05:12:56 devstack sudo[109874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:12:56 devstack sudo[109874]: pam_unix(sudo:session): session closed for user root Jun 24 05:12:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3" returned: 0 in 0.812s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:12:56 devstack cinder-volume[93830]: DEBUG cinder.utils [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Path /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b2eabb93-8cd1-4865-a11c-c66a6a98222c not found in is_blk_device check {{(pid=93830) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 05:12:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b2eabb93-8cd1-4865-a11c-c66a6a98222c {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:12:56 devstack sudo[109879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b2eabb93-8cd1-4865-a11c-c66a6a98222c Jun 24 05:12:56 devstack sudo[109879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:13:02 devstack sudo[109879]: pam_unix(sudo:session): session closed for user root Jun 24 05:13:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b2eabb93-8cd1-4865-a11c-c66a6a98222c" returned: 0 in 5.279s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:13:02 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6b32ff-c5ea-4cb1-b057-017224578cb9]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:13:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:13:02 devstack sudo[109893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3 Jun 24 05:13:02 devstack sudo[109893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:13:03 devstack sudo[109893]: pam_unix(sudo:session): session closed for user root Jun 24 05:13:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3" returned: 0 in 0.992s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:13:03 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Image conversion details: src /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3, size 1024.00 MB, duration 5.28 sec, destination /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b2eabb93-8cd1-4865-a11c-c66a6a98222c {{(pid=93830) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 05:13:03 devstack cinder-volume[93830]: INFO cinder.image.image_utils [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Converted 1024.00 MB image at 193.92 MB/s Jun 24 05:13:03 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b2eabb93-8cd1-4865-a11c-c66a6a98222c is being set with open permissions: ugo+rw Jun 24 05:13:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b2eabb93-8cd1-4865-a11c-c66a6a98222c {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:13:03 devstack sudo[109898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b2eabb93-8cd1-4865-a11c-c66a6a98222c Jun 24 05:13:03 devstack sudo[109898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:13:03 devstack sudo[109898]: pam_unix(sudo:session): session closed for user root Jun 24 05:13:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b2eabb93-8cd1-4865-a11c-c66a6a98222c" returned: 0 in 0.699s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:13:03 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Lock "cinder-quobyte-b2eabb93-8cd1-4865-a11c-c66a6a98222c" released by "_copy_volume_from_snapshot" :: held 8.708s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:13:03 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Lock "cinder-quobyte-643f47f9-5da3-444e-869c-ddda193f8f8d-b2eabb93-8cd1-4865-a11c-c66a6a98222c" released by "_create_volume_from_snapshot" :: held 8.747s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:13:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.768s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:13:03 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56f5d9b1-8c79-4ea0-9e47-05cdf43c92ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2eabb93-8cd1-4865-a11c-c66a6a98222c', 'volume_size': 1, 'snapshot_id': '643f47f9-5da3-444e-869c-ddda193f8f8d'}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:13:03 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7c8eb5d-5b75-4640-9783-b2e07c959322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:13:03 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Volume volume-b2eabb93-8cd1-4865-a11c-c66a6a98222c (b2eabb93-8cd1-4865-a11c-c66a6a98222c): created successfully Jun 24 05:13:03 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7c8eb5d-5b75-4640-9783-b2e07c959322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:13:03 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Flow 'volume_create_manager' (ebcb4c45-9fdd-4978-a6d2-a9fb3965dc35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:13:03 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-746aca40-169e-403a-ae27-c8b2957489bf tempest-VolumesDeleteCascade-1326074240 None] Created volume successfully. Jun 24 05:13:05 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-38d5ffe1-f0b4-4030-85f7-1935cd5df5cc tempest-VolumesDeleteCascade-1326074240 None] Acquiring lock "cinder-785c1062-72a6-42b6-983c-e800c9fa00d3-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:13:05 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-38d5ffe1-f0b4-4030-85f7-1935cd5df5cc tempest-VolumesDeleteCascade-1326074240 None] Lock "cinder-785c1062-72a6-42b6-983c-e800c9fa00d3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:13:05 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-38d5ffe1-f0b4-4030-85f7-1935cd5df5cc tempest-VolumesDeleteCascade-1326074240 None] Performing cascade delete. {{(pid=93830) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 24 05:13:05 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-38d5ffe1-f0b4-4030-85f7-1935cd5df5cc tempest-VolumesDeleteCascade-1326074240 None] Acquiring lock "cinder-643f47f9-5da3-444e-869c-ddda193f8f8d-delete_snapshot" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:13:05 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-38d5ffe1-f0b4-4030-85f7-1935cd5df5cc tempest-VolumesDeleteCascade-1326074240 None] Lock "cinder-643f47f9-5da3-444e-869c-ddda193f8f8d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:13:05 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-38d5ffe1-f0b4-4030-85f7-1935cd5df5cc tempest-VolumesDeleteCascade-1326074240 None] Acquiring lock "cinder-quobyte-785c1062-72a6-42b6-983c-e800c9fa00d3" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:13:05 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-38d5ffe1-f0b4-4030-85f7-1935cd5df5cc tempest-VolumesDeleteCascade-1326074240 None] Lock "cinder-quobyte-785c1062-72a6-42b6-983c-e800c9fa00d3" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:13:05 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-38d5ffe1-f0b4-4030-85f7-1935cd5df5cc tempest-VolumesDeleteCascade-1326074240 None] Acquiring lock "cinder-quobyte-643f47f9-5da3-444e-869c-ddda193f8f8d" by "_delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:13:05 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-38d5ffe1-f0b4-4030-85f7-1935cd5df5cc tempest-VolumesDeleteCascade-1326074240 None] Lock "cinder-quobyte-643f47f9-5da3-444e-869c-ddda193f8f8d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:13:05 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-38d5ffe1-f0b4-4030-85f7-1935cd5df5cc tempest-VolumesDeleteCascade-1326074240 None] Deleting offline snapshot 643f47f9-5da3-444e-869c-ddda193f8f8d of volume 785c1062-72a6-42b6-983c-e800c9fa00d3 {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 05:13:05 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-38d5ffe1-f0b4-4030-85f7-1935cd5df5cc tempest-VolumesDeleteCascade-1326074240 None] snapshot_file for this snap is: volume-785c1062-72a6-42b6-983c-e800c9fa00d3.643f47f9-5da3-444e-869c-ddda193f8f8d {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 05:13:05 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd10182c-0fd9-4cdc-828c-8da82912ff9a]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:13:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-38d5ffe1-f0b4-4030-85f7-1935cd5df5cc tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3.643f47f9-5da3-444e-869c-ddda193f8f8d {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:13:05 devstack sudo[109907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3.643f47f9-5da3-444e-869c-ddda193f8f8d Jun 24 05:13:05 devstack sudo[109907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:13:06 devstack sudo[109907]: pam_unix(sudo:session): session closed for user root Jun 24 05:13:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-38d5ffe1-f0b4-4030-85f7-1935cd5df5cc tempest-VolumesDeleteCascade-1326074240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3.643f47f9-5da3-444e-869c-ddda193f8f8d" returned: 0 in 0.825s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:13:06 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-38d5ffe1-f0b4-4030-85f7-1935cd5df5cc tempest-VolumesDeleteCascade-1326074240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-785c1062-72a6-42b6-983c-e800c9fa00d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:13:06 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89ebac8-2d92-4913-97c2-5b258c9177a9]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:13:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-38d5ffe1-f0b4-4030-85f7-1935cd5df5cc tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:13:06 devstack sudo[109913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3 Jun 24 05:13:06 devstack sudo[109913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:13:07 devstack sudo[109913]: pam_unix(sudo:session): session closed for user root Jun 24 05:13:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-38d5ffe1-f0b4-4030-85f7-1935cd5df5cc tempest-VolumesDeleteCascade-1326074240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3" returned: 0 in 0.866s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:13:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-38d5ffe1-f0b4-4030-85f7-1935cd5df5cc tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3.643f47f9-5da3-444e-869c-ddda193f8f8d {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:13:07 devstack sudo[109918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3.643f47f9-5da3-444e-869c-ddda193f8f8d Jun 24 05:13:07 devstack sudo[109918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:13:07 devstack sudo[109918]: pam_unix(sudo:session): session closed for user root Jun 24 05:13:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-38d5ffe1-f0b4-4030-85f7-1935cd5df5cc tempest-VolumesDeleteCascade-1326074240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3.643f47f9-5da3-444e-869c-ddda193f8f8d" returned: 0 in 0.776s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:13:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-38d5ffe1-f0b4-4030-85f7-1935cd5df5cc tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3.643f47f9-5da3-444e-869c-ddda193f8f8d {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:13:07 devstack sudo[109924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3.643f47f9-5da3-444e-869c-ddda193f8f8d Jun 24 05:13:07 devstack sudo[109924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:13:08 devstack sudo[109924]: pam_unix(sudo:session): session closed for user root Jun 24 05:13:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-38d5ffe1-f0b4-4030-85f7-1935cd5df5cc tempest-VolumesDeleteCascade-1326074240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3.643f47f9-5da3-444e-869c-ddda193f8f8d" returned: 0 in 0.670s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:13:08 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-38d5ffe1-f0b4-4030-85f7-1935cd5df5cc tempest-VolumesDeleteCascade-1326074240 None] Lock "cinder-quobyte-643f47f9-5da3-444e-869c-ddda193f8f8d" released by "_delete_snapshot" :: held 3.244s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:13:08 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-38d5ffe1-f0b4-4030-85f7-1935cd5df5cc tempest-VolumesDeleteCascade-1326074240 None] Lock "cinder-quobyte-785c1062-72a6-42b6-983c-e800c9fa00d3" released by "delete_snapshot" :: held 3.273s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:13:08 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-38d5ffe1-f0b4-4030-85f7-1935cd5df5cc tempest-VolumesDeleteCascade-1326074240 None] Created reservations ['de1a87e1-e7d4-47a5-bf40-f9d07d4171a5', '9f888eb5-4e39-45bf-924c-7329d516b7f0', '7795f460-460e-408d-942d-c1d14b7f8ec1', '3306d2df-f344-4d4c-be3f-f132f61abb45'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:13:08 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-38d5ffe1-f0b4-4030-85f7-1935cd5df5cc tempest-VolumesDeleteCascade-1326074240 None] Delete snapshot completed successfully. Jun 24 05:13:08 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-38d5ffe1-f0b4-4030-85f7-1935cd5df5cc tempest-VolumesDeleteCascade-1326074240 None] Lock "cinder-643f47f9-5da3-444e-869c-ddda193f8f8d-delete_snapshot" released by "delete_snapshot" :: held 3.427s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:13:08 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-38d5ffe1-f0b4-4030-85f7-1935cd5df5cc tempest-VolumesDeleteCascade-1326074240 None] Snapshots deleted, issuing volume delete {{(pid=93830) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 24 05:13:08 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-38d5ffe1-f0b4-4030-85f7-1935cd5df5cc tempest-VolumesDeleteCascade-1326074240 None] Acquiring lock "cinder-quobyte-785c1062-72a6-42b6-983c-e800c9fa00d3" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:13:08 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-38d5ffe1-f0b4-4030-85f7-1935cd5df5cc tempest-VolumesDeleteCascade-1326074240 None] Lock "cinder-quobyte-785c1062-72a6-42b6-983c-e800c9fa00d3" acquired by "delete_volume" :: waited 0.015s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:13:08 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[6903909e-8a52-4a4c-a1c1-0b302d726da9]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:13:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-38d5ffe1-f0b4-4030-85f7-1935cd5df5cc tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:13:08 devstack sudo[109927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3 Jun 24 05:13:08 devstack sudo[109927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:13:09 devstack sudo[109927]: pam_unix(sudo:session): session closed for user root Jun 24 05:13:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-38d5ffe1-f0b4-4030-85f7-1935cd5df5cc tempest-VolumesDeleteCascade-1326074240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3" returned: 0 in 0.808s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:13:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-38d5ffe1-f0b4-4030-85f7-1935cd5df5cc tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:13:09 devstack sudo[109933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3 Jun 24 05:13:09 devstack sudo[109933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:13:09 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 05:13:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:13:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:13:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:13:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:13:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:13:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:13:09 devstack sudo[109935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:13:09 devstack sudo[109935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:13:10 devstack sudo[109933]: pam_unix(sudo:session): session closed for user root Jun 24 05:13:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-38d5ffe1-f0b4-4030-85f7-1935cd5df5cc tempest-VolumesDeleteCascade-1326074240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-785c1062-72a6-42b6-983c-e800c9fa00d3" returned: 0 in 0.729s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:13:10 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-38d5ffe1-f0b4-4030-85f7-1935cd5df5cc tempest-VolumesDeleteCascade-1326074240 None] Lock "cinder-quobyte-785c1062-72a6-42b6-983c-e800c9fa00d3" released by "delete_volume" :: held 1.615s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:13:10 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-38d5ffe1-f0b4-4030-85f7-1935cd5df5cc tempest-VolumesDeleteCascade-1326074240 None] Created reservations ['934e802a-1d85-4f1d-a708-badb5fdfad21', 'e5b92a23-3fb6-41fe-97f2-d611bede834c', 'bc4b55a3-3049-4e4d-bfe0-4f74489a8792', 'ebe0f4d2-5249-48f8-ba0a-512e1ce11ff5'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:13:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-38d5ffe1-f0b4-4030-85f7-1935cd5df5cc tempest-VolumesDeleteCascade-1326074240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:13:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-38d5ffe1-f0b4-4030-85f7-1935cd5df5cc tempest-VolumesDeleteCascade-1326074240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:13:10 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-38d5ffe1-f0b4-4030-85f7-1935cd5df5cc tempest-VolumesDeleteCascade-1326074240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:13:10 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-38d5ffe1-f0b4-4030-85f7-1935cd5df5cc tempest-VolumesDeleteCascade-1326074240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:13:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-38d5ffe1-f0b4-4030-85f7-1935cd5df5cc tempest-VolumesDeleteCascade-1326074240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:13:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-38d5ffe1-f0b4-4030-85f7-1935cd5df5cc tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:13:10 devstack sudo[109940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:13:10 devstack sudo[109940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:13:10 devstack sudo[109935]: pam_unix(sudo:session): session closed for user root Jun 24 05:13:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.766s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:13:10 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:13:10 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager._thread_info {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 05:13:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread count: 29 {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 05:13:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread info: [<_MainThread(MainThread, started 130211312517248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 05:13:10 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-33870054-e56d-4163-b6c7-0f010db345b8 tempest-VolumesDeleteCascade-1326074240 None] Acquiring lock "cinder-b2eabb93-8cd1-4865-a11c-c66a6a98222c-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:13:10 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-33870054-e56d-4163-b6c7-0f010db345b8 tempest-VolumesDeleteCascade-1326074240 None] Lock "cinder-b2eabb93-8cd1-4865-a11c-c66a6a98222c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:13:10 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-33870054-e56d-4163-b6c7-0f010db345b8 tempest-VolumesDeleteCascade-1326074240 None] Acquiring lock "cinder-quobyte-b2eabb93-8cd1-4865-a11c-c66a6a98222c" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:13:10 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-33870054-e56d-4163-b6c7-0f010db345b8 tempest-VolumesDeleteCascade-1326074240 None] Lock "cinder-quobyte-b2eabb93-8cd1-4865-a11c-c66a6a98222c" acquired by "delete_volume" :: waited 0.023s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:13:10 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9b670f-766d-4088-afa8-3257207e3de6]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:13:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-33870054-e56d-4163-b6c7-0f010db345b8 tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b2eabb93-8cd1-4865-a11c-c66a6a98222c {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:13:11 devstack sudo[109942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b2eabb93-8cd1-4865-a11c-c66a6a98222c Jun 24 05:13:11 devstack sudo[109942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:13:11 devstack sudo[109940]: pam_unix(sudo:session): session closed for user root Jun 24 05:13:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-38d5ffe1-f0b4-4030-85f7-1935cd5df5cc tempest-VolumesDeleteCascade-1326074240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.778s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:13:11 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-38d5ffe1-f0b4-4030-85f7-1935cd5df5cc tempest-VolumesDeleteCascade-1326074240 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:13:11 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-38d5ffe1-f0b4-4030-85f7-1935cd5df5cc tempest-VolumesDeleteCascade-1326074240 None] Deleted volume successfully. Jun 24 05:13:11 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-38d5ffe1-f0b4-4030-85f7-1935cd5df5cc tempest-VolumesDeleteCascade-1326074240 None] Lock "cinder-785c1062-72a6-42b6-983c-e800c9fa00d3-delete_volume" released by "delete_volume" :: held 6.084s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:13:11 devstack sudo[109942]: pam_unix(sudo:session): session closed for user root Jun 24 05:13:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-33870054-e56d-4163-b6c7-0f010db345b8 tempest-VolumesDeleteCascade-1326074240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b2eabb93-8cd1-4865-a11c-c66a6a98222c" returned: 0 in 0.872s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:13:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-33870054-e56d-4163-b6c7-0f010db345b8 tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b2eabb93-8cd1-4865-a11c-c66a6a98222c {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:13:11 devstack sudo[109948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b2eabb93-8cd1-4865-a11c-c66a6a98222c Jun 24 05:13:11 devstack sudo[109948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:13:12 devstack sudo[109948]: pam_unix(sudo:session): session closed for user root Jun 24 05:13:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-33870054-e56d-4163-b6c7-0f010db345b8 tempest-VolumesDeleteCascade-1326074240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b2eabb93-8cd1-4865-a11c-c66a6a98222c" returned: 0 in 0.694s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:13:12 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-33870054-e56d-4163-b6c7-0f010db345b8 tempest-VolumesDeleteCascade-1326074240 None] Lock "cinder-quobyte-b2eabb93-8cd1-4865-a11c-c66a6a98222c" released by "delete_volume" :: held 1.623s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:13:12 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-33870054-e56d-4163-b6c7-0f010db345b8 tempest-VolumesDeleteCascade-1326074240 None] Created reservations ['f8d0d8d5-7e81-4e84-987b-37aba75fa0af', 'e470925c-020e-4bb8-9132-e769d136215c', '2aee4320-d4fb-4d39-8cc8-e21c2b1cb040', '11bf94c8-b3ff-4421-8018-e80f8507eee9'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:13:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-33870054-e56d-4163-b6c7-0f010db345b8 tempest-VolumesDeleteCascade-1326074240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:13:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-33870054-e56d-4163-b6c7-0f010db345b8 tempest-VolumesDeleteCascade-1326074240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:13:12 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-33870054-e56d-4163-b6c7-0f010db345b8 tempest-VolumesDeleteCascade-1326074240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:13:12 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-33870054-e56d-4163-b6c7-0f010db345b8 tempest-VolumesDeleteCascade-1326074240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:13:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-33870054-e56d-4163-b6c7-0f010db345b8 tempest-VolumesDeleteCascade-1326074240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:13:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-33870054-e56d-4163-b6c7-0f010db345b8 tempest-VolumesDeleteCascade-1326074240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:13:12 devstack sudo[109951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:13:12 devstack sudo[109951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:13:13 devstack sudo[109951]: pam_unix(sudo:session): session closed for user root Jun 24 05:13:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-33870054-e56d-4163-b6c7-0f010db345b8 tempest-VolumesDeleteCascade-1326074240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.676s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:13:13 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-33870054-e56d-4163-b6c7-0f010db345b8 tempest-VolumesDeleteCascade-1326074240 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:13:13 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-33870054-e56d-4163-b6c7-0f010db345b8 tempest-VolumesDeleteCascade-1326074240 None] Deleted volume successfully. Jun 24 05:13:13 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-33870054-e56d-4163-b6c7-0f010db345b8 tempest-VolumesDeleteCascade-1326074240 None] Lock "cinder-b2eabb93-8cd1-4865-a11c-c66a6a98222c-delete_volume" released by "delete_volume" :: held 2.547s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:13:18 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2d8c61d-8daf-4ffc-922e-dbd807313545 tempest-VolumesTransfersTest-309299522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:13:18 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a2d8c61d-8daf-4ffc-922e-dbd807313545 tempest-VolumesTransfersTest-309299522 None] Flow 'volume_create_manager' (ed7d341f-a0ff-407b-9687-e9d6eef48f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:13:18 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a2d8c61d-8daf-4ffc-922e-dbd807313545 tempest-VolumesTransfersTest-309299522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee1ff436-aa7b-4fe7-8b00-c4c130f5e9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:13:18 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a2d8c61d-8daf-4ffc-922e-dbd807313545 tempest-VolumesTransfersTest-309299522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee1ff436-aa7b-4fe7-8b00-c4c130f5e9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1528911865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=735e7f53-0981-4e97-9962-75a2163073d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50245cb75a1b4fe5b3f80c53d1f023bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:13:18Z,use_quota=True,user_id='9a78723dae9648bd93d54cc4cf2794a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:13:18 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a2d8c61d-8daf-4ffc-922e-dbd807313545 tempest-VolumesTransfersTest-309299522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f308d0ab-6aa5-4342-bbbd-2ee53bdc7500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:13:18 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a2d8c61d-8daf-4ffc-922e-dbd807313545 tempest-VolumesTransfersTest-309299522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f308d0ab-6aa5-4342-bbbd-2ee53bdc7500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:13:18 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a2d8c61d-8daf-4ffc-922e-dbd807313545 tempest-VolumesTransfersTest-309299522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bc95f1f-f6cc-4784-ad5a-424f66954b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:13:18 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a2d8c61d-8daf-4ffc-922e-dbd807313545 tempest-VolumesTransfersTest-309299522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bc95f1f-f6cc-4784-ad5a-424f66954b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '735e7f53-0981-4e97-9962-75a2163073d2', 'volume_name': 'volume-735e7f53-0981-4e97-9962-75a2163073d2', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:13:18 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a2d8c61d-8daf-4ffc-922e-dbd807313545 tempest-VolumesTransfersTest-309299522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c3188d5-a87f-40c4-ba97-deea0cacd97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:13:18 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a2d8c61d-8daf-4ffc-922e-dbd807313545 tempest-VolumesTransfersTest-309299522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c3188d5-a87f-40c4-ba97-deea0cacd97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:13:18 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a2d8c61d-8daf-4ffc-922e-dbd807313545 tempest-VolumesTransfersTest-309299522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfb80441-cc3a-4316-b572-7a3796b6a74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:13:18 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-a2d8c61d-8daf-4ffc-922e-dbd807313545 tempest-VolumesTransfersTest-309299522 None] Volume 735e7f53-0981-4e97-9962-75a2163073d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-735e7f53-0981-4e97-9962-75a2163073d2', 'volume_size': 1} Jun 24 05:13:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a2d8c61d-8daf-4ffc-922e-dbd807313545 tempest-VolumesTransfersTest-309299522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:13:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a2d8c61d-8daf-4ffc-922e-dbd807313545 tempest-VolumesTransfersTest-309299522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:13:18 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a2d8c61d-8daf-4ffc-922e-dbd807313545 tempest-VolumesTransfersTest-309299522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1528911865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=735e7f53-0981-4e97-9962-75a2163073d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50245cb75a1b4fe5b3f80c53d1f023bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:13:18Z,use_quota=True,user_id='9a78723dae9648bd93d54cc4cf2794a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:13:18 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-a2d8c61d-8daf-4ffc-922e-dbd807313545 tempest-VolumesTransfersTest-309299522 None] Creating volume 735e7f53-0981-4e97-9962-75a2163073d2 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:13:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a2d8c61d-8daf-4ffc-922e-dbd807313545 tempest-VolumesTransfersTest-309299522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:13:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a2d8c61d-8daf-4ffc-922e-dbd807313545 tempest-VolumesTransfersTest-309299522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:13:18 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a2d8c61d-8daf-4ffc-922e-dbd807313545 tempest-VolumesTransfersTest-309299522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:13:18 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a2d8c61d-8daf-4ffc-922e-dbd807313545 tempest-VolumesTransfersTest-309299522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:13:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a2d8c61d-8daf-4ffc-922e-dbd807313545 tempest-VolumesTransfersTest-309299522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:13:18 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a2d8c61d-8daf-4ffc-922e-dbd807313545 tempest-VolumesTransfersTest-309299522 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:13:18 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-a2d8c61d-8daf-4ffc-922e-dbd807313545 tempest-VolumesTransfersTest-309299522 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:13:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a2d8c61d-8daf-4ffc-922e-dbd807313545 tempest-VolumesTransfersTest-309299522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-735e7f53-0981-4e97-9962-75a2163073d2 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:13:18 devstack sudo[109954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-735e7f53-0981-4e97-9962-75a2163073d2 1073741824 Jun 24 05:13:18 devstack sudo[109954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:13:19 devstack sudo[109954]: pam_unix(sudo:session): session closed for user root Jun 24 05:13:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a2d8c61d-8daf-4ffc-922e-dbd807313545 tempest-VolumesTransfersTest-309299522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-735e7f53-0981-4e97-9962-75a2163073d2 1073741824" returned: 0 in 0.945s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:13:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a2d8c61d-8daf-4ffc-922e-dbd807313545 tempest-VolumesTransfersTest-309299522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-735e7f53-0981-4e97-9962-75a2163073d2 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:13:19 devstack sudo[109960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-735e7f53-0981-4e97-9962-75a2163073d2 Jun 24 05:13:19 devstack sudo[109960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:13:19 devstack sudo[109960]: pam_unix(sudo:session): session closed for user root Jun 24 05:13:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a2d8c61d-8daf-4ffc-922e-dbd807313545 tempest-VolumesTransfersTest-309299522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-735e7f53-0981-4e97-9962-75a2163073d2" returned: 0 in 0.711s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:13:19 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a2d8c61d-8daf-4ffc-922e-dbd807313545 tempest-VolumesTransfersTest-309299522 None] <== create_volume: return (1707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:13:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a2d8c61d-8daf-4ffc-922e-dbd807313545 tempest-VolumesTransfersTest-309299522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:13:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a2d8c61d-8daf-4ffc-922e-dbd807313545 tempest-VolumesTransfersTest-309299522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfb80441-cc3a-4316-b572-7a3796b6a74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-735e7f53-0981-4e97-9962-75a2163073d2', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:13:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a2d8c61d-8daf-4ffc-922e-dbd807313545 tempest-VolumesTransfersTest-309299522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eae75f28-7188-4589-9ad5-476a75550ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:13:19 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-a2d8c61d-8daf-4ffc-922e-dbd807313545 tempest-VolumesTransfersTest-309299522 None] Volume volume-735e7f53-0981-4e97-9962-75a2163073d2 (735e7f53-0981-4e97-9962-75a2163073d2): created successfully Jun 24 05:13:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a2d8c61d-8daf-4ffc-922e-dbd807313545 tempest-VolumesTransfersTest-309299522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eae75f28-7188-4589-9ad5-476a75550ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:13:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a2d8c61d-8daf-4ffc-922e-dbd807313545 tempest-VolumesTransfersTest-309299522 None] Flow 'volume_create_manager' (ed7d341f-a0ff-407b-9687-e9d6eef48f96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:13:19 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-a2d8c61d-8daf-4ffc-922e-dbd807313545 tempest-VolumesTransfersTest-309299522 None] Created volume successfully. Jun 24 05:13:20 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-aa9e3af8-1e34-46f5-ad0b-67dd1bc9c029 tempest-VolumesTransfersTest-1656881475 None] Transfer volume completed successfully. Jun 24 05:13:21 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-2a7da578-bff6-4300-9e44-50380eaef39e tempest-VolumesTransfersTest-1341064757 None] Acquiring lock "cinder-735e7f53-0981-4e97-9962-75a2163073d2-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:13:21 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-2a7da578-bff6-4300-9e44-50380eaef39e tempest-VolumesTransfersTest-1341064757 None] Lock "cinder-735e7f53-0981-4e97-9962-75a2163073d2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:13:21 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-2a7da578-bff6-4300-9e44-50380eaef39e tempest-VolumesTransfersTest-1341064757 None] Acquiring lock "cinder-quobyte-735e7f53-0981-4e97-9962-75a2163073d2" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:13:21 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-2a7da578-bff6-4300-9e44-50380eaef39e tempest-VolumesTransfersTest-1341064757 None] Lock "cinder-quobyte-735e7f53-0981-4e97-9962-75a2163073d2" acquired by "delete_volume" :: waited 0.014s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:13:21 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce799d1-d31c-457c-a5ad-bae2faebc931]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:13:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2a7da578-bff6-4300-9e44-50380eaef39e tempest-VolumesTransfersTest-1341064757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-735e7f53-0981-4e97-9962-75a2163073d2 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:13:21 devstack sudo[109965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-735e7f53-0981-4e97-9962-75a2163073d2 Jun 24 05:13:21 devstack sudo[109965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:13:22 devstack sudo[109965]: pam_unix(sudo:session): session closed for user root Jun 24 05:13:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2a7da578-bff6-4300-9e44-50380eaef39e tempest-VolumesTransfersTest-1341064757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-735e7f53-0981-4e97-9962-75a2163073d2" returned: 0 in 0.869s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:13:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2a7da578-bff6-4300-9e44-50380eaef39e tempest-VolumesTransfersTest-1341064757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-735e7f53-0981-4e97-9962-75a2163073d2 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:13:22 devstack sudo[109972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-735e7f53-0981-4e97-9962-75a2163073d2 Jun 24 05:13:22 devstack sudo[109972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:13:23 devstack sudo[109972]: pam_unix(sudo:session): session closed for user root Jun 24 05:13:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2a7da578-bff6-4300-9e44-50380eaef39e tempest-VolumesTransfersTest-1341064757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-735e7f53-0981-4e97-9962-75a2163073d2" returned: 0 in 0.656s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:13:23 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-2a7da578-bff6-4300-9e44-50380eaef39e tempest-VolumesTransfersTest-1341064757 None] Lock "cinder-quobyte-735e7f53-0981-4e97-9962-75a2163073d2" released by "delete_volume" :: held 1.572s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:13:23 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-2a7da578-bff6-4300-9e44-50380eaef39e tempest-VolumesTransfersTest-1341064757 None] Created reservations ['b29eaacd-19af-4dcf-8832-15c0612cd06d', 'f7083f61-cfdb-4929-a84b-6e79d6982bec', 'f8e0b02a-0b55-4180-8301-9944794dcc4d', '694495e3-2f42-4e04-8c31-dccd3da02ba4'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:13:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-2a7da578-bff6-4300-9e44-50380eaef39e tempest-VolumesTransfersTest-1341064757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:13:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-2a7da578-bff6-4300-9e44-50380eaef39e tempest-VolumesTransfersTest-1341064757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:13:23 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-2a7da578-bff6-4300-9e44-50380eaef39e tempest-VolumesTransfersTest-1341064757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:13:23 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-2a7da578-bff6-4300-9e44-50380eaef39e tempest-VolumesTransfersTest-1341064757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:13:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-2a7da578-bff6-4300-9e44-50380eaef39e tempest-VolumesTransfersTest-1341064757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:13:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2a7da578-bff6-4300-9e44-50380eaef39e tempest-VolumesTransfersTest-1341064757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:13:23 devstack sudo[109975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:13:23 devstack sudo[109975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:13:24 devstack sudo[109975]: pam_unix(sudo:session): session closed for user root Jun 24 05:13:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2a7da578-bff6-4300-9e44-50380eaef39e tempest-VolumesTransfersTest-1341064757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.654s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:13:24 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-2a7da578-bff6-4300-9e44-50380eaef39e tempest-VolumesTransfersTest-1341064757 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:13:24 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-2a7da578-bff6-4300-9e44-50380eaef39e tempest-VolumesTransfersTest-1341064757 None] Deleted volume successfully. Jun 24 05:13:24 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-2a7da578-bff6-4300-9e44-50380eaef39e tempest-VolumesTransfersTest-1341064757 None] Lock "cinder-735e7f53-0981-4e97-9962-75a2163073d2-delete_volume" released by "delete_volume" :: held 2.442s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:13:24 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d189ef1-f19b-4987-b4a1-9c648fcb4739 tempest-VolumesTransfersTest-309299522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:13:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9d189ef1-f19b-4987-b4a1-9c648fcb4739 tempest-VolumesTransfersTest-309299522 None] Flow 'volume_create_manager' (ce45b016-4510-4f15-bae5-a92946c754dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:13:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9d189ef1-f19b-4987-b4a1-9c648fcb4739 tempest-VolumesTransfersTest-309299522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fffd3483-79ac-4c97-a6be-04be67db3ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:13:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9d189ef1-f19b-4987-b4a1-9c648fcb4739 tempest-VolumesTransfersTest-309299522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fffd3483-79ac-4c97-a6be-04be67db3ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:13:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1233660520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=254d50ab-ccfa-43d1-ab47-0cb5381e2516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50245cb75a1b4fe5b3f80c53d1f023bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:13:24Z,use_quota=True,user_id='9a78723dae9648bd93d54cc4cf2794a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:13:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9d189ef1-f19b-4987-b4a1-9c648fcb4739 tempest-VolumesTransfersTest-309299522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95087586-c5fb-49c6-8102-556286320f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:13:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9d189ef1-f19b-4987-b4a1-9c648fcb4739 tempest-VolumesTransfersTest-309299522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95087586-c5fb-49c6-8102-556286320f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:13:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9d189ef1-f19b-4987-b4a1-9c648fcb4739 tempest-VolumesTransfersTest-309299522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fd5aa12-59d6-4234-8483-79cc99c9e982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:13:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9d189ef1-f19b-4987-b4a1-9c648fcb4739 tempest-VolumesTransfersTest-309299522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fd5aa12-59d6-4234-8483-79cc99c9e982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '254d50ab-ccfa-43d1-ab47-0cb5381e2516', 'volume_name': 'volume-254d50ab-ccfa-43d1-ab47-0cb5381e2516', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:13:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9d189ef1-f19b-4987-b4a1-9c648fcb4739 tempest-VolumesTransfersTest-309299522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4a0a553-9fac-434a-8eb8-070bd8658785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:13:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9d189ef1-f19b-4987-b4a1-9c648fcb4739 tempest-VolumesTransfersTest-309299522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4a0a553-9fac-434a-8eb8-070bd8658785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:13:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9d189ef1-f19b-4987-b4a1-9c648fcb4739 tempest-VolumesTransfersTest-309299522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f54824f-f5e9-41be-bc26-2eef4b7e0628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:13:24 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-9d189ef1-f19b-4987-b4a1-9c648fcb4739 tempest-VolumesTransfersTest-309299522 None] Volume 254d50ab-ccfa-43d1-ab47-0cb5381e2516: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-254d50ab-ccfa-43d1-ab47-0cb5381e2516', 'volume_size': 1} Jun 24 05:13:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9d189ef1-f19b-4987-b4a1-9c648fcb4739 tempest-VolumesTransfersTest-309299522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:13:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9d189ef1-f19b-4987-b4a1-9c648fcb4739 tempest-VolumesTransfersTest-309299522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:13:24 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-9d189ef1-f19b-4987-b4a1-9c648fcb4739 tempest-VolumesTransfersTest-309299522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:13:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1233660520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=254d50ab-ccfa-43d1-ab47-0cb5381e2516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50245cb75a1b4fe5b3f80c53d1f023bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:13:24Z,use_quota=True,user_id='9a78723dae9648bd93d54cc4cf2794a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:13:24 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-9d189ef1-f19b-4987-b4a1-9c648fcb4739 tempest-VolumesTransfersTest-309299522 None] Creating volume 254d50ab-ccfa-43d1-ab47-0cb5381e2516 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:13:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9d189ef1-f19b-4987-b4a1-9c648fcb4739 tempest-VolumesTransfersTest-309299522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:13:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9d189ef1-f19b-4987-b4a1-9c648fcb4739 tempest-VolumesTransfersTest-309299522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:13:24 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-9d189ef1-f19b-4987-b4a1-9c648fcb4739 tempest-VolumesTransfersTest-309299522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:13:24 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-9d189ef1-f19b-4987-b4a1-9c648fcb4739 tempest-VolumesTransfersTest-309299522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:13:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9d189ef1-f19b-4987-b4a1-9c648fcb4739 tempest-VolumesTransfersTest-309299522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:13:24 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-9d189ef1-f19b-4987-b4a1-9c648fcb4739 tempest-VolumesTransfersTest-309299522 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:13:24 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-9d189ef1-f19b-4987-b4a1-9c648fcb4739 tempest-VolumesTransfersTest-309299522 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:13:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9d189ef1-f19b-4987-b4a1-9c648fcb4739 tempest-VolumesTransfersTest-309299522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-254d50ab-ccfa-43d1-ab47-0cb5381e2516 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:13:24 devstack sudo[109978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-254d50ab-ccfa-43d1-ab47-0cb5381e2516 1073741824 Jun 24 05:13:24 devstack sudo[109978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:13:25 devstack sudo[109978]: pam_unix(sudo:session): session closed for user root Jun 24 05:13:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9d189ef1-f19b-4987-b4a1-9c648fcb4739 tempest-VolumesTransfersTest-309299522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-254d50ab-ccfa-43d1-ab47-0cb5381e2516 1073741824" returned: 0 in 0.917s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:13:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9d189ef1-f19b-4987-b4a1-9c648fcb4739 tempest-VolumesTransfersTest-309299522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-254d50ab-ccfa-43d1-ab47-0cb5381e2516 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:13:25 devstack sudo[109989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-254d50ab-ccfa-43d1-ab47-0cb5381e2516 Jun 24 05:13:25 devstack sudo[109989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:13:26 devstack sudo[109989]: pam_unix(sudo:session): session closed for user root Jun 24 05:13:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9d189ef1-f19b-4987-b4a1-9c648fcb4739 tempest-VolumesTransfersTest-309299522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-254d50ab-ccfa-43d1-ab47-0cb5381e2516" returned: 0 in 0.643s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:13:26 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-9d189ef1-f19b-4987-b4a1-9c648fcb4739 tempest-VolumesTransfersTest-309299522 None] <== create_volume: return (1600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:13:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9d189ef1-f19b-4987-b4a1-9c648fcb4739 tempest-VolumesTransfersTest-309299522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:13:26 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9d189ef1-f19b-4987-b4a1-9c648fcb4739 tempest-VolumesTransfersTest-309299522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f54824f-f5e9-41be-bc26-2eef4b7e0628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-254d50ab-ccfa-43d1-ab47-0cb5381e2516', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:13:26 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9d189ef1-f19b-4987-b4a1-9c648fcb4739 tempest-VolumesTransfersTest-309299522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (338896bf-3698-4185-8283-11b2cd0f8368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:13:26 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-9d189ef1-f19b-4987-b4a1-9c648fcb4739 tempest-VolumesTransfersTest-309299522 None] Volume volume-254d50ab-ccfa-43d1-ab47-0cb5381e2516 (254d50ab-ccfa-43d1-ab47-0cb5381e2516): created successfully Jun 24 05:13:26 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9d189ef1-f19b-4987-b4a1-9c648fcb4739 tempest-VolumesTransfersTest-309299522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (338896bf-3698-4185-8283-11b2cd0f8368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:13:26 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-9d189ef1-f19b-4987-b4a1-9c648fcb4739 tempest-VolumesTransfersTest-309299522 None] Flow 'volume_create_manager' (ce45b016-4510-4f15-bae5-a92946c754dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:13:26 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-9d189ef1-f19b-4987-b4a1-9c648fcb4739 tempest-VolumesTransfersTest-309299522 None] Created volume successfully. Jun 24 05:13:26 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-0e2176ae-f14d-402e-b2c7-06f4b0af4357 tempest-VolumesTransfersTest-1341064757 None] Acquiring lock "cinder-254d50ab-ccfa-43d1-ab47-0cb5381e2516-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:13:26 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-0e2176ae-f14d-402e-b2c7-06f4b0af4357 tempest-VolumesTransfersTest-1341064757 None] Lock "cinder-254d50ab-ccfa-43d1-ab47-0cb5381e2516-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:13:26 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:SELECT=58,cinder:UPDATE=75,cinder:INSERT=17,cinder:DELETE=3 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:13:26 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-0e2176ae-f14d-402e-b2c7-06f4b0af4357 tempest-VolumesTransfersTest-1341064757 None] Acquiring lock "cinder-quobyte-254d50ab-ccfa-43d1-ab47-0cb5381e2516" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:13:26 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-0e2176ae-f14d-402e-b2c7-06f4b0af4357 tempest-VolumesTransfersTest-1341064757 None] Lock "cinder-quobyte-254d50ab-ccfa-43d1-ab47-0cb5381e2516" acquired by "delete_volume" :: waited 0.021s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:13:26 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[600caf16-fa88-41c9-a593-3abbd1014583]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:13:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0e2176ae-f14d-402e-b2c7-06f4b0af4357 tempest-VolumesTransfersTest-1341064757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-254d50ab-ccfa-43d1-ab47-0cb5381e2516 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:13:27 devstack sudo[109992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-254d50ab-ccfa-43d1-ab47-0cb5381e2516 Jun 24 05:13:27 devstack sudo[109992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:13:27 devstack sudo[109992]: pam_unix(sudo:session): session closed for user root Jun 24 05:13:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0e2176ae-f14d-402e-b2c7-06f4b0af4357 tempest-VolumesTransfersTest-1341064757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-254d50ab-ccfa-43d1-ab47-0cb5381e2516" returned: 0 in 0.780s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:13:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0e2176ae-f14d-402e-b2c7-06f4b0af4357 tempest-VolumesTransfersTest-1341064757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-254d50ab-ccfa-43d1-ab47-0cb5381e2516 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:13:27 devstack sudo[109997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-254d50ab-ccfa-43d1-ab47-0cb5381e2516 Jun 24 05:13:27 devstack sudo[109997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:13:28 devstack sudo[109997]: pam_unix(sudo:session): session closed for user root Jun 24 05:13:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0e2176ae-f14d-402e-b2c7-06f4b0af4357 tempest-VolumesTransfersTest-1341064757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-254d50ab-ccfa-43d1-ab47-0cb5381e2516" returned: 0 in 0.665s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:13:28 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-0e2176ae-f14d-402e-b2c7-06f4b0af4357 tempest-VolumesTransfersTest-1341064757 None] Lock "cinder-quobyte-254d50ab-ccfa-43d1-ab47-0cb5381e2516" released by "delete_volume" :: held 1.498s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:13:28 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:SELECT=60,cinder:UPDATE=67,cinder:DELETE=8,cinder:INSERT=19 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:13:28 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-0e2176ae-f14d-402e-b2c7-06f4b0af4357 tempest-VolumesTransfersTest-1341064757 None] Created reservations ['6b3a15fb-529e-4ed9-97f2-42d70be4be92', 'c110486c-5490-4db2-95ca-e6f92a09291a', '9927021e-f273-421a-9be1-c92a7c466e41', 'a2039978-0992-4619-8580-5dea2d08ab41'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:13:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-0e2176ae-f14d-402e-b2c7-06f4b0af4357 tempest-VolumesTransfersTest-1341064757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:13:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-0e2176ae-f14d-402e-b2c7-06f4b0af4357 tempest-VolumesTransfersTest-1341064757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:13:28 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-0e2176ae-f14d-402e-b2c7-06f4b0af4357 tempest-VolumesTransfersTest-1341064757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:13:28 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-0e2176ae-f14d-402e-b2c7-06f4b0af4357 tempest-VolumesTransfersTest-1341064757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:13:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-0e2176ae-f14d-402e-b2c7-06f4b0af4357 tempest-VolumesTransfersTest-1341064757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:13:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0e2176ae-f14d-402e-b2c7-06f4b0af4357 tempest-VolumesTransfersTest-1341064757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:13:28 devstack sudo[110000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:13:28 devstack sudo[110000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:13:29 devstack sudo[110000]: pam_unix(sudo:session): session closed for user root Jun 24 05:13:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0e2176ae-f14d-402e-b2c7-06f4b0af4357 tempest-VolumesTransfersTest-1341064757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.684s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:13:29 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-0e2176ae-f14d-402e-b2c7-06f4b0af4357 tempest-VolumesTransfersTest-1341064757 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:13:29 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-0e2176ae-f14d-402e-b2c7-06f4b0af4357 tempest-VolumesTransfersTest-1341064757 None] Deleted volume successfully. Jun 24 05:13:29 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-0e2176ae-f14d-402e-b2c7-06f4b0af4357 tempest-VolumesTransfersTest-1341064757 None] Lock "cinder-254d50ab-ccfa-43d1-ab47-0cb5381e2516-delete_volume" released by "delete_volume" :: held 2.427s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:13:36 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5cc0402-278b-4e81-b3de-7c961a55d410 tempest-VolumesTransfersV357Test-2004845293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:13:36 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-c5cc0402-278b-4e81-b3de-7c961a55d410 tempest-VolumesTransfersV357Test-2004845293 None] Flow 'volume_create_manager' (47d4bb03-70de-4258-b40d-625e152d2907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:13:36 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-c5cc0402-278b-4e81-b3de-7c961a55d410 tempest-VolumesTransfersV357Test-2004845293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aba488e-89ba-4e87-b849-3b145146daf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:13:36 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-c5cc0402-278b-4e81-b3de-7c961a55d410 tempest-VolumesTransfersV357Test-2004845293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aba488e-89ba-4e87-b849-3b145146daf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-550619467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ff68ad3-ef20-4408-aeec-9ab0081ffeef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e8f7fae696544579c7f201d2d922ebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:13:36Z,use_quota=True,user_id='69287af97a2f49d8889a1d85bcdb51e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:13:36 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-c5cc0402-278b-4e81-b3de-7c961a55d410 tempest-VolumesTransfersV357Test-2004845293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e494771-650f-4f10-8ebf-5d380146e17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:13:36 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-c5cc0402-278b-4e81-b3de-7c961a55d410 tempest-VolumesTransfersV357Test-2004845293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e494771-650f-4f10-8ebf-5d380146e17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:13:36 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-c5cc0402-278b-4e81-b3de-7c961a55d410 tempest-VolumesTransfersV357Test-2004845293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (629ef9fd-8b30-41b9-8f2e-8f466aca29b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:13:36 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-c5cc0402-278b-4e81-b3de-7c961a55d410 tempest-VolumesTransfersV357Test-2004845293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (629ef9fd-8b30-41b9-8f2e-8f466aca29b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ff68ad3-ef20-4408-aeec-9ab0081ffeef', 'volume_name': 'volume-7ff68ad3-ef20-4408-aeec-9ab0081ffeef', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:13:36 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-c5cc0402-278b-4e81-b3de-7c961a55d410 tempest-VolumesTransfersV357Test-2004845293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05acc2d6-2abb-494f-8043-02c5a49338b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:13:36 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-c5cc0402-278b-4e81-b3de-7c961a55d410 tempest-VolumesTransfersV357Test-2004845293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05acc2d6-2abb-494f-8043-02c5a49338b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:13:36 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-c5cc0402-278b-4e81-b3de-7c961a55d410 tempest-VolumesTransfersV357Test-2004845293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc08d891-2733-4f6b-be9d-beb7c2229b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:13:36 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-c5cc0402-278b-4e81-b3de-7c961a55d410 tempest-VolumesTransfersV357Test-2004845293 None] Volume 7ff68ad3-ef20-4408-aeec-9ab0081ffeef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ff68ad3-ef20-4408-aeec-9ab0081ffeef', 'volume_size': 1} Jun 24 05:13:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-c5cc0402-278b-4e81-b3de-7c961a55d410 tempest-VolumesTransfersV357Test-2004845293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:13:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-c5cc0402-278b-4e81-b3de-7c961a55d410 tempest-VolumesTransfersV357Test-2004845293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:13:36 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-c5cc0402-278b-4e81-b3de-7c961a55d410 tempest-VolumesTransfersV357Test-2004845293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-550619467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ff68ad3-ef20-4408-aeec-9ab0081ffeef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e8f7fae696544579c7f201d2d922ebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:13:36Z,use_quota=True,user_id='69287af97a2f49d8889a1d85bcdb51e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:13:36 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-c5cc0402-278b-4e81-b3de-7c961a55d410 tempest-VolumesTransfersV357Test-2004845293 None] Creating volume 7ff68ad3-ef20-4408-aeec-9ab0081ffeef {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:13:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-c5cc0402-278b-4e81-b3de-7c961a55d410 tempest-VolumesTransfersV357Test-2004845293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:13:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-c5cc0402-278b-4e81-b3de-7c961a55d410 tempest-VolumesTransfersV357Test-2004845293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:13:36 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-c5cc0402-278b-4e81-b3de-7c961a55d410 tempest-VolumesTransfersV357Test-2004845293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:13:36 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-c5cc0402-278b-4e81-b3de-7c961a55d410 tempest-VolumesTransfersV357Test-2004845293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:13:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-c5cc0402-278b-4e81-b3de-7c961a55d410 tempest-VolumesTransfersV357Test-2004845293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:13:36 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-c5cc0402-278b-4e81-b3de-7c961a55d410 tempest-VolumesTransfersV357Test-2004845293 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:13:36 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-c5cc0402-278b-4e81-b3de-7c961a55d410 tempest-VolumesTransfersV357Test-2004845293 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:13:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c5cc0402-278b-4e81-b3de-7c961a55d410 tempest-VolumesTransfersV357Test-2004845293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7ff68ad3-ef20-4408-aeec-9ab0081ffeef 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:13:36 devstack sudo[110062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7ff68ad3-ef20-4408-aeec-9ab0081ffeef 1073741824 Jun 24 05:13:36 devstack sudo[110062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:13:37 devstack sudo[110062]: pam_unix(sudo:session): session closed for user root Jun 24 05:13:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c5cc0402-278b-4e81-b3de-7c961a55d410 tempest-VolumesTransfersV357Test-2004845293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7ff68ad3-ef20-4408-aeec-9ab0081ffeef 1073741824" returned: 0 in 0.920s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:13:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c5cc0402-278b-4e81-b3de-7c961a55d410 tempest-VolumesTransfersV357Test-2004845293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7ff68ad3-ef20-4408-aeec-9ab0081ffeef {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:13:37 devstack sudo[110101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7ff68ad3-ef20-4408-aeec-9ab0081ffeef Jun 24 05:13:37 devstack sudo[110101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:13:38 devstack sudo[110101]: pam_unix(sudo:session): session closed for user root Jun 24 05:13:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c5cc0402-278b-4e81-b3de-7c961a55d410 tempest-VolumesTransfersV357Test-2004845293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7ff68ad3-ef20-4408-aeec-9ab0081ffeef" returned: 0 in 0.906s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:13:38 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-c5cc0402-278b-4e81-b3de-7c961a55d410 tempest-VolumesTransfersV357Test-2004845293 None] <== create_volume: return (1874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:13:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-c5cc0402-278b-4e81-b3de-7c961a55d410 tempest-VolumesTransfersV357Test-2004845293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.877s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:13:38 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-c5cc0402-278b-4e81-b3de-7c961a55d410 tempest-VolumesTransfersV357Test-2004845293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc08d891-2733-4f6b-be9d-beb7c2229b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ff68ad3-ef20-4408-aeec-9ab0081ffeef', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:13:38 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-c5cc0402-278b-4e81-b3de-7c961a55d410 tempest-VolumesTransfersV357Test-2004845293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ed22c72-94ab-4884-b031-4b2069f83033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:13:38 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-c5cc0402-278b-4e81-b3de-7c961a55d410 tempest-VolumesTransfersV357Test-2004845293 None] Volume volume-7ff68ad3-ef20-4408-aeec-9ab0081ffeef (7ff68ad3-ef20-4408-aeec-9ab0081ffeef): created successfully Jun 24 05:13:38 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-c5cc0402-278b-4e81-b3de-7c961a55d410 tempest-VolumesTransfersV357Test-2004845293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ed22c72-94ab-4884-b031-4b2069f83033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:13:38 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-c5cc0402-278b-4e81-b3de-7c961a55d410 tempest-VolumesTransfersV357Test-2004845293 None] Flow 'volume_create_manager' (47d4bb03-70de-4258-b40d-625e152d2907) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:13:38 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-c5cc0402-278b-4e81-b3de-7c961a55d410 tempest-VolumesTransfersV357Test-2004845293 None] Created volume successfully. Jun 24 05:13:39 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-8d2fb1c0-0787-4192-a0e2-ade228d624d7 tempest-VolumesTransfersV357Test-1980737809 None] Transfer volume completed successfully. Jun 24 05:13:40 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-effb8ab5-8b6b-4bbe-bf8d-fe2229d9fee7 tempest-VolumesTransfersV357Test-849163320 None] Acquiring lock "cinder-7ff68ad3-ef20-4408-aeec-9ab0081ffeef-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:13:40 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-effb8ab5-8b6b-4bbe-bf8d-fe2229d9fee7 tempest-VolumesTransfersV357Test-849163320 None] Lock "cinder-7ff68ad3-ef20-4408-aeec-9ab0081ffeef-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:13:40 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-effb8ab5-8b6b-4bbe-bf8d-fe2229d9fee7 tempest-VolumesTransfersV357Test-849163320 None] Acquiring lock "cinder-quobyte-7ff68ad3-ef20-4408-aeec-9ab0081ffeef" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:13:40 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-effb8ab5-8b6b-4bbe-bf8d-fe2229d9fee7 tempest-VolumesTransfersV357Test-849163320 None] Lock "cinder-quobyte-7ff68ad3-ef20-4408-aeec-9ab0081ffeef" acquired by "delete_volume" :: waited 0.027s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:13:40 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a00083-edba-4c6d-b3dd-673ec1a01b29]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:13:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-effb8ab5-8b6b-4bbe-bf8d-fe2229d9fee7 tempest-VolumesTransfersV357Test-849163320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7ff68ad3-ef20-4408-aeec-9ab0081ffeef {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:13:40 devstack sudo[110154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7ff68ad3-ef20-4408-aeec-9ab0081ffeef Jun 24 05:13:40 devstack sudo[110154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:13:41 devstack sudo[110154]: pam_unix(sudo:session): session closed for user root Jun 24 05:13:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-effb8ab5-8b6b-4bbe-bf8d-fe2229d9fee7 tempest-VolumesTransfersV357Test-849163320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7ff68ad3-ef20-4408-aeec-9ab0081ffeef" returned: 0 in 0.878s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:13:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-effb8ab5-8b6b-4bbe-bf8d-fe2229d9fee7 tempest-VolumesTransfersV357Test-849163320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7ff68ad3-ef20-4408-aeec-9ab0081ffeef {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:13:41 devstack sudo[110160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7ff68ad3-ef20-4408-aeec-9ab0081ffeef Jun 24 05:13:41 devstack sudo[110160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:13:42 devstack sudo[110160]: pam_unix(sudo:session): session closed for user root Jun 24 05:13:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-effb8ab5-8b6b-4bbe-bf8d-fe2229d9fee7 tempest-VolumesTransfersV357Test-849163320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7ff68ad3-ef20-4408-aeec-9ab0081ffeef" returned: 0 in 0.778s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:13:42 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-effb8ab5-8b6b-4bbe-bf8d-fe2229d9fee7 tempest-VolumesTransfersV357Test-849163320 None] Lock "cinder-quobyte-7ff68ad3-ef20-4408-aeec-9ab0081ffeef" released by "delete_volume" :: held 1.743s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:13:42 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-effb8ab5-8b6b-4bbe-bf8d-fe2229d9fee7 tempest-VolumesTransfersV357Test-849163320 None] Created reservations ['f38ee968-1435-4e29-aedc-e0f6637063c6', '502bf4b4-6343-4591-8de1-0791a22fd2c0', 'a6491cd8-f398-4251-bbd5-a4d73696ef1f', '8bdf9ff6-9fd2-4257-bb42-85fb831db3b3'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:13:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-effb8ab5-8b6b-4bbe-bf8d-fe2229d9fee7 tempest-VolumesTransfersV357Test-849163320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:13:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-effb8ab5-8b6b-4bbe-bf8d-fe2229d9fee7 tempest-VolumesTransfersV357Test-849163320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:13:42 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-effb8ab5-8b6b-4bbe-bf8d-fe2229d9fee7 tempest-VolumesTransfersV357Test-849163320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:13:42 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-effb8ab5-8b6b-4bbe-bf8d-fe2229d9fee7 tempest-VolumesTransfersV357Test-849163320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:13:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-effb8ab5-8b6b-4bbe-bf8d-fe2229d9fee7 tempest-VolumesTransfersV357Test-849163320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:13:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-effb8ab5-8b6b-4bbe-bf8d-fe2229d9fee7 tempest-VolumesTransfersV357Test-849163320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:13:42 devstack sudo[110165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:13:42 devstack sudo[110165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:13:42 devstack sudo[110165]: pam_unix(sudo:session): session closed for user root Jun 24 05:13:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-effb8ab5-8b6b-4bbe-bf8d-fe2229d9fee7 tempest-VolumesTransfersV357Test-849163320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.741s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:13:42 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-effb8ab5-8b6b-4bbe-bf8d-fe2229d9fee7 tempest-VolumesTransfersV357Test-849163320 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:13:42 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-effb8ab5-8b6b-4bbe-bf8d-fe2229d9fee7 tempest-VolumesTransfersV357Test-849163320 None] Deleted volume successfully. Jun 24 05:13:42 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-effb8ab5-8b6b-4bbe-bf8d-fe2229d9fee7 tempest-VolumesTransfersV357Test-849163320 None] Lock "cinder-7ff68ad3-ef20-4408-aeec-9ab0081ffeef-delete_volume" released by "delete_volume" :: held 2.743s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:13:43 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-249afe64-ca5f-40f1-9bd5-a8dffa39d310 tempest-VolumesTransfersV357Test-2004845293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:13:43 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-249afe64-ca5f-40f1-9bd5-a8dffa39d310 tempest-VolumesTransfersV357Test-2004845293 None] Flow 'volume_create_manager' (f81d9b47-29cc-4b2b-bbe1-70791461b103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:13:43 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-249afe64-ca5f-40f1-9bd5-a8dffa39d310 tempest-VolumesTransfersV357Test-2004845293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65ec368d-fff2-4c49-bdc4-db242ef5744f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:13:43 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-249afe64-ca5f-40f1-9bd5-a8dffa39d310 tempest-VolumesTransfersV357Test-2004845293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65ec368d-fff2-4c49-bdc4-db242ef5744f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:13:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-885502459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=677b9076-3c7c-45f5-a245-b549ee22a796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e8f7fae696544579c7f201d2d922ebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:13:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:13:43Z,use_quota=True,user_id='69287af97a2f49d8889a1d85bcdb51e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:13:43 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-249afe64-ca5f-40f1-9bd5-a8dffa39d310 tempest-VolumesTransfersV357Test-2004845293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e0a438d-8413-4e83-9cdb-311e29aebc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:13:43 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-249afe64-ca5f-40f1-9bd5-a8dffa39d310 tempest-VolumesTransfersV357Test-2004845293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e0a438d-8413-4e83-9cdb-311e29aebc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:13:43 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-249afe64-ca5f-40f1-9bd5-a8dffa39d310 tempest-VolumesTransfersV357Test-2004845293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (180e2723-3d45-4cf5-aed7-fa7164cc2adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:13:43 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-249afe64-ca5f-40f1-9bd5-a8dffa39d310 tempest-VolumesTransfersV357Test-2004845293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (180e2723-3d45-4cf5-aed7-fa7164cc2adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '677b9076-3c7c-45f5-a245-b549ee22a796', 'volume_name': 'volume-677b9076-3c7c-45f5-a245-b549ee22a796', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:13:43 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-249afe64-ca5f-40f1-9bd5-a8dffa39d310 tempest-VolumesTransfersV357Test-2004845293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64961909-586f-4087-8153-3b680f3b0669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:13:43 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-249afe64-ca5f-40f1-9bd5-a8dffa39d310 tempest-VolumesTransfersV357Test-2004845293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64961909-586f-4087-8153-3b680f3b0669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:13:43 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-249afe64-ca5f-40f1-9bd5-a8dffa39d310 tempest-VolumesTransfersV357Test-2004845293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57e273b7-1794-4a36-acb6-67e90c8021db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:13:43 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-249afe64-ca5f-40f1-9bd5-a8dffa39d310 tempest-VolumesTransfersV357Test-2004845293 None] Volume 677b9076-3c7c-45f5-a245-b549ee22a796: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-677b9076-3c7c-45f5-a245-b549ee22a796', 'volume_size': 1} Jun 24 05:13:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-249afe64-ca5f-40f1-9bd5-a8dffa39d310 tempest-VolumesTransfersV357Test-2004845293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:13:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-249afe64-ca5f-40f1-9bd5-a8dffa39d310 tempest-VolumesTransfersV357Test-2004845293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:13:43 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-249afe64-ca5f-40f1-9bd5-a8dffa39d310 tempest-VolumesTransfersV357Test-2004845293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:13:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-885502459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=677b9076-3c7c-45f5-a245-b549ee22a796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e8f7fae696544579c7f201d2d922ebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:13:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:13:43Z,use_quota=True,user_id='69287af97a2f49d8889a1d85bcdb51e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:13:43 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-249afe64-ca5f-40f1-9bd5-a8dffa39d310 tempest-VolumesTransfersV357Test-2004845293 None] Creating volume 677b9076-3c7c-45f5-a245-b549ee22a796 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:13:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-249afe64-ca5f-40f1-9bd5-a8dffa39d310 tempest-VolumesTransfersV357Test-2004845293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:13:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-249afe64-ca5f-40f1-9bd5-a8dffa39d310 tempest-VolumesTransfersV357Test-2004845293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:13:43 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-249afe64-ca5f-40f1-9bd5-a8dffa39d310 tempest-VolumesTransfersV357Test-2004845293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:13:43 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-249afe64-ca5f-40f1-9bd5-a8dffa39d310 tempest-VolumesTransfersV357Test-2004845293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:13:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-249afe64-ca5f-40f1-9bd5-a8dffa39d310 tempest-VolumesTransfersV357Test-2004845293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:13:43 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-249afe64-ca5f-40f1-9bd5-a8dffa39d310 tempest-VolumesTransfersV357Test-2004845293 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:13:43 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-249afe64-ca5f-40f1-9bd5-a8dffa39d310 tempest-VolumesTransfersV357Test-2004845293 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:13:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-249afe64-ca5f-40f1-9bd5-a8dffa39d310 tempest-VolumesTransfersV357Test-2004845293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-677b9076-3c7c-45f5-a245-b549ee22a796 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:13:43 devstack sudo[110168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-677b9076-3c7c-45f5-a245-b549ee22a796 1073741824 Jun 24 05:13:43 devstack sudo[110168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:13:44 devstack sudo[110168]: pam_unix(sudo:session): session closed for user root Jun 24 05:13:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-249afe64-ca5f-40f1-9bd5-a8dffa39d310 tempest-VolumesTransfersV357Test-2004845293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-677b9076-3c7c-45f5-a245-b549ee22a796 1073741824" returned: 0 in 0.841s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:13:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-249afe64-ca5f-40f1-9bd5-a8dffa39d310 tempest-VolumesTransfersV357Test-2004845293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-677b9076-3c7c-45f5-a245-b549ee22a796 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:13:44 devstack sudo[110173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-677b9076-3c7c-45f5-a245-b549ee22a796 Jun 24 05:13:44 devstack sudo[110173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:13:44 devstack sudo[110173]: pam_unix(sudo:session): session closed for user root Jun 24 05:13:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-249afe64-ca5f-40f1-9bd5-a8dffa39d310 tempest-VolumesTransfersV357Test-2004845293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-677b9076-3c7c-45f5-a245-b549ee22a796" returned: 0 in 0.660s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:13:44 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-249afe64-ca5f-40f1-9bd5-a8dffa39d310 tempest-VolumesTransfersV357Test-2004845293 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:13:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-249afe64-ca5f-40f1-9bd5-a8dffa39d310 tempest-VolumesTransfersV357Test-2004845293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:13:44 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-249afe64-ca5f-40f1-9bd5-a8dffa39d310 tempest-VolumesTransfersV357Test-2004845293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57e273b7-1794-4a36-acb6-67e90c8021db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-677b9076-3c7c-45f5-a245-b549ee22a796', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:13:44 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-249afe64-ca5f-40f1-9bd5-a8dffa39d310 tempest-VolumesTransfersV357Test-2004845293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c3e175f-296c-4386-b8fc-f79e932a6763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:13:44 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-249afe64-ca5f-40f1-9bd5-a8dffa39d310 tempest-VolumesTransfersV357Test-2004845293 None] Volume volume-677b9076-3c7c-45f5-a245-b549ee22a796 (677b9076-3c7c-45f5-a245-b549ee22a796): created successfully Jun 24 05:13:44 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-249afe64-ca5f-40f1-9bd5-a8dffa39d310 tempest-VolumesTransfersV357Test-2004845293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c3e175f-296c-4386-b8fc-f79e932a6763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:13:44 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-249afe64-ca5f-40f1-9bd5-a8dffa39d310 tempest-VolumesTransfersV357Test-2004845293 None] Flow 'volume_create_manager' (f81d9b47-29cc-4b2b-bbe1-70791461b103) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:13:44 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-249afe64-ca5f-40f1-9bd5-a8dffa39d310 tempest-VolumesTransfersV357Test-2004845293 None] Created volume successfully. Jun 24 05:13:45 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-45b836da-70a4-4ee6-a591-f4d9db10d6c0 tempest-VolumesTransfersV357Test-849163320 None] Acquiring lock "cinder-677b9076-3c7c-45f5-a245-b549ee22a796-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:13:45 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-45b836da-70a4-4ee6-a591-f4d9db10d6c0 tempest-VolumesTransfersV357Test-849163320 None] Lock "cinder-677b9076-3c7c-45f5-a245-b549ee22a796-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:13:45 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-45b836da-70a4-4ee6-a591-f4d9db10d6c0 tempest-VolumesTransfersV357Test-849163320 None] Acquiring lock "cinder-quobyte-677b9076-3c7c-45f5-a245-b549ee22a796" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:13:45 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-45b836da-70a4-4ee6-a591-f4d9db10d6c0 tempest-VolumesTransfersV357Test-849163320 None] Lock "cinder-quobyte-677b9076-3c7c-45f5-a245-b549ee22a796" acquired by "delete_volume" :: waited 0.014s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:13:45 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebe2829-f479-4a85-ba92-5d36fc5aae1d]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:13:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-45b836da-70a4-4ee6-a591-f4d9db10d6c0 tempest-VolumesTransfersV357Test-849163320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-677b9076-3c7c-45f5-a245-b549ee22a796 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:13:45 devstack sudo[110177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-677b9076-3c7c-45f5-a245-b549ee22a796 Jun 24 05:13:45 devstack sudo[110177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:13:46 devstack sudo[110177]: pam_unix(sudo:session): session closed for user root Jun 24 05:13:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-45b836da-70a4-4ee6-a591-f4d9db10d6c0 tempest-VolumesTransfersV357Test-849163320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-677b9076-3c7c-45f5-a245-b549ee22a796" returned: 0 in 0.771s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:13:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-45b836da-70a4-4ee6-a591-f4d9db10d6c0 tempest-VolumesTransfersV357Test-849163320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-677b9076-3c7c-45f5-a245-b549ee22a796 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:13:46 devstack sudo[110182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-677b9076-3c7c-45f5-a245-b549ee22a796 Jun 24 05:13:46 devstack sudo[110182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:13:47 devstack sudo[110182]: pam_unix(sudo:session): session closed for user root Jun 24 05:13:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-45b836da-70a4-4ee6-a591-f4d9db10d6c0 tempest-VolumesTransfersV357Test-849163320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-677b9076-3c7c-45f5-a245-b549ee22a796" returned: 0 in 0.668s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:13:47 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-45b836da-70a4-4ee6-a591-f4d9db10d6c0 tempest-VolumesTransfersV357Test-849163320 None] Lock "cinder-quobyte-677b9076-3c7c-45f5-a245-b549ee22a796" released by "delete_volume" :: held 1.483s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:13:47 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-45b836da-70a4-4ee6-a591-f4d9db10d6c0 tempest-VolumesTransfersV357Test-849163320 None] Created reservations ['a091b4e7-68b5-4f6c-b13c-8349159de591', '70c0af13-495c-43d4-ae66-7a9c472a274d', '3e7981e2-c438-4833-9151-de2ee2112814', '2d91c831-473a-4583-9297-9776b83f13ff'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:13:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-45b836da-70a4-4ee6-a591-f4d9db10d6c0 tempest-VolumesTransfersV357Test-849163320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:13:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-45b836da-70a4-4ee6-a591-f4d9db10d6c0 tempest-VolumesTransfersV357Test-849163320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:13:47 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-45b836da-70a4-4ee6-a591-f4d9db10d6c0 tempest-VolumesTransfersV357Test-849163320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:13:47 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-45b836da-70a4-4ee6-a591-f4d9db10d6c0 tempest-VolumesTransfersV357Test-849163320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:13:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-45b836da-70a4-4ee6-a591-f4d9db10d6c0 tempest-VolumesTransfersV357Test-849163320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:13:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-45b836da-70a4-4ee6-a591-f4d9db10d6c0 tempest-VolumesTransfersV357Test-849163320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:13:47 devstack sudo[110185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:13:47 devstack sudo[110185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:13:47 devstack sudo[110185]: pam_unix(sudo:session): session closed for user root Jun 24 05:13:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-45b836da-70a4-4ee6-a591-f4d9db10d6c0 tempest-VolumesTransfersV357Test-849163320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.703s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:13:47 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-45b836da-70a4-4ee6-a591-f4d9db10d6c0 tempest-VolumesTransfersV357Test-849163320 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:13:47 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-45b836da-70a4-4ee6-a591-f4d9db10d6c0 tempest-VolumesTransfersV357Test-849163320 None] Deleted volume successfully. Jun 24 05:13:47 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-45b836da-70a4-4ee6-a591-f4d9db10d6c0 tempest-VolumesTransfersV357Test-849163320 None] Lock "cinder-677b9076-3c7c-45f5-a245-b549ee22a796-delete_volume" released by "delete_volume" :: held 2.457s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:13:57 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:UPDATE=33,cinder:SELECT=16,cinder:DELETE=2,cinder:INSERT=5 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:13:57 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:SELECT=20,cinder:INSERT=9,cinder:UPDATE=26,cinder:DELETE=3 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:14:01 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-d42b20be-3119-4029-8a17-22e6cf218b78 tempest-VolumesActionsTest-1673806745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:14:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d42b20be-3119-4029-8a17-22e6cf218b78 tempest-VolumesActionsTest-1673806745 None] Flow 'volume_create_manager' (1feb0ae6-cb42-4af5-82f8-41a2265aa9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:14:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d42b20be-3119-4029-8a17-22e6cf218b78 tempest-VolumesActionsTest-1673806745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72c1fd38-4174-49a9-83bd-63f48bd9c08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:14:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d42b20be-3119-4029-8a17-22e6cf218b78 tempest-VolumesActionsTest-1673806745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72c1fd38-4174-49a9-83bd-63f48bd9c08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-583324201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb7a151a-1b51-4b86-a183-1116a72cee9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29d0d073c4b44cf5a499240b40be0fc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:14:01Z,use_quota=True,user_id='c03560aefc89470bb41c4347fa05f00b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:14:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d42b20be-3119-4029-8a17-22e6cf218b78 tempest-VolumesActionsTest-1673806745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57e682bb-d9aa-46f8-9e92-deccda13a85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:14:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d42b20be-3119-4029-8a17-22e6cf218b78 tempest-VolumesActionsTest-1673806745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57e682bb-d9aa-46f8-9e92-deccda13a85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:14:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d42b20be-3119-4029-8a17-22e6cf218b78 tempest-VolumesActionsTest-1673806745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c28e0d4e-243d-42ba-8e97-8feae2e143cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:14:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d42b20be-3119-4029-8a17-22e6cf218b78 tempest-VolumesActionsTest-1673806745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c28e0d4e-243d-42ba-8e97-8feae2e143cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb7a151a-1b51-4b86-a183-1116a72cee9c', 'volume_name': 'volume-cb7a151a-1b51-4b86-a183-1116a72cee9c', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:14:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d42b20be-3119-4029-8a17-22e6cf218b78 tempest-VolumesActionsTest-1673806745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ccc1ba4-c067-4d79-8f86-7ab0abf7ca52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:14:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d42b20be-3119-4029-8a17-22e6cf218b78 tempest-VolumesActionsTest-1673806745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ccc1ba4-c067-4d79-8f86-7ab0abf7ca52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:14:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d42b20be-3119-4029-8a17-22e6cf218b78 tempest-VolumesActionsTest-1673806745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (005b5782-b98d-4952-a032-0862c6854e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:14:01 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-d42b20be-3119-4029-8a17-22e6cf218b78 tempest-VolumesActionsTest-1673806745 None] Volume cb7a151a-1b51-4b86-a183-1116a72cee9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb7a151a-1b51-4b86-a183-1116a72cee9c', 'volume_size': 1} Jun 24 05:14:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-d42b20be-3119-4029-8a17-22e6cf218b78 tempest-VolumesActionsTest-1673806745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:14:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-d42b20be-3119-4029-8a17-22e6cf218b78 tempest-VolumesActionsTest-1673806745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:14:01 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-d42b20be-3119-4029-8a17-22e6cf218b78 tempest-VolumesActionsTest-1673806745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-583324201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb7a151a-1b51-4b86-a183-1116a72cee9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29d0d073c4b44cf5a499240b40be0fc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:14:01Z,use_quota=True,user_id='c03560aefc89470bb41c4347fa05f00b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:14:01 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-d42b20be-3119-4029-8a17-22e6cf218b78 tempest-VolumesActionsTest-1673806745 None] Creating volume cb7a151a-1b51-4b86-a183-1116a72cee9c {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:14:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-d42b20be-3119-4029-8a17-22e6cf218b78 tempest-VolumesActionsTest-1673806745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:14:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-d42b20be-3119-4029-8a17-22e6cf218b78 tempest-VolumesActionsTest-1673806745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:14:01 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-d42b20be-3119-4029-8a17-22e6cf218b78 tempest-VolumesActionsTest-1673806745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:14:01 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-d42b20be-3119-4029-8a17-22e6cf218b78 tempest-VolumesActionsTest-1673806745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:14:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-d42b20be-3119-4029-8a17-22e6cf218b78 tempest-VolumesActionsTest-1673806745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:14:01 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-d42b20be-3119-4029-8a17-22e6cf218b78 tempest-VolumesActionsTest-1673806745 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:14:01 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-d42b20be-3119-4029-8a17-22e6cf218b78 tempest-VolumesActionsTest-1673806745 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:14:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d42b20be-3119-4029-8a17-22e6cf218b78 tempest-VolumesActionsTest-1673806745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cb7a151a-1b51-4b86-a183-1116a72cee9c 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:14:01 devstack sudo[110210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cb7a151a-1b51-4b86-a183-1116a72cee9c 1073741824 Jun 24 05:14:01 devstack sudo[110210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:14:01 devstack sudo[110210]: pam_unix(sudo:session): session closed for user root Jun 24 05:14:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d42b20be-3119-4029-8a17-22e6cf218b78 tempest-VolumesActionsTest-1673806745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cb7a151a-1b51-4b86-a183-1116a72cee9c 1073741824" returned: 0 in 0.880s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:14:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d42b20be-3119-4029-8a17-22e6cf218b78 tempest-VolumesActionsTest-1673806745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cb7a151a-1b51-4b86-a183-1116a72cee9c {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:14:02 devstack sudo[110218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cb7a151a-1b51-4b86-a183-1116a72cee9c Jun 24 05:14:02 devstack sudo[110218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:14:02 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7e5bf1f-913c-497f-8b30-9db380d169af tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:14:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b7e5bf1f-913c-497f-8b30-9db380d169af tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Flow 'volume_create_manager' (5184c170-56be-4fde-8049-d5d82c6c1d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:14:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b7e5bf1f-913c-497f-8b30-9db380d169af tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df99e60c-d86a-49d9-9cdf-30dab041276c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:14:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b7e5bf1f-913c-497f-8b30-9db380d169af tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df99e60c-d86a-49d9-9cdf-30dab041276c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1835008639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcf88151-e668-48c1-9390-668436dd784a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b6634443e694fb8899e311fb3df6e2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:14:02Z,use_quota=True,user_id='062e5e8bbe1f4203acdfc2a1d7565f99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:14:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b7e5bf1f-913c-497f-8b30-9db380d169af tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eb1b336-7a24-4c28-b5d3-c75324fc0975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:14:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b7e5bf1f-913c-497f-8b30-9db380d169af tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eb1b336-7a24-4c28-b5d3-c75324fc0975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:14:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b7e5bf1f-913c-497f-8b30-9db380d169af tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd07876e-a4a3-4195-ab73-c390fffefb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:14:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b7e5bf1f-913c-497f-8b30-9db380d169af tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd07876e-a4a3-4195-ab73-c390fffefb7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcf88151-e668-48c1-9390-668436dd784a', 'volume_name': 'volume-bcf88151-e668-48c1-9390-668436dd784a', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:14:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b7e5bf1f-913c-497f-8b30-9db380d169af tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06d6b392-3afa-4161-a369-e51f94112dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:14:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b7e5bf1f-913c-497f-8b30-9db380d169af tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06d6b392-3afa-4161-a369-e51f94112dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:14:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b7e5bf1f-913c-497f-8b30-9db380d169af tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (537a4b51-7aff-489e-8f4d-1e4d7f0285b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:14:02 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-b7e5bf1f-913c-497f-8b30-9db380d169af tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Volume bcf88151-e668-48c1-9390-668436dd784a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcf88151-e668-48c1-9390-668436dd784a', 'volume_size': 1} Jun 24 05:14:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-b7e5bf1f-913c-497f-8b30-9db380d169af tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:14:02 devstack sudo[110218]: pam_unix(sudo:session): session closed for user root Jun 24 05:14:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d42b20be-3119-4029-8a17-22e6cf218b78 tempest-VolumesActionsTest-1673806745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cb7a151a-1b51-4b86-a183-1116a72cee9c" returned: 0 in 0.661s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:14:02 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-d42b20be-3119-4029-8a17-22e6cf218b78 tempest-VolumesActionsTest-1673806745 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:14:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-d42b20be-3119-4029-8a17-22e6cf218b78 tempest-VolumesActionsTest-1673806745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:14:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-b7e5bf1f-913c-497f-8b30-9db380d169af tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.099s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:14:02 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-b7e5bf1f-913c-497f-8b30-9db380d169af tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1835008639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcf88151-e668-48c1-9390-668436dd784a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b6634443e694fb8899e311fb3df6e2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:14:02Z,use_quota=True,user_id='062e5e8bbe1f4203acdfc2a1d7565f99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:14:02 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-b7e5bf1f-913c-497f-8b30-9db380d169af tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Creating volume bcf88151-e668-48c1-9390-668436dd784a {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:14:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-b7e5bf1f-913c-497f-8b30-9db380d169af tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:14:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-b7e5bf1f-913c-497f-8b30-9db380d169af tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:14:02 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-b7e5bf1f-913c-497f-8b30-9db380d169af tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:14:02 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-b7e5bf1f-913c-497f-8b30-9db380d169af tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:14:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-b7e5bf1f-913c-497f-8b30-9db380d169af tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:14:02 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-b7e5bf1f-913c-497f-8b30-9db380d169af tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:14:02 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-b7e5bf1f-913c-497f-8b30-9db380d169af tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:14:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-b7e5bf1f-913c-497f-8b30-9db380d169af tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bcf88151-e668-48c1-9390-668436dd784a 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:14:02 devstack sudo[110221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bcf88151-e668-48c1-9390-668436dd784a 1073741824 Jun 24 05:14:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d42b20be-3119-4029-8a17-22e6cf218b78 tempest-VolumesActionsTest-1673806745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (005b5782-b98d-4952-a032-0862c6854e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb7a151a-1b51-4b86-a183-1116a72cee9c', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:14:02 devstack sudo[110221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:14:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d42b20be-3119-4029-8a17-22e6cf218b78 tempest-VolumesActionsTest-1673806745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ebf70f4-c8ae-4b53-a4d3-715c7a684adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:14:02 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-d42b20be-3119-4029-8a17-22e6cf218b78 tempest-VolumesActionsTest-1673806745 None] Volume volume-cb7a151a-1b51-4b86-a183-1116a72cee9c (cb7a151a-1b51-4b86-a183-1116a72cee9c): created successfully Jun 24 05:14:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d42b20be-3119-4029-8a17-22e6cf218b78 tempest-VolumesActionsTest-1673806745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ebf70f4-c8ae-4b53-a4d3-715c7a684adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:14:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d42b20be-3119-4029-8a17-22e6cf218b78 tempest-VolumesActionsTest-1673806745 None] Flow 'volume_create_manager' (1feb0ae6-cb42-4af5-82f8-41a2265aa9db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:14:02 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-d42b20be-3119-4029-8a17-22e6cf218b78 tempest-VolumesActionsTest-1673806745 None] Created volume successfully. Jun 24 05:14:03 devstack sudo[110221]: pam_unix(sudo:session): session closed for user root Jun 24 05:14:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-b7e5bf1f-913c-497f-8b30-9db380d169af tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bcf88151-e668-48c1-9390-668436dd784a 1073741824" returned: 0 in 0.851s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:14:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-b7e5bf1f-913c-497f-8b30-9db380d169af tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bcf88151-e668-48c1-9390-668436dd784a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:14:03 devstack sudo[110227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bcf88151-e668-48c1-9390-668436dd784a Jun 24 05:14:03 devstack sudo[110227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:14:04 devstack sudo[110227]: pam_unix(sudo:session): session closed for user root Jun 24 05:14:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-b7e5bf1f-913c-497f-8b30-9db380d169af tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bcf88151-e668-48c1-9390-668436dd784a" returned: 0 in 0.680s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:14:04 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-b7e5bf1f-913c-497f-8b30-9db380d169af tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:14:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-b7e5bf1f-913c-497f-8b30-9db380d169af tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.577s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:14:04 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b7e5bf1f-913c-497f-8b30-9db380d169af tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (537a4b51-7aff-489e-8f4d-1e4d7f0285b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcf88151-e668-48c1-9390-668436dd784a', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:14:04 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b7e5bf1f-913c-497f-8b30-9db380d169af tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31d5ef50-9c58-46c1-89a6-0df120964684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:14:04 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-b7e5bf1f-913c-497f-8b30-9db380d169af tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Volume volume-bcf88151-e668-48c1-9390-668436dd784a (bcf88151-e668-48c1-9390-668436dd784a): created successfully Jun 24 05:14:04 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b7e5bf1f-913c-497f-8b30-9db380d169af tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31d5ef50-9c58-46c1-89a6-0df120964684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:14:04 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b7e5bf1f-913c-497f-8b30-9db380d169af tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Flow 'volume_create_manager' (5184c170-56be-4fde-8049-d5d82c6c1d8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:14:04 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-b7e5bf1f-913c-497f-8b30-9db380d169af tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Created volume successfully. Jun 24 05:14:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-4b6fc83e-e72b-4123-b8d4-331b2ed702c4 req-c3431f36-95e6-4203-9475-434d9c8b804b tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:14:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-4b6fc83e-e72b-4123-b8d4-331b2ed702c4 req-c3431f36-95e6-4203-9475-434d9c8b804b tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:14:07 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7076e0-a8ab-4883-a33a-9b57de422468]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:14:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-4b6fc83e-e72b-4123-b8d4-331b2ed702c4 req-c3431f36-95e6-4203-9475-434d9c8b804b tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bcf88151-e668-48c1-9390-668436dd784a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:14:07 devstack sudo[110250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bcf88151-e668-48c1-9390-668436dd784a Jun 24 05:14:07 devstack sudo[110250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:14:08 devstack sudo[110250]: pam_unix(sudo:session): session closed for user root Jun 24 05:14:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-4b6fc83e-e72b-4123-b8d4-331b2ed702c4 req-c3431f36-95e6-4203-9475-434d9c8b804b tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bcf88151-e668-48c1-9390-668436dd784a" returned: 0 in 0.762s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:14:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-4b6fc83e-e72b-4123-b8d4-331b2ed702c4 req-c3431f36-95e6-4203-9475-434d9c8b804b tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.781s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:14:08 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-4b6fc83e-e72b-4123-b8d4-331b2ed702c4 req-c3431f36-95e6-4203-9475-434d9c8b804b tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05', 'name': 'volume-bcf88151-e668-48c1-9390-668436dd784a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1536efcf-14ea-4b78-83ae-649c6c1370e3', 'enforce_multipath': True} {{(pid=93830) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 05:14:08 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-4b6fc83e-e72b-4123-b8d4-331b2ed702c4 req-c3431f36-95e6-4203-9475-434d9c8b804b tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] attachment_update completed successfully. Jun 24 05:14:09 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 05:14:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:14:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:14:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:14:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:14:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:14:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:14:09 devstack sudo[110639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:14:09 devstack sudo[110639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:14:10 devstack sudo[110639]: pam_unix(sudo:session): session closed for user root Jun 24 05:14:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.710s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:14:10 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:14:10 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager._thread_info {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 05:14:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread count: 29 {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 05:14:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread info: [<_MainThread(MainThread, started 130211312517248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 05:14:15 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-b0d8d8cf-5261-4544-ada9-02574ef18c8d req-3f44c94a-766e-4167-b701-08c717fb6c94 tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Terminate volume connection completed successfully. Jun 24 05:14:15 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-b0d8d8cf-5261-4544-ada9-02574ef18c8d req-3f44c94a-766e-4167-b701-08c717fb6c94 tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Deleting attachment 1536efcf-14ea-4b78-83ae-649c6c1370e3. {{(pid=93830) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 05:14:17 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-eee53473-52e5-4645-a5c7-4374d9728a65 tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Acquiring lock "cinder-bcf88151-e668-48c1-9390-668436dd784a-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:14:17 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-eee53473-52e5-4645-a5c7-4374d9728a65 tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Lock "cinder-bcf88151-e668-48c1-9390-668436dd784a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:14:17 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-eee53473-52e5-4645-a5c7-4374d9728a65 tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Acquiring lock "cinder-quobyte-bcf88151-e668-48c1-9390-668436dd784a" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:14:17 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-eee53473-52e5-4645-a5c7-4374d9728a65 tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Lock "cinder-quobyte-bcf88151-e668-48c1-9390-668436dd784a" acquired by "delete_volume" :: waited 0.021s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:14:17 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[325ebc08-0a96-4096-81e2-26c87cce5934]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:14:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-eee53473-52e5-4645-a5c7-4374d9728a65 tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bcf88151-e668-48c1-9390-668436dd784a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:14:17 devstack sudo[110776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bcf88151-e668-48c1-9390-668436dd784a Jun 24 05:14:17 devstack sudo[110776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:14:18 devstack sudo[110776]: pam_unix(sudo:session): session closed for user root Jun 24 05:14:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-eee53473-52e5-4645-a5c7-4374d9728a65 tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bcf88151-e668-48c1-9390-668436dd784a" returned: 0 in 0.820s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:14:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-eee53473-52e5-4645-a5c7-4374d9728a65 tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bcf88151-e668-48c1-9390-668436dd784a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:14:18 devstack sudo[110781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bcf88151-e668-48c1-9390-668436dd784a Jun 24 05:14:18 devstack sudo[110781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:14:18 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-413556c4-9c5e-4be6-a2dc-96f1652f4e5b tempest-VolumesActionsTest-1673806745 None] Acquiring lock "cinder-cb7a151a-1b51-4b86-a183-1116a72cee9c" by "attach_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:14:18 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-413556c4-9c5e-4be6-a2dc-96f1652f4e5b tempest-VolumesActionsTest-1673806745 None] Lock "cinder-cb7a151a-1b51-4b86-a183-1116a72cee9c" acquired by "attach_volume" :: waited 0.023s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:14:18 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-413556c4-9c5e-4be6-a2dc-96f1652f4e5b tempest-VolumesActionsTest-1673806745 None] Attaching volume cb7a151a-1b51-4b86-a183-1116a72cee9c to instance 911158f2-44b9-4d18-9e83-18de066e4e94 at mountpoint /dev/vdb on host None. Jun 24 05:14:18 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-413556c4-9c5e-4be6-a2dc-96f1652f4e5b tempest-VolumesActionsTest-1673806745 None] Attach volume completed successfully. Jun 24 05:14:18 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-413556c4-9c5e-4be6-a2dc-96f1652f4e5b tempest-VolumesActionsTest-1673806745 None] Lock "cinder-cb7a151a-1b51-4b86-a183-1116a72cee9c" released by "attach_volume" :: held 0.112s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:14:18 devstack sudo[110781]: pam_unix(sudo:session): session closed for user root Jun 24 05:14:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-eee53473-52e5-4645-a5c7-4374d9728a65 tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bcf88151-e668-48c1-9390-668436dd784a" returned: 0 in 0.748s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:14:18 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-eee53473-52e5-4645-a5c7-4374d9728a65 tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Lock "cinder-quobyte-bcf88151-e668-48c1-9390-668436dd784a" released by "delete_volume" :: held 1.607s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:14:18 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-eee53473-52e5-4645-a5c7-4374d9728a65 tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Created reservations ['f802d1af-948a-48b9-a61e-ba91b0e4ab86', '43d78c20-44b3-4a9a-ba40-a1ff974300f9', '6222a331-a3ba-44ef-97a0-5f41c02acb3a', 'cde6cd11-dd5e-4bf5-9c57-df1bf762051c'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:14:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-eee53473-52e5-4645-a5c7-4374d9728a65 tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:14:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-eee53473-52e5-4645-a5c7-4374d9728a65 tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:14:19 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-eee53473-52e5-4645-a5c7-4374d9728a65 tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:14:19 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-eee53473-52e5-4645-a5c7-4374d9728a65 tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:14:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-eee53473-52e5-4645-a5c7-4374d9728a65 tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:14:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-eee53473-52e5-4645-a5c7-4374d9728a65 tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:14:19 devstack sudo[110784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:14:19 devstack sudo[110784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:14:19 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-0d576cfa-6194-4885-9f5f-26c55b8e575e tempest-VolumesActionsTest-1673806745 None] Acquiring lock "cinder-cb7a151a-1b51-4b86-a183-1116a72cee9c-detach_volume" by "detach_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:14:19 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-0d576cfa-6194-4885-9f5f-26c55b8e575e tempest-VolumesActionsTest-1673806745 None] Lock "cinder-cb7a151a-1b51-4b86-a183-1116a72cee9c-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:14:19 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-0d576cfa-6194-4885-9f5f-26c55b8e575e tempest-VolumesActionsTest-1673806745 None] Detaching volume cb7a151a-1b51-4b86-a183-1116a72cee9c from instance 911158f2-44b9-4d18-9e83-18de066e4e94. Jun 24 05:14:19 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-0d576cfa-6194-4885-9f5f-26c55b8e575e tempest-VolumesActionsTest-1673806745 None] Detach volume completed successfully. Jun 24 05:14:19 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-0d576cfa-6194-4885-9f5f-26c55b8e575e tempest-VolumesActionsTest-1673806745 None] Lock "cinder-cb7a151a-1b51-4b86-a183-1116a72cee9c-detach_volume" released by "detach_volume" :: held 0.079s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:14:19 devstack sudo[110784]: pam_unix(sudo:session): session closed for user root Jun 24 05:14:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-eee53473-52e5-4645-a5c7-4374d9728a65 tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.724s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:14:19 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-eee53473-52e5-4645-a5c7-4374d9728a65 tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:14:19 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-eee53473-52e5-4645-a5c7-4374d9728a65 tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Deleted volume successfully. Jun 24 05:14:19 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-eee53473-52e5-4645-a5c7-4374d9728a65 tempest-TestServerVolumeAttachScenarioOldVersion-1887043343 None] Lock "cinder-bcf88151-e668-48c1-9390-668436dd784a-delete_volume" released by "delete_volume" :: held 2.561s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:14:33 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:SELECT=24,cinder:UPDATE=18,cinder:INSERT=5,cinder:DELETE=2 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:14:33 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:UPDATE=20,cinder:SELECT=21,cinder:DELETE=1,cinder:INSERT=3 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:14:45 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-bb19a541-b73b-47ce-a41c-7cfb61d00e14 tempest-VolumesActionsTest-1673806745 None] Acquiring lock "cinder-cb7a151a-1b51-4b86-a183-1116a72cee9c" by "attach_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:14:45 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-bb19a541-b73b-47ce-a41c-7cfb61d00e14 tempest-VolumesActionsTest-1673806745 None] Lock "cinder-cb7a151a-1b51-4b86-a183-1116a72cee9c" acquired by "attach_volume" :: waited 0.031s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:14:45 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-bb19a541-b73b-47ce-a41c-7cfb61d00e14 tempest-VolumesActionsTest-1673806745 None] Attaching volume cb7a151a-1b51-4b86-a183-1116a72cee9c to instance 570ccd50-d20d-4da3-8f26-4e76d8d005c5 at mountpoint /dev/vdb on host None. Jun 24 05:14:45 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-bb19a541-b73b-47ce-a41c-7cfb61d00e14 tempest-VolumesActionsTest-1673806745 None] Attach volume completed successfully. Jun 24 05:14:45 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-bb19a541-b73b-47ce-a41c-7cfb61d00e14 tempest-VolumesActionsTest-1673806745 None] Lock "cinder-cb7a151a-1b51-4b86-a183-1116a72cee9c" released by "attach_volume" :: held 0.119s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:14:46 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-67461a4c-a326-49cb-8191-a44a05fc5d45 tempest-VolumesActionsTest-1673806745 None] Acquiring lock "cinder-cb7a151a-1b51-4b86-a183-1116a72cee9c-detach_volume" by "detach_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:14:46 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-67461a4c-a326-49cb-8191-a44a05fc5d45 tempest-VolumesActionsTest-1673806745 None] Lock "cinder-cb7a151a-1b51-4b86-a183-1116a72cee9c-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:14:46 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-67461a4c-a326-49cb-8191-a44a05fc5d45 tempest-VolumesActionsTest-1673806745 None] Detaching volume cb7a151a-1b51-4b86-a183-1116a72cee9c from instance 570ccd50-d20d-4da3-8f26-4e76d8d005c5. Jun 24 05:14:46 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-67461a4c-a326-49cb-8191-a44a05fc5d45 tempest-VolumesActionsTest-1673806745 None] Detach volume completed successfully. Jun 24 05:14:46 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-67461a4c-a326-49cb-8191-a44a05fc5d45 tempest-VolumesActionsTest-1673806745 None] Lock "cinder-cb7a151a-1b51-4b86-a183-1116a72cee9c-detach_volume" released by "detach_volume" :: held 0.073s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:14:56 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:14:56 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=4 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:14:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-044a20cc-32bb-492b-bcd3-a87c40237b8c tempest-VolumesActionsTest-1673806745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:14:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-044a20cc-32bb-492b-bcd3-a87c40237b8c tempest-VolumesActionsTest-1673806745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:14:56 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25de003-1f5d-4d4f-a323-89427301e107]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:14:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-044a20cc-32bb-492b-bcd3-a87c40237b8c tempest-VolumesActionsTest-1673806745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cb7a151a-1b51-4b86-a183-1116a72cee9c {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:14:56 devstack sudo[111091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cb7a151a-1b51-4b86-a183-1116a72cee9c Jun 24 05:14:56 devstack sudo[111091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:14:57 devstack sudo[111091]: pam_unix(sudo:session): session closed for user root Jun 24 05:14:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-044a20cc-32bb-492b-bcd3-a87c40237b8c tempest-VolumesActionsTest-1673806745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cb7a151a-1b51-4b86-a183-1116a72cee9c" returned: 0 in 0.798s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:14:57 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[e423ece2-7f5d-416d-a540-15897a6fc082]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:14:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-044a20cc-32bb-492b-bcd3-a87c40237b8c tempest-VolumesActionsTest-1673806745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cb7a151a-1b51-4b86-a183-1116a72cee9c {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:14:57 devstack sudo[111096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cb7a151a-1b51-4b86-a183-1116a72cee9c Jun 24 05:14:57 devstack sudo[111096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:14:58 devstack sudo[111096]: pam_unix(sudo:session): session closed for user root Jun 24 05:14:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-044a20cc-32bb-492b-bcd3-a87c40237b8c tempest-VolumesActionsTest-1673806745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cb7a151a-1b51-4b86-a183-1116a72cee9c" returned: 0 in 0.875s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:14:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-044a20cc-32bb-492b-bcd3-a87c40237b8c tempest-VolumesActionsTest-1673806745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cb7a151a-1b51-4b86-a183-1116a72cee9c /opt/stack/data/cinder/conversion/cb7a151a-1b51-4b86-a183-1116a72cee9c.temp_image.345ef4d0-bf24-4210-aef8-fde4acb5fef0_uypntcz.img {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:14:58 devstack sudo[111101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cb7a151a-1b51-4b86-a183-1116a72cee9c /opt/stack/data/cinder/conversion/cb7a151a-1b51-4b86-a183-1116a72cee9c.temp_image.345ef4d0-bf24-4210-aef8-fde4acb5fef0_uypntcz.img Jun 24 05:14:58 devstack sudo[111101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:15:00 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a6531da-0d28-444f-a861-26af162bc8ae tempest-TestServerVolumeAttachmentScenario-644772180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:15:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1a6531da-0d28-444f-a861-26af162bc8ae tempest-TestServerVolumeAttachmentScenario-644772180 None] Flow 'volume_create_manager' (929065a3-6a64-4a9d-aab3-b0df6596ca2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:15:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1a6531da-0d28-444f-a861-26af162bc8ae tempest-TestServerVolumeAttachmentScenario-644772180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d05c8ae-f35b-4490-9536-97585a380bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:15:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1a6531da-0d28-444f-a861-26af162bc8ae tempest-TestServerVolumeAttachmentScenario-644772180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d05c8ae-f35b-4490-9536-97585a380bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1258341289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75d787cf-9926-4a8a-a4f7-4f068eb2e358,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95d523a359224ae3ba46a88623f9ef77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:15:00Z,use_quota=True,user_id='e17f2d95315a4321933fe3387a0ef0d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:15:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1a6531da-0d28-444f-a861-26af162bc8ae tempest-TestServerVolumeAttachmentScenario-644772180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d66a3f6-999a-44c5-8bc6-9eebec970cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:15:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1a6531da-0d28-444f-a861-26af162bc8ae tempest-TestServerVolumeAttachmentScenario-644772180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d66a3f6-999a-44c5-8bc6-9eebec970cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:15:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1a6531da-0d28-444f-a861-26af162bc8ae tempest-TestServerVolumeAttachmentScenario-644772180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f24b85c7-2acc-470d-ac33-b8cd747254d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:15:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1a6531da-0d28-444f-a861-26af162bc8ae tempest-TestServerVolumeAttachmentScenario-644772180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f24b85c7-2acc-470d-ac33-b8cd747254d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75d787cf-9926-4a8a-a4f7-4f068eb2e358', 'volume_name': 'volume-75d787cf-9926-4a8a-a4f7-4f068eb2e358', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:15:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1a6531da-0d28-444f-a861-26af162bc8ae tempest-TestServerVolumeAttachmentScenario-644772180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f7e30c8-ff10-4a94-bb26-d7c545b889e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:15:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1a6531da-0d28-444f-a861-26af162bc8ae tempest-TestServerVolumeAttachmentScenario-644772180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f7e30c8-ff10-4a94-bb26-d7c545b889e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:15:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1a6531da-0d28-444f-a861-26af162bc8ae tempest-TestServerVolumeAttachmentScenario-644772180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce5abafc-f002-41d6-a643-d83ddc0f84e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:15:00 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-1a6531da-0d28-444f-a861-26af162bc8ae tempest-TestServerVolumeAttachmentScenario-644772180 None] Volume 75d787cf-9926-4a8a-a4f7-4f068eb2e358: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75d787cf-9926-4a8a-a4f7-4f068eb2e358', 'volume_size': 1} Jun 24 05:15:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1a6531da-0d28-444f-a861-26af162bc8ae tempest-TestServerVolumeAttachmentScenario-644772180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:15:01 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-a55cae2c-1af8-43a5-8899-faee5488e857 tempest-TestServerVolumeAttachmentScenario-644772180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:15:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a55cae2c-1af8-43a5-8899-faee5488e857 tempest-TestServerVolumeAttachmentScenario-644772180 None] Flow 'volume_create_manager' (72c57440-5ac5-4d9c-9642-66c1fb883181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:15:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a55cae2c-1af8-43a5-8899-faee5488e857 tempest-TestServerVolumeAttachmentScenario-644772180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (016d73f2-8b5b-4b5d-a726-356c1d2d40cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:15:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a55cae2c-1af8-43a5-8899-faee5488e857 tempest-TestServerVolumeAttachmentScenario-644772180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (016d73f2-8b5b-4b5d-a726-356c1d2d40cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1882356521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb2f83dd-8f69-433d-aa35-a17e96ad097c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95d523a359224ae3ba46a88623f9ef77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:15:01Z,use_quota=True,user_id='e17f2d95315a4321933fe3387a0ef0d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:15:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a55cae2c-1af8-43a5-8899-faee5488e857 tempest-TestServerVolumeAttachmentScenario-644772180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ade7ac03-fade-459b-8f9b-1219d82a39d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:15:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a55cae2c-1af8-43a5-8899-faee5488e857 tempest-TestServerVolumeAttachmentScenario-644772180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ade7ac03-fade-459b-8f9b-1219d82a39d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:15:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a55cae2c-1af8-43a5-8899-faee5488e857 tempest-TestServerVolumeAttachmentScenario-644772180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bb9f751-e029-45f4-b83b-8e1e46cf946c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:15:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a55cae2c-1af8-43a5-8899-faee5488e857 tempest-TestServerVolumeAttachmentScenario-644772180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bb9f751-e029-45f4-b83b-8e1e46cf946c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb2f83dd-8f69-433d-aa35-a17e96ad097c', 'volume_name': 'volume-bb2f83dd-8f69-433d-aa35-a17e96ad097c', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:15:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a55cae2c-1af8-43a5-8899-faee5488e857 tempest-TestServerVolumeAttachmentScenario-644772180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9de7e2f-7646-4164-884c-9759baa083ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:15:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a55cae2c-1af8-43a5-8899-faee5488e857 tempest-TestServerVolumeAttachmentScenario-644772180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9de7e2f-7646-4164-884c-9759baa083ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:15:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a55cae2c-1af8-43a5-8899-faee5488e857 tempest-TestServerVolumeAttachmentScenario-644772180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cc544b7-ff5e-46b6-95ef-350be2c9cc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:15:01 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-a55cae2c-1af8-43a5-8899-faee5488e857 tempest-TestServerVolumeAttachmentScenario-644772180 None] Volume bb2f83dd-8f69-433d-aa35-a17e96ad097c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb2f83dd-8f69-433d-aa35-a17e96ad097c', 'volume_size': 1} Jun 24 05:15:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a55cae2c-1af8-43a5-8899-faee5488e857 tempest-TestServerVolumeAttachmentScenario-644772180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:15:03 devstack sudo[111101]: pam_unix(sudo:session): session closed for user root Jun 24 05:15:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-044a20cc-32bb-492b-bcd3-a87c40237b8c tempest-VolumesActionsTest-1673806745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cb7a151a-1b51-4b86-a183-1116a72cee9c /opt/stack/data/cinder/conversion/cb7a151a-1b51-4b86-a183-1116a72cee9c.temp_image.345ef4d0-bf24-4210-aef8-fde4acb5fef0_uypntcz.img" returned: 0 in 5.419s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:15:03 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[91da2810-3eb9-476a-ab41-03dd4943d207]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:15:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-044a20cc-32bb-492b-bcd3-a87c40237b8c tempest-VolumesActionsTest-1673806745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cb7a151a-1b51-4b86-a183-1116a72cee9c {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:15:03 devstack sudo[111118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cb7a151a-1b51-4b86-a183-1116a72cee9c Jun 24 05:15:03 devstack sudo[111118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:15:04 devstack sudo[111118]: pam_unix(sudo:session): session closed for user root Jun 24 05:15:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-044a20cc-32bb-492b-bcd3-a87c40237b8c tempest-VolumesActionsTest-1673806745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cb7a151a-1b51-4b86-a183-1116a72cee9c" returned: 0 in 0.965s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:15:04 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-044a20cc-32bb-492b-bcd3-a87c40237b8c tempest-VolumesActionsTest-1673806745 None] Image conversion details: src /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cb7a151a-1b51-4b86-a183-1116a72cee9c, size 1024.00 MB, duration 5.42 sec, destination /opt/stack/data/cinder/conversion/cb7a151a-1b51-4b86-a183-1116a72cee9c.temp_image.345ef4d0-bf24-4210-aef8-fde4acb5fef0_uypntcz.img {{(pid=93830) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 05:15:04 devstack cinder-volume[93830]: INFO cinder.image.image_utils [None req-044a20cc-32bb-492b-bcd3-a87c40237b8c tempest-VolumesActionsTest-1673806745 None] Converted 1024.00 MB image at 188.82 MB/s Jun 24 05:15:04 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-044a20cc-32bb-492b-bcd3-a87c40237b8c tempest-VolumesActionsTest-1673806745 None] 345ef4d0-bf24-4210-aef8-fde4acb5fef0 was raw, no need to convert to raw {{(pid=93830) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jun 24 05:15:09 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 05:15:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:15:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:15:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:15:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:15:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:15:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:15:09 devstack sudo[111132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:15:09 devstack sudo[111132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:15:10 devstack sudo[111132]: pam_unix(sudo:session): session closed for user root Jun 24 05:15:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.860s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:15:10 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:15:10 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager._thread_info {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 05:15:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread count: 29 {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 05:15:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread info: [<_MainThread(MainThread, started 130211312517248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 05:15:11 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:15:14 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:15:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-044a20cc-32bb-492b-bcd3-a87c40237b8c tempest-VolumesActionsTest-1673806745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.313s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:15:25 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-044a20cc-32bb-492b-bcd3-a87c40237b8c tempest-VolumesActionsTest-1673806745 None] Uploaded volume to glance image-id: 345ef4d0-bf24-4210-aef8-fde4acb5fef0. {{(pid=93830) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 24 05:15:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1a6531da-0d28-444f-a861-26af162bc8ae tempest-TestServerVolumeAttachmentScenario-644772180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.910s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:15:25 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-1a6531da-0d28-444f-a861-26af162bc8ae tempest-TestServerVolumeAttachmentScenario-644772180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1258341289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75d787cf-9926-4a8a-a4f7-4f068eb2e358,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95d523a359224ae3ba46a88623f9ef77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:15:00Z,use_quota=True,user_id='e17f2d95315a4321933fe3387a0ef0d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:15:25 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-1a6531da-0d28-444f-a861-26af162bc8ae tempest-TestServerVolumeAttachmentScenario-644772180 None] Creating volume 75d787cf-9926-4a8a-a4f7-4f068eb2e358 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:15:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1a6531da-0d28-444f-a861-26af162bc8ae tempest-TestServerVolumeAttachmentScenario-644772180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:15:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1a6531da-0d28-444f-a861-26af162bc8ae tempest-TestServerVolumeAttachmentScenario-644772180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:15:25 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-1a6531da-0d28-444f-a861-26af162bc8ae tempest-TestServerVolumeAttachmentScenario-644772180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:15:25 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-1a6531da-0d28-444f-a861-26af162bc8ae tempest-TestServerVolumeAttachmentScenario-644772180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:15:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1a6531da-0d28-444f-a861-26af162bc8ae tempest-TestServerVolumeAttachmentScenario-644772180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:15:25 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-1a6531da-0d28-444f-a861-26af162bc8ae tempest-TestServerVolumeAttachmentScenario-644772180 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:15:25 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-1a6531da-0d28-444f-a861-26af162bc8ae tempest-TestServerVolumeAttachmentScenario-644772180 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:15:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1a6531da-0d28-444f-a861-26af162bc8ae tempest-TestServerVolumeAttachmentScenario-644772180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-75d787cf-9926-4a8a-a4f7-4f068eb2e358 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:15:25 devstack sudo[111243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-75d787cf-9926-4a8a-a4f7-4f068eb2e358 1073741824 Jun 24 05:15:25 devstack sudo[111243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:15:25 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-044a20cc-32bb-492b-bcd3-a87c40237b8c tempest-VolumesActionsTest-1673806745 None] Copy volume to image completed successfully. Jun 24 05:15:26 devstack sudo[111243]: pam_unix(sudo:session): session closed for user root Jun 24 05:15:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1a6531da-0d28-444f-a861-26af162bc8ae tempest-TestServerVolumeAttachmentScenario-644772180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-75d787cf-9926-4a8a-a4f7-4f068eb2e358 1073741824" returned: 0 in 0.957s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:15:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1a6531da-0d28-444f-a861-26af162bc8ae tempest-TestServerVolumeAttachmentScenario-644772180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-75d787cf-9926-4a8a-a4f7-4f068eb2e358 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:15:26 devstack sudo[111249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-75d787cf-9926-4a8a-a4f7-4f068eb2e358 Jun 24 05:15:26 devstack sudo[111249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:15:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5112f98c-ff84-4052-9859-856d7aef6cda tempest-VolumesActionsTest-1673806745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:15:27 devstack sudo[111249]: pam_unix(sudo:session): session closed for user root Jun 24 05:15:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1a6531da-0d28-444f-a861-26af162bc8ae tempest-TestServerVolumeAttachmentScenario-644772180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-75d787cf-9926-4a8a-a4f7-4f068eb2e358" returned: 0 in 0.659s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:15:27 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-1a6531da-0d28-444f-a861-26af162bc8ae tempest-TestServerVolumeAttachmentScenario-644772180 None] <== create_volume: return (1662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:15:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1a6531da-0d28-444f-a861-26af162bc8ae tempest-TestServerVolumeAttachmentScenario-644772180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.666s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:15:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a55cae2c-1af8-43a5-8899-faee5488e857 tempest-TestServerVolumeAttachmentScenario-644772180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.522s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:15:27 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a55cae2c-1af8-43a5-8899-faee5488e857 tempest-TestServerVolumeAttachmentScenario-644772180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1882356521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb2f83dd-8f69-433d-aa35-a17e96ad097c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95d523a359224ae3ba46a88623f9ef77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:15:01Z,use_quota=True,user_id='e17f2d95315a4321933fe3387a0ef0d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:15:27 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-a55cae2c-1af8-43a5-8899-faee5488e857 tempest-TestServerVolumeAttachmentScenario-644772180 None] Creating volume bb2f83dd-8f69-433d-aa35-a17e96ad097c {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:15:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a55cae2c-1af8-43a5-8899-faee5488e857 tempest-TestServerVolumeAttachmentScenario-644772180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:15:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a55cae2c-1af8-43a5-8899-faee5488e857 tempest-TestServerVolumeAttachmentScenario-644772180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:15:27 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a55cae2c-1af8-43a5-8899-faee5488e857 tempest-TestServerVolumeAttachmentScenario-644772180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:15:27 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a55cae2c-1af8-43a5-8899-faee5488e857 tempest-TestServerVolumeAttachmentScenario-644772180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:15:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a55cae2c-1af8-43a5-8899-faee5488e857 tempest-TestServerVolumeAttachmentScenario-644772180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:15:27 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a55cae2c-1af8-43a5-8899-faee5488e857 tempest-TestServerVolumeAttachmentScenario-644772180 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:15:27 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-a55cae2c-1af8-43a5-8899-faee5488e857 tempest-TestServerVolumeAttachmentScenario-644772180 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:15:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a55cae2c-1af8-43a5-8899-faee5488e857 tempest-TestServerVolumeAttachmentScenario-644772180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bb2f83dd-8f69-433d-aa35-a17e96ad097c 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:15:27 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1a6531da-0d28-444f-a861-26af162bc8ae tempest-TestServerVolumeAttachmentScenario-644772180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce5abafc-f002-41d6-a643-d83ddc0f84e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75d787cf-9926-4a8a-a4f7-4f068eb2e358', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:15:27 devstack sudo[111252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bb2f83dd-8f69-433d-aa35-a17e96ad097c 1073741824 Jun 24 05:15:27 devstack sudo[111252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:15:27 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1a6531da-0d28-444f-a861-26af162bc8ae tempest-TestServerVolumeAttachmentScenario-644772180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96548ab2-7509-4fc7-a16b-90122822a5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:15:27 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-1a6531da-0d28-444f-a861-26af162bc8ae tempest-TestServerVolumeAttachmentScenario-644772180 None] Volume volume-75d787cf-9926-4a8a-a4f7-4f068eb2e358 (75d787cf-9926-4a8a-a4f7-4f068eb2e358): created successfully Jun 24 05:15:27 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1a6531da-0d28-444f-a861-26af162bc8ae tempest-TestServerVolumeAttachmentScenario-644772180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96548ab2-7509-4fc7-a16b-90122822a5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:15:27 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1a6531da-0d28-444f-a861-26af162bc8ae tempest-TestServerVolumeAttachmentScenario-644772180 None] Flow 'volume_create_manager' (929065a3-6a64-4a9d-aab3-b0df6596ca2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:15:27 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-1a6531da-0d28-444f-a861-26af162bc8ae tempest-TestServerVolumeAttachmentScenario-644772180 None] Created volume successfully. Jun 24 05:15:28 devstack sudo[111252]: pam_unix(sudo:session): session closed for user root Jun 24 05:15:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a55cae2c-1af8-43a5-8899-faee5488e857 tempest-TestServerVolumeAttachmentScenario-644772180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bb2f83dd-8f69-433d-aa35-a17e96ad097c 1073741824" returned: 0 in 0.806s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:15:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a55cae2c-1af8-43a5-8899-faee5488e857 tempest-TestServerVolumeAttachmentScenario-644772180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bb2f83dd-8f69-433d-aa35-a17e96ad097c {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:15:28 devstack sudo[111257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bb2f83dd-8f69-433d-aa35-a17e96ad097c Jun 24 05:15:28 devstack sudo[111257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:15:28 devstack sudo[111257]: pam_unix(sudo:session): session closed for user root Jun 24 05:15:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a55cae2c-1af8-43a5-8899-faee5488e857 tempest-TestServerVolumeAttachmentScenario-644772180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bb2f83dd-8f69-433d-aa35-a17e96ad097c" returned: 0 in 0.623s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:15:28 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a55cae2c-1af8-43a5-8899-faee5488e857 tempest-TestServerVolumeAttachmentScenario-644772180 None] <== create_volume: return (1467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:15:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a55cae2c-1af8-43a5-8899-faee5488e857 tempest-TestServerVolumeAttachmentScenario-644772180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.471s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:15:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5112f98c-ff84-4052-9859-856d7aef6cda tempest-VolumesActionsTest-1673806745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.061s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:15:28 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a55cae2c-1af8-43a5-8899-faee5488e857 tempest-TestServerVolumeAttachmentScenario-644772180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cc544b7-ff5e-46b6-95ef-350be2c9cc7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb2f83dd-8f69-433d-aa35-a17e96ad097c', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:15:28 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a55cae2c-1af8-43a5-8899-faee5488e857 tempest-TestServerVolumeAttachmentScenario-644772180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f55c793b-2617-4b77-bbac-5d086737f4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:15:28 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[228c07de-0000-4a38-9794-a8d13114be52]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:15:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5112f98c-ff84-4052-9859-856d7aef6cda tempest-VolumesActionsTest-1673806745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cb7a151a-1b51-4b86-a183-1116a72cee9c {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:15:28 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-a55cae2c-1af8-43a5-8899-faee5488e857 tempest-TestServerVolumeAttachmentScenario-644772180 None] Volume volume-bb2f83dd-8f69-433d-aa35-a17e96ad097c (bb2f83dd-8f69-433d-aa35-a17e96ad097c): created successfully Jun 24 05:15:28 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a55cae2c-1af8-43a5-8899-faee5488e857 tempest-TestServerVolumeAttachmentScenario-644772180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f55c793b-2617-4b77-bbac-5d086737f4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:15:28 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a55cae2c-1af8-43a5-8899-faee5488e857 tempest-TestServerVolumeAttachmentScenario-644772180 None] Flow 'volume_create_manager' (72c57440-5ac5-4d9c-9642-66c1fb883181) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:15:28 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-a55cae2c-1af8-43a5-8899-faee5488e857 tempest-TestServerVolumeAttachmentScenario-644772180 None] Created volume successfully. Jun 24 05:15:28 devstack sudo[111260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cb7a151a-1b51-4b86-a183-1116a72cee9c Jun 24 05:15:28 devstack sudo[111260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:15:29 devstack sudo[111260]: pam_unix(sudo:session): session closed for user root Jun 24 05:15:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5112f98c-ff84-4052-9859-856d7aef6cda tempest-VolumesActionsTest-1673806745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cb7a151a-1b51-4b86-a183-1116a72cee9c" returned: 0 in 0.781s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:15:29 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc7e2e1-3f47-43d7-b47b-0fc86b6fa772]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:15:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5112f98c-ff84-4052-9859-856d7aef6cda tempest-VolumesActionsTest-1673806745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cb7a151a-1b51-4b86-a183-1116a72cee9c {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:15:29 devstack sudo[111265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cb7a151a-1b51-4b86-a183-1116a72cee9c Jun 24 05:15:29 devstack sudo[111265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:15:30 devstack sudo[111265]: pam_unix(sudo:session): session closed for user root Jun 24 05:15:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5112f98c-ff84-4052-9859-856d7aef6cda tempest-VolumesActionsTest-1673806745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cb7a151a-1b51-4b86-a183-1116a72cee9c" returned: 0 in 0.742s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:15:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5112f98c-ff84-4052-9859-856d7aef6cda tempest-VolumesActionsTest-1673806745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cb7a151a-1b51-4b86-a183-1116a72cee9c /opt/stack/data/cinder/conversion/cb7a151a-1b51-4b86-a183-1116a72cee9c.temp_image.add2266d-fa3d-42af-8df9-47a381cbad8b9wqyryog.img {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:15:30 devstack sudo[111270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cb7a151a-1b51-4b86-a183-1116a72cee9c /opt/stack/data/cinder/conversion/cb7a151a-1b51-4b86-a183-1116a72cee9c.temp_image.add2266d-fa3d-42af-8df9-47a381cbad8b9wqyryog.img Jun 24 05:15:30 devstack sudo[111270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:15:35 devstack sudo[111270]: pam_unix(sudo:session): session closed for user root Jun 24 05:15:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5112f98c-ff84-4052-9859-856d7aef6cda tempest-VolumesActionsTest-1673806745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cb7a151a-1b51-4b86-a183-1116a72cee9c /opt/stack/data/cinder/conversion/cb7a151a-1b51-4b86-a183-1116a72cee9c.temp_image.add2266d-fa3d-42af-8df9-47a381cbad8b9wqyryog.img" returned: 0 in 4.636s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:15:35 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc78a55d-0b39-4013-b265-edf26eba3ebc]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:15:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5112f98c-ff84-4052-9859-856d7aef6cda tempest-VolumesActionsTest-1673806745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cb7a151a-1b51-4b86-a183-1116a72cee9c {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:15:35 devstack sudo[111304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cb7a151a-1b51-4b86-a183-1116a72cee9c Jun 24 05:15:35 devstack sudo[111304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:15:35 devstack sudo[111304]: pam_unix(sudo:session): session closed for user root Jun 24 05:15:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5112f98c-ff84-4052-9859-856d7aef6cda tempest-VolumesActionsTest-1673806745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cb7a151a-1b51-4b86-a183-1116a72cee9c" returned: 0 in 0.913s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:15:35 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-5112f98c-ff84-4052-9859-856d7aef6cda tempest-VolumesActionsTest-1673806745 None] Image conversion details: src /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cb7a151a-1b51-4b86-a183-1116a72cee9c, size 1024.00 MB, duration 4.64 sec, destination /opt/stack/data/cinder/conversion/cb7a151a-1b51-4b86-a183-1116a72cee9c.temp_image.add2266d-fa3d-42af-8df9-47a381cbad8b9wqyryog.img {{(pid=93830) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 05:15:35 devstack cinder-volume[93830]: INFO cinder.image.image_utils [None req-5112f98c-ff84-4052-9859-856d7aef6cda tempest-VolumesActionsTest-1673806745 None] Converted 1024.00 MB image at 220.71 MB/s Jun 24 05:15:35 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-5112f98c-ff84-4052-9859-856d7aef6cda tempest-VolumesActionsTest-1673806745 None] add2266d-fa3d-42af-8df9-47a381cbad8b was raw, converting to qcow2 {{(pid=93830) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jun 24 05:15:35 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdaa7f6d-f83f-4f0f-8175-758e5f28b836]: (4, 'raw') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:15:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5112f98c-ff84-4052-9859-856d7aef6cda tempest-VolumesActionsTest-1673806745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cb7a151a-1b51-4b86-a183-1116a72cee9c.temp_image.add2266d-fa3d-42af-8df9-47a381cbad8b9wqyryog.img {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:15:36 devstack sudo[111346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cb7a151a-1b51-4b86-a183-1116a72cee9c.temp_image.add2266d-fa3d-42af-8df9-47a381cbad8b9wqyryog.img Jun 24 05:15:36 devstack sudo[111346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:15:36 devstack sudo[111346]: pam_unix(sudo:session): session closed for user root Jun 24 05:15:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5112f98c-ff84-4052-9859-856d7aef6cda tempest-VolumesActionsTest-1673806745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cb7a151a-1b51-4b86-a183-1116a72cee9c.temp_image.add2266d-fa3d-42af-8df9-47a381cbad8b9wqyryog.img" returned: 0 in 0.707s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:15:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5112f98c-ff84-4052-9859-856d7aef6cda tempest-VolumesActionsTest-1673806745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cb7a151a-1b51-4b86-a183-1116a72cee9c.temp_image.add2266d-fa3d-42af-8df9-47a381cbad8b9wqyryog.img {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:15:36 devstack sudo[111357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cb7a151a-1b51-4b86-a183-1116a72cee9c.temp_image.add2266d-fa3d-42af-8df9-47a381cbad8b9wqyryog.img Jun 24 05:15:36 devstack sudo[111357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:15:37 devstack sudo[111357]: pam_unix(sudo:session): session closed for user root Jun 24 05:15:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5112f98c-ff84-4052-9859-856d7aef6cda tempest-VolumesActionsTest-1673806745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cb7a151a-1b51-4b86-a183-1116a72cee9c.temp_image.add2266d-fa3d-42af-8df9-47a381cbad8b9wqyryog.img" returned: 1 in 0.774s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:15:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5112f98c-ff84-4052-9859-856d7aef6cda tempest-VolumesActionsTest-1673806745 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cb7a151a-1b51-4b86-a183-1116a72cee9c.temp_image.add2266d-fa3d-42af-8df9-47a381cbad8b9wqyryog.img' failed. Not Retrying. {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 05:15:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5112f98c-ff84-4052-9859-856d7aef6cda tempest-VolumesActionsTest-1673806745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cb7a151a-1b51-4b86-a183-1116a72cee9c.temp_image.add2266d-fa3d-42af-8df9-47a381cbad8b9wqyryog.img /opt/stack/data/cinder/conversion/vol_upload_2hoot_6y {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:15:37 devstack sudo[111362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cb7a151a-1b51-4b86-a183-1116a72cee9c.temp_image.add2266d-fa3d-42af-8df9-47a381cbad8b9wqyryog.img /opt/stack/data/cinder/conversion/vol_upload_2hoot_6y Jun 24 05:15:37 devstack sudo[111362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:15:38 devstack sudo[111362]: pam_unix(sudo:session): session closed for user root Jun 24 05:15:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5112f98c-ff84-4052-9859-856d7aef6cda tempest-VolumesActionsTest-1673806745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cb7a151a-1b51-4b86-a183-1116a72cee9c.temp_image.add2266d-fa3d-42af-8df9-47a381cbad8b9wqyryog.img /opt/stack/data/cinder/conversion/vol_upload_2hoot_6y" returned: 0 in 0.637s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:15:38 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-5112f98c-ff84-4052-9859-856d7aef6cda tempest-VolumesActionsTest-1673806745 None] Image conversion details: src /opt/stack/data/cinder/conversion/cb7a151a-1b51-4b86-a183-1116a72cee9c.temp_image.add2266d-fa3d-42af-8df9-47a381cbad8b9wqyryog.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_2hoot_6y {{(pid=93830) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 05:15:38 devstack cinder-volume[93830]: INFO cinder.image.image_utils [None req-5112f98c-ff84-4052-9859-856d7aef6cda tempest-VolumesActionsTest-1673806745 None] Converted 1024.00 MB image at 1024.00 MB/s Jun 24 05:15:38 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[5446317c-6e0f-4b4d-bd4e-429eb834313c]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:15:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5112f98c-ff84-4052-9859-856d7aef6cda tempest-VolumesActionsTest-1673806745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2hoot_6y {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:15:38 devstack sudo[111368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2hoot_6y Jun 24 05:15:38 devstack sudo[111368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:15:38 devstack sudo[111368]: pam_unix(sudo:session): session closed for user root Jun 24 05:15:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5112f98c-ff84-4052-9859-856d7aef6cda tempest-VolumesActionsTest-1673806745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2hoot_6y" returned: 0 in 0.737s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:15:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5112f98c-ff84-4052-9859-856d7aef6cda tempest-VolumesActionsTest-1673806745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.380s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:15:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5112f98c-ff84-4052-9859-856d7aef6cda tempest-VolumesActionsTest-1673806745 None] Uploaded volume to glance image-id: add2266d-fa3d-42af-8df9-47a381cbad8b. {{(pid=93830) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 24 05:15:40 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-5112f98c-ff84-4052-9859-856d7aef6cda tempest-VolumesActionsTest-1673806745 None] Copy volume to image completed successfully. Jun 24 05:15:40 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-ca342f74-d306-4989-869d-f8273ee7a4e6 tempest-VolumesActionsTest-1673806745 None] Acquiring lock "cinder-cb7a151a-1b51-4b86-a183-1116a72cee9c-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:15:40 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-ca342f74-d306-4989-869d-f8273ee7a4e6 tempest-VolumesActionsTest-1673806745 None] Lock "cinder-cb7a151a-1b51-4b86-a183-1116a72cee9c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:15:41 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-ca342f74-d306-4989-869d-f8273ee7a4e6 tempest-VolumesActionsTest-1673806745 None] Acquiring lock "cinder-quobyte-cb7a151a-1b51-4b86-a183-1116a72cee9c" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:15:41 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-ca342f74-d306-4989-869d-f8273ee7a4e6 tempest-VolumesActionsTest-1673806745 None] Lock "cinder-quobyte-cb7a151a-1b51-4b86-a183-1116a72cee9c" acquired by "delete_volume" :: waited 0.022s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:15:41 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9076ba-5222-482e-b2f8-30c740704f5e]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:15:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ca342f74-d306-4989-869d-f8273ee7a4e6 tempest-VolumesActionsTest-1673806745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cb7a151a-1b51-4b86-a183-1116a72cee9c {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:15:41 devstack sudo[111374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cb7a151a-1b51-4b86-a183-1116a72cee9c Jun 24 05:15:41 devstack sudo[111374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:15:41 devstack sudo[111374]: pam_unix(sudo:session): session closed for user root Jun 24 05:15:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ca342f74-d306-4989-869d-f8273ee7a4e6 tempest-VolumesActionsTest-1673806745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cb7a151a-1b51-4b86-a183-1116a72cee9c" returned: 0 in 0.778s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:15:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ca342f74-d306-4989-869d-f8273ee7a4e6 tempest-VolumesActionsTest-1673806745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cb7a151a-1b51-4b86-a183-1116a72cee9c {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:15:41 devstack sudo[111379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cb7a151a-1b51-4b86-a183-1116a72cee9c Jun 24 05:15:41 devstack sudo[111379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:15:42 devstack sudo[111379]: pam_unix(sudo:session): session closed for user root Jun 24 05:15:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ca342f74-d306-4989-869d-f8273ee7a4e6 tempest-VolumesActionsTest-1673806745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-cb7a151a-1b51-4b86-a183-1116a72cee9c" returned: 0 in 0.648s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:15:42 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-ca342f74-d306-4989-869d-f8273ee7a4e6 tempest-VolumesActionsTest-1673806745 None] Lock "cinder-quobyte-cb7a151a-1b51-4b86-a183-1116a72cee9c" released by "delete_volume" :: held 1.465s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:15:42 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-ca342f74-d306-4989-869d-f8273ee7a4e6 tempest-VolumesActionsTest-1673806745 None] Created reservations ['f4935dba-7f60-46e9-a038-a8036adc789f', '256b2825-11c1-435b-b0c7-133e50ad1302', '66afc1c9-94a0-4847-bbde-5fee5f24c36e', 'c91f0a11-7031-431c-9b2f-92d2deb0f5d0'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:15:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-ca342f74-d306-4989-869d-f8273ee7a4e6 tempest-VolumesActionsTest-1673806745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:15:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-ca342f74-d306-4989-869d-f8273ee7a4e6 tempest-VolumesActionsTest-1673806745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:15:42 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-ca342f74-d306-4989-869d-f8273ee7a4e6 tempest-VolumesActionsTest-1673806745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:15:42 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-ca342f74-d306-4989-869d-f8273ee7a4e6 tempest-VolumesActionsTest-1673806745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:15:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-ca342f74-d306-4989-869d-f8273ee7a4e6 tempest-VolumesActionsTest-1673806745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:15:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ca342f74-d306-4989-869d-f8273ee7a4e6 tempest-VolumesActionsTest-1673806745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:15:42 devstack sudo[111382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:15:42 devstack sudo[111382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:15:43 devstack sudo[111382]: pam_unix(sudo:session): session closed for user root Jun 24 05:15:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ca342f74-d306-4989-869d-f8273ee7a4e6 tempest-VolumesActionsTest-1673806745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.640s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:15:43 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-ca342f74-d306-4989-869d-f8273ee7a4e6 tempest-VolumesActionsTest-1673806745 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:15:43 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-ca342f74-d306-4989-869d-f8273ee7a4e6 tempest-VolumesActionsTest-1673806745 None] Deleted volume successfully. Jun 24 05:15:43 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-ca342f74-d306-4989-869d-f8273ee7a4e6 tempest-VolumesActionsTest-1673806745 None] Lock "cinder-cb7a151a-1b51-4b86-a183-1116a72cee9c-delete_volume" released by "delete_volume" :: held 2.340s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:15:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-ee4fb2da-ca20-4927-b8bd-f84f1acd1156 req-f6bd370f-1938-4b3c-896c-f10d62a121ed tempest-TestServerVolumeAttachmentScenario-644772180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:15:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-ee4fb2da-ca20-4927-b8bd-f84f1acd1156 req-f6bd370f-1938-4b3c-896c-f10d62a121ed tempest-TestServerVolumeAttachmentScenario-644772180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:15:46 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb0a6c8-d414-46c1-b441-cc108754dbc4]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:15:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-ee4fb2da-ca20-4927-b8bd-f84f1acd1156 req-f6bd370f-1938-4b3c-896c-f10d62a121ed tempest-TestServerVolumeAttachmentScenario-644772180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-75d787cf-9926-4a8a-a4f7-4f068eb2e358 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:15:46 devstack sudo[111402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-75d787cf-9926-4a8a-a4f7-4f068eb2e358 Jun 24 05:15:46 devstack sudo[111402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:15:47 devstack sudo[111402]: pam_unix(sudo:session): session closed for user root Jun 24 05:15:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-ee4fb2da-ca20-4927-b8bd-f84f1acd1156 req-f6bd370f-1938-4b3c-896c-f10d62a121ed tempest-TestServerVolumeAttachmentScenario-644772180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-75d787cf-9926-4a8a-a4f7-4f068eb2e358" returned: 0 in 0.803s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:15:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-ee4fb2da-ca20-4927-b8bd-f84f1acd1156 req-f6bd370f-1938-4b3c-896c-f10d62a121ed tempest-TestServerVolumeAttachmentScenario-644772180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.823s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:15:47 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-ee4fb2da-ca20-4927-b8bd-f84f1acd1156 req-f6bd370f-1938-4b3c-896c-f10d62a121ed tempest-TestServerVolumeAttachmentScenario-644772180 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05', 'name': 'volume-75d787cf-9926-4a8a-a4f7-4f068eb2e358', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'abe6dddb-bb1b-4ac3-9890-54e1aa093e0b', 'enforce_multipath': True} {{(pid=93830) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 05:15:47 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-ee4fb2da-ca20-4927-b8bd-f84f1acd1156 req-f6bd370f-1938-4b3c-896c-f10d62a121ed tempest-TestServerVolumeAttachmentScenario-644772180 None] attachment_update completed successfully. Jun 24 05:15:49 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-84976fe6-a6d4-432a-b37b-fd538e3b23e0 tempest-VolumesCloneTest-1067995497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:15:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-84976fe6-a6d4-432a-b37b-fd538e3b23e0 tempest-VolumesCloneTest-1067995497 None] Flow 'volume_create_manager' (27e82e50-d333-443b-b8d3-3a4a68df5fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:15:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-84976fe6-a6d4-432a-b37b-fd538e3b23e0 tempest-VolumesCloneTest-1067995497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ac4ac02-ce17-4415-ba0f-5212e76e6cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:15:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-84976fe6-a6d4-432a-b37b-fd538e3b23e0 tempest-VolumesCloneTest-1067995497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ac4ac02-ce17-4415-ba0f-5212e76e6cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-487128757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eab4f00e-8da0-4236-935c-96171746c2a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1806cb573cf4f7dbcdf669d55aae764',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:15:49Z,use_quota=True,user_id='910c2873cee645b296bd100408437d96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:15:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-84976fe6-a6d4-432a-b37b-fd538e3b23e0 tempest-VolumesCloneTest-1067995497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29f6f846-d85d-482d-88f1-5d2f8bf9fd8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:15:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-84976fe6-a6d4-432a-b37b-fd538e3b23e0 tempest-VolumesCloneTest-1067995497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29f6f846-d85d-482d-88f1-5d2f8bf9fd8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:15:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-84976fe6-a6d4-432a-b37b-fd538e3b23e0 tempest-VolumesCloneTest-1067995497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0632cba-59dc-4b55-bd45-35d1e3e3c691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:15:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-84976fe6-a6d4-432a-b37b-fd538e3b23e0 tempest-VolumesCloneTest-1067995497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0632cba-59dc-4b55-bd45-35d1e3e3c691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eab4f00e-8da0-4236-935c-96171746c2a2', 'volume_name': 'volume-eab4f00e-8da0-4236-935c-96171746c2a2', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:15:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-84976fe6-a6d4-432a-b37b-fd538e3b23e0 tempest-VolumesCloneTest-1067995497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5bc6fc6-a5b4-43bc-a83d-eec1ec503249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:15:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-84976fe6-a6d4-432a-b37b-fd538e3b23e0 tempest-VolumesCloneTest-1067995497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5bc6fc6-a5b4-43bc-a83d-eec1ec503249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:15:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-84976fe6-a6d4-432a-b37b-fd538e3b23e0 tempest-VolumesCloneTest-1067995497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (402bdcc3-0ffc-4bca-bf85-f4837ad07ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:15:49 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-84976fe6-a6d4-432a-b37b-fd538e3b23e0 tempest-VolumesCloneTest-1067995497 None] Volume eab4f00e-8da0-4236-935c-96171746c2a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eab4f00e-8da0-4236-935c-96171746c2a2', 'volume_size': 1} Jun 24 05:15:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-84976fe6-a6d4-432a-b37b-fd538e3b23e0 tempest-VolumesCloneTest-1067995497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:15:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-84976fe6-a6d4-432a-b37b-fd538e3b23e0 tempest-VolumesCloneTest-1067995497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:15:49 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-84976fe6-a6d4-432a-b37b-fd538e3b23e0 tempest-VolumesCloneTest-1067995497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-487128757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eab4f00e-8da0-4236-935c-96171746c2a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1806cb573cf4f7dbcdf669d55aae764',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:15:49Z,use_quota=True,user_id='910c2873cee645b296bd100408437d96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:15:49 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-84976fe6-a6d4-432a-b37b-fd538e3b23e0 tempest-VolumesCloneTest-1067995497 None] Creating volume eab4f00e-8da0-4236-935c-96171746c2a2 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:15:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-84976fe6-a6d4-432a-b37b-fd538e3b23e0 tempest-VolumesCloneTest-1067995497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:15:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-84976fe6-a6d4-432a-b37b-fd538e3b23e0 tempest-VolumesCloneTest-1067995497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:15:49 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-84976fe6-a6d4-432a-b37b-fd538e3b23e0 tempest-VolumesCloneTest-1067995497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:15:49 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-84976fe6-a6d4-432a-b37b-fd538e3b23e0 tempest-VolumesCloneTest-1067995497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:15:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-84976fe6-a6d4-432a-b37b-fd538e3b23e0 tempest-VolumesCloneTest-1067995497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:15:49 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-84976fe6-a6d4-432a-b37b-fd538e3b23e0 tempest-VolumesCloneTest-1067995497 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:15:49 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-84976fe6-a6d4-432a-b37b-fd538e3b23e0 tempest-VolumesCloneTest-1067995497 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:15:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-84976fe6-a6d4-432a-b37b-fd538e3b23e0 tempest-VolumesCloneTest-1067995497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:15:49 devstack sudo[111793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2 1073741824 Jun 24 05:15:49 devstack sudo[111793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:15:50 devstack sudo[111793]: pam_unix(sudo:session): session closed for user root Jun 24 05:15:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-84976fe6-a6d4-432a-b37b-fd538e3b23e0 tempest-VolumesCloneTest-1067995497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2 1073741824" returned: 0 in 0.870s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:15:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-84976fe6-a6d4-432a-b37b-fd538e3b23e0 tempest-VolumesCloneTest-1067995497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:15:50 devstack sudo[111799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2 Jun 24 05:15:50 devstack sudo[111799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:15:50 devstack sudo[111799]: pam_unix(sudo:session): session closed for user root Jun 24 05:15:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-84976fe6-a6d4-432a-b37b-fd538e3b23e0 tempest-VolumesCloneTest-1067995497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2" returned: 0 in 0.664s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:15:50 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-84976fe6-a6d4-432a-b37b-fd538e3b23e0 tempest-VolumesCloneTest-1067995497 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:15:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-84976fe6-a6d4-432a-b37b-fd538e3b23e0 tempest-VolumesCloneTest-1067995497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:15:50 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-84976fe6-a6d4-432a-b37b-fd538e3b23e0 tempest-VolumesCloneTest-1067995497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (402bdcc3-0ffc-4bca-bf85-f4837ad07ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eab4f00e-8da0-4236-935c-96171746c2a2', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:15:50 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-84976fe6-a6d4-432a-b37b-fd538e3b23e0 tempest-VolumesCloneTest-1067995497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0f5b895-4f23-409d-8ad6-1a87d2c8432f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:15:50 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-84976fe6-a6d4-432a-b37b-fd538e3b23e0 tempest-VolumesCloneTest-1067995497 None] Volume volume-eab4f00e-8da0-4236-935c-96171746c2a2 (eab4f00e-8da0-4236-935c-96171746c2a2): created successfully Jun 24 05:15:50 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-84976fe6-a6d4-432a-b37b-fd538e3b23e0 tempest-VolumesCloneTest-1067995497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0f5b895-4f23-409d-8ad6-1a87d2c8432f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:15:50 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-84976fe6-a6d4-432a-b37b-fd538e3b23e0 tempest-VolumesCloneTest-1067995497 None] Flow 'volume_create_manager' (27e82e50-d333-443b-b8d3-3a4a68df5fea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:15:50 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-84976fe6-a6d4-432a-b37b-fd538e3b23e0 tempest-VolumesCloneTest-1067995497 None] Created volume successfully. Jun 24 05:15:51 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:15:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Flow 'volume_create_manager' (32e2df18-b557-4df7-9404-dabf6a9b3b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:15:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ba25bfd-0c90-4d0d-a8fa-6775af0f03fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:15:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ba25bfd-0c90-4d0d-a8fa-6775af0f03fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:15:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-33642794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=952d0eac-1c6f-4220-a99d-f3df025cb852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1806cb573cf4f7dbcdf669d55aae764',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:15:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=eab4f00e-8da0-4236-935c-96171746c2a2,status='creating',terminated_at=None,updated_at=2026-06-24T03:15:52Z,use_quota=True,user_id='910c2873cee645b296bd100408437d96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:15:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30c68a7f-0d75-4785-932e-43dbf77a2a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:15:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30c68a7f-0d75-4785-932e-43dbf77a2a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:15:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbf5b0f5-ae14-4a9d-800a-091ee4fe6f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:15:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbf5b0f5-ae14-4a9d-800a-091ee4fe6f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '952d0eac-1c6f-4220-a99d-f3df025cb852', 'volume_name': 'volume-952d0eac-1c6f-4220-a99d-f3df025cb852', 'volume_size': 2, 'source_volid': 'eab4f00e-8da0-4236-935c-96171746c2a2', 'source_volstatus': 'available'}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:15:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa5ff70c-adac-44fa-a5b3-ad15fd3fa0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:15:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa5ff70c-adac-44fa-a5b3-ad15fd3fa0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:15:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ee517e8-e8bf-4aad-b576-f4ca53250296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:15:51 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Volume 952d0eac-1c6f-4220-a99d-f3df025cb852: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-952d0eac-1c6f-4220-a99d-f3df025cb852', 'volume_size': 2, 'source_volid': 'eab4f00e-8da0-4236-935c-96171746c2a2', 'source_volstatus': 'available'} Jun 24 05:15:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:15:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:15:51 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Cloning volume eab4f00e-8da0-4236-935c-96171746c2a2 to volume 952d0eac-1c6f-4220-a99d-f3df025cb852 Jun 24 05:15:51 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Creating offline snapshot eb8c901d-f690-46f4-bd30-6d88013c7171 of volume eab4f00e-8da0-4236-935c-96171746c2a2 {{(pid=93830) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 05:15:51 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b13246-24e5-4635-a90a-9f828c7c0092]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:15:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:15:51 devstack sudo[111803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2 Jun 24 05:15:51 devstack sudo[111803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:15:52 devstack sudo[111803]: pam_unix(sudo:session): session closed for user root Jun 24 05:15:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2" returned: 0 in 0.882s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:15:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2.eb8c901d-f690-46f4-bd30-6d88013c7171 1G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:15:52 devstack sudo[111808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2.eb8c901d-f690-46f4-bd30-6d88013c7171 1G Jun 24 05:15:52 devstack sudo[111808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:15:53 devstack sudo[111808]: pam_unix(sudo:session): session closed for user root Jun 24 05:15:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2.eb8c901d-f690-46f4-bd30-6d88013c7171 1G" returned: 0 in 0.859s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:15:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eab4f00e-8da0-4236-935c-96171746c2a2 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2.eb8c901d-f690-46f4-bd30-6d88013c7171 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:15:53 devstack sudo[111814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eab4f00e-8da0-4236-935c-96171746c2a2 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2.eb8c901d-f690-46f4-bd30-6d88013c7171 Jun 24 05:15:53 devstack sudo[111814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:15:54 devstack sudo[111814]: pam_unix(sudo:session): session closed for user root Jun 24 05:15:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eab4f00e-8da0-4236-935c-96171746c2a2 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2.eb8c901d-f690-46f4-bd30-6d88013c7171" returned: 0 in 0.700s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:15:54 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2.eb8c901d-f690-46f4-bd30-6d88013c7171 is being set with open permissions: ugo+rw Jun 24 05:15:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2.eb8c901d-f690-46f4-bd30-6d88013c7171 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:15:54 devstack sudo[111822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2.eb8c901d-f690-46f4-bd30-6d88013c7171 Jun 24 05:15:54 devstack sudo[111822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:15:54 devstack sudo[111822]: pam_unix(sudo:session): session closed for user root Jun 24 05:15:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2.eb8c901d-f690-46f4-bd30-6d88013c7171" returned: 0 in 0.652s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:15:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:15:55 devstack sudo[111825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2.info Jun 24 05:15:55 devstack sudo[111825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:15:55 devstack sudo[111825]: pam_unix(sudo:session): session closed for user root Jun 24 05:15:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2.info" returned: 0 in 0.651s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:15:55 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2.info is being set with open permissions: ugo+rw Jun 24 05:15:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:15:55 devstack sudo[111828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2.info Jun 24 05:15:55 devstack sudo[111828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:15:56 devstack sudo[111828]: pam_unix(sudo:session): session closed for user root Jun 24 05:15:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2.info" returned: 0 in 0.642s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:15:56 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Acquiring lock "cinder-quobyte-952d0eac-1c6f-4220-a99d-f3df025cb852" by "_copy_volume_from_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:15:56 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Lock "cinder-quobyte-952d0eac-1c6f-4220-a99d-f3df025cb852" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:15:56 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] snapshot: eb8c901d-f690-46f4-bd30-6d88013c7171, volume: 952d0eac-1c6f-4220-a99d-f3df025cb852, {{(pid=93830) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 05:15:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:15:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:15:56 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:15:56 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:15:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:15:56 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d47259-cfd4-4e77-a576-fd7a80f04706]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:15:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2.eb8c901d-f690-46f4-bd30-6d88013c7171 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:15:56 devstack sudo[111831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2.eb8c901d-f690-46f4-bd30-6d88013c7171 Jun 24 05:15:56 devstack sudo[111831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:15:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-b8981982-920b-4213-b28d-0bf748eadce1 req-b87952eb-c5c2-4dfa-a685-02a52df03418 tempest-TestServerVolumeAttachmentScenario-644772180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:15:57 devstack sudo[111831]: pam_unix(sudo:session): session closed for user root Jun 24 05:15:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2.eb8c901d-f690-46f4-bd30-6d88013c7171" returned: 0 in 0.796s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:15:57 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eab4f00e-8da0-4236-935c-96171746c2a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:15:57 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2 {{(pid=93830) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 05:15:57 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Creating direct copy from snapshot {{(pid=93830) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 05:15:57 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[a084910c-da36-4af6-a43b-bfa4bcad1980]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:15:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:15:57 devstack sudo[111844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2 Jun 24 05:15:57 devstack sudo[111844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:15:57 devstack sudo[111844]: pam_unix(sudo:session): session closed for user root Jun 24 05:15:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2" returned: 0 in 0.779s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:15:57 devstack cinder-volume[93830]: DEBUG cinder.utils [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Path /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-952d0eac-1c6f-4220-a99d-f3df025cb852 not found in is_blk_device check {{(pid=93830) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 05:15:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-952d0eac-1c6f-4220-a99d-f3df025cb852 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:15:57 devstack sudo[111849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-952d0eac-1c6f-4220-a99d-f3df025cb852 Jun 24 05:15:57 devstack sudo[111849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:02 devstack sudo[111849]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-952d0eac-1c6f-4220-a99d-f3df025cb852" returned: 0 in 4.517s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:02 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[d549be1c-1201-4b35-a164-93dac0690079]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:16:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:02 devstack sudo[111862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2 Jun 24 05:16:02 devstack sudo[111862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:03 devstack sudo[111862]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2" returned: 0 in 0.887s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:03 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Image conversion details: src /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2, size 1024.00 MB, duration 4.52 sec, destination /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-952d0eac-1c6f-4220-a99d-f3df025cb852 {{(pid=93830) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 05:16:03 devstack cinder-volume[93830]: INFO cinder.image.image_utils [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Converted 1024.00 MB image at 226.65 MB/s Jun 24 05:16:03 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-952d0eac-1c6f-4220-a99d-f3df025cb852 is being set with open permissions: ugo+rw Jun 24 05:16:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-952d0eac-1c6f-4220-a99d-f3df025cb852 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:03 devstack sudo[111867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-952d0eac-1c6f-4220-a99d-f3df025cb852 Jun 24 05:16:03 devstack sudo[111867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:03 devstack sudo[111867]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-952d0eac-1c6f-4220-a99d-f3df025cb852" returned: 0 in 0.604s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:03 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Lock "cinder-quobyte-952d0eac-1c6f-4220-a99d-f3df025cb852" released by "_copy_volume_from_snapshot" :: held 7.656s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:16:03 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Acquiring lock "cinder-quobyte-eb8c901d-f690-46f4-bd30-6d88013c7171" by "_delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:16:04 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Lock "cinder-quobyte-eb8c901d-f690-46f4-bd30-6d88013c7171" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:16:04 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Deleting offline snapshot eb8c901d-f690-46f4-bd30-6d88013c7171 of volume eab4f00e-8da0-4236-935c-96171746c2a2 {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 05:16:04 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] snapshot_file for this snap is: volume-eab4f00e-8da0-4236-935c-96171746c2a2.eb8c901d-f690-46f4-bd30-6d88013c7171 {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 05:16:04 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45ca10e-4c1e-484b-b5fd-409e23ccdd83]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:16:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2.eb8c901d-f690-46f4-bd30-6d88013c7171 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:04 devstack sudo[111870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2.eb8c901d-f690-46f4-bd30-6d88013c7171 Jun 24 05:16:04 devstack sudo[111870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:04 devstack sudo[111870]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2.eb8c901d-f690-46f4-bd30-6d88013c7171" returned: 0 in 0.715s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:04 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eab4f00e-8da0-4236-935c-96171746c2a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:16:04 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5d90a7-2c83-4ad1-b68e-14945e5c6469]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:16:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:04 devstack sudo[111878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2 Jun 24 05:16:04 devstack sudo[111878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:05 devstack sudo[111878]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2" returned: 0 in 0.737s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2.eb8c901d-f690-46f4-bd30-6d88013c7171 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:05 devstack sudo[111886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2.eb8c901d-f690-46f4-bd30-6d88013c7171 Jun 24 05:16:05 devstack sudo[111886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:06 devstack sudo[111886]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2.eb8c901d-f690-46f4-bd30-6d88013c7171" returned: 0 in 0.705s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2.eb8c901d-f690-46f4-bd30-6d88013c7171 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:06 devstack sudo[111891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2.eb8c901d-f690-46f4-bd30-6d88013c7171 Jun 24 05:16:06 devstack sudo[111891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:06 devstack sudo[111891]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2.eb8c901d-f690-46f4-bd30-6d88013c7171" returned: 0 in 0.622s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:06 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Lock "cinder-quobyte-eb8c901d-f690-46f4-bd30-6d88013c7171" released by "_delete_snapshot" :: held 2.866s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:16:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.098s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:16:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-b8981982-920b-4213-b28d-0bf748eadce1 req-b87952eb-c5c2-4dfa-a685-02a52df03418 tempest-TestServerVolumeAttachmentScenario-644772180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.992s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:16:06 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ee517e8-e8bf-4aad-b576-f4ca53250296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-952d0eac-1c6f-4220-a99d-f3df025cb852', 'volume_size': 2, 'source_volid': 'eab4f00e-8da0-4236-935c-96171746c2a2', 'source_volstatus': 'available'}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:16:06 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ba79d36-2639-4c1a-91bc-da10e6e42aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:16:06 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cbcc9e-a32d-4db2-ad33-07fdb67068cb]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:16:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-b8981982-920b-4213-b28d-0bf748eadce1 req-b87952eb-c5c2-4dfa-a685-02a52df03418 tempest-TestServerVolumeAttachmentScenario-644772180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bb2f83dd-8f69-433d-aa35-a17e96ad097c {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:06 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Volume volume-952d0eac-1c6f-4220-a99d-f3df025cb852 (952d0eac-1c6f-4220-a99d-f3df025cb852): created successfully Jun 24 05:16:06 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ba79d36-2639-4c1a-91bc-da10e6e42aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:16:06 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Flow 'volume_create_manager' (32e2df18-b557-4df7-9404-dabf6a9b3b52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:16:06 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-480d2339-18e6-4e14-8737-a415c8ddb86c tempest-VolumesCloneTest-1067995497 None] Created volume successfully. Jun 24 05:16:07 devstack sudo[111894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bb2f83dd-8f69-433d-aa35-a17e96ad097c Jun 24 05:16:07 devstack sudo[111894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:07 devstack sudo[111894]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-b8981982-920b-4213-b28d-0bf748eadce1 req-b87952eb-c5c2-4dfa-a685-02a52df03418 tempest-TestServerVolumeAttachmentScenario-644772180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bb2f83dd-8f69-433d-aa35-a17e96ad097c" returned: 0 in 0.721s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-b8981982-920b-4213-b28d-0bf748eadce1 req-b87952eb-c5c2-4dfa-a685-02a52df03418 tempest-TestServerVolumeAttachmentScenario-644772180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.747s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:16:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-b8981982-920b-4213-b28d-0bf748eadce1 req-b87952eb-c5c2-4dfa-a685-02a52df03418 tempest-TestServerVolumeAttachmentScenario-644772180 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05', 'name': 'volume-bb2f83dd-8f69-433d-aa35-a17e96ad097c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f92f2188-3f00-4436-a0b8-2dac13eaedd4', 'enforce_multipath': True} {{(pid=93830) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 05:16:07 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-b8981982-920b-4213-b28d-0bf748eadce1 req-b87952eb-c5c2-4dfa-a685-02a52df03418 tempest-TestServerVolumeAttachmentScenario-644772180 None] attachment_update completed successfully. Jun 24 05:16:07 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-c85a7825-5b31-4f87-8ac8-f236744f4b11 tempest-VolumesCloneTest-1067995497 None] Acquiring lock "cinder-952d0eac-1c6f-4220-a99d-f3df025cb852-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:16:07 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-c85a7825-5b31-4f87-8ac8-f236744f4b11 tempest-VolumesCloneTest-1067995497 None] Lock "cinder-952d0eac-1c6f-4220-a99d-f3df025cb852-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:16:07 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-c85a7825-5b31-4f87-8ac8-f236744f4b11 tempest-VolumesCloneTest-1067995497 None] Acquiring lock "cinder-quobyte-952d0eac-1c6f-4220-a99d-f3df025cb852" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:16:07 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-c85a7825-5b31-4f87-8ac8-f236744f4b11 tempest-VolumesCloneTest-1067995497 None] Lock "cinder-quobyte-952d0eac-1c6f-4220-a99d-f3df025cb852" acquired by "delete_volume" :: waited 0.021s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:16:08 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d575ff0-25d2-4f65-bb2c-d450f085d2c0]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:16:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c85a7825-5b31-4f87-8ac8-f236744f4b11 tempest-VolumesCloneTest-1067995497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-952d0eac-1c6f-4220-a99d-f3df025cb852 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:08 devstack sudo[111923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-952d0eac-1c6f-4220-a99d-f3df025cb852 Jun 24 05:16:08 devstack sudo[111923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:08 devstack sudo[111923]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c85a7825-5b31-4f87-8ac8-f236744f4b11 tempest-VolumesCloneTest-1067995497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-952d0eac-1c6f-4220-a99d-f3df025cb852" returned: 0 in 0.742s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c85a7825-5b31-4f87-8ac8-f236744f4b11 tempest-VolumesCloneTest-1067995497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-952d0eac-1c6f-4220-a99d-f3df025cb852 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:08 devstack sudo[111933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-952d0eac-1c6f-4220-a99d-f3df025cb852 Jun 24 05:16:08 devstack sudo[111933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:09 devstack sudo[111933]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c85a7825-5b31-4f87-8ac8-f236744f4b11 tempest-VolumesCloneTest-1067995497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-952d0eac-1c6f-4220-a99d-f3df025cb852" returned: 0 in 0.625s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:09 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-c85a7825-5b31-4f87-8ac8-f236744f4b11 tempest-VolumesCloneTest-1067995497 None] Lock "cinder-quobyte-952d0eac-1c6f-4220-a99d-f3df025cb852" released by "delete_volume" :: held 1.413s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:16:09 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-c85a7825-5b31-4f87-8ac8-f236744f4b11 tempest-VolumesCloneTest-1067995497 None] Created reservations ['9d55aa35-1e02-4272-8a58-05897f34e0e0', 'e0ed7035-7660-4e0f-a0ee-e2978a778e80', 'aa700028-201a-40d5-bb6f-cc6989a004bc', '3360b58c-2f21-4265-98e9-8cc84842942f'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:16:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-c85a7825-5b31-4f87-8ac8-f236744f4b11 tempest-VolumesCloneTest-1067995497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:16:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-c85a7825-5b31-4f87-8ac8-f236744f4b11 tempest-VolumesCloneTest-1067995497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:16:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-c85a7825-5b31-4f87-8ac8-f236744f4b11 tempest-VolumesCloneTest-1067995497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:16:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-c85a7825-5b31-4f87-8ac8-f236744f4b11 tempest-VolumesCloneTest-1067995497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:16:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-c85a7825-5b31-4f87-8ac8-f236744f4b11 tempest-VolumesCloneTest-1067995497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:16:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c85a7825-5b31-4f87-8ac8-f236744f4b11 tempest-VolumesCloneTest-1067995497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:09 devstack sudo[111936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:16:09 devstack sudo[111936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:09 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 05:16:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:16:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:16:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:16:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:16:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:16:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:09 devstack sudo[111938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:16:09 devstack sudo[111938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:10 devstack sudo[111936]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c85a7825-5b31-4f87-8ac8-f236744f4b11 tempest-VolumesCloneTest-1067995497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.640s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:10 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-c85a7825-5b31-4f87-8ac8-f236744f4b11 tempest-VolumesCloneTest-1067995497 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:16:10 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-c85a7825-5b31-4f87-8ac8-f236744f4b11 tempest-VolumesCloneTest-1067995497 None] Deleted volume successfully. Jun 24 05:16:10 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-c85a7825-5b31-4f87-8ac8-f236744f4b11 tempest-VolumesCloneTest-1067995497 None] Lock "cinder-952d0eac-1c6f-4220-a99d-f3df025cb852-delete_volume" released by "delete_volume" :: held 2.278s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:16:10 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-bf1ba6cb-af74-4f41-86ec-c114c470f7ab tempest-VolumesCloneTest-1067995497 None] Acquiring lock "cinder-eab4f00e-8da0-4236-935c-96171746c2a2-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:16:10 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-bf1ba6cb-af74-4f41-86ec-c114c470f7ab tempest-VolumesCloneTest-1067995497 None] Lock "cinder-eab4f00e-8da0-4236-935c-96171746c2a2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:16:10 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-bf1ba6cb-af74-4f41-86ec-c114c470f7ab tempest-VolumesCloneTest-1067995497 None] Acquiring lock "cinder-quobyte-eab4f00e-8da0-4236-935c-96171746c2a2" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:16:10 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-bf1ba6cb-af74-4f41-86ec-c114c470f7ab tempest-VolumesCloneTest-1067995497 None] Lock "cinder-quobyte-eab4f00e-8da0-4236-935c-96171746c2a2" acquired by "delete_volume" :: waited 0.020s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:16:10 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8cdda8-7ddb-4252-822e-992ea6e8cdd2]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:16:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-bf1ba6cb-af74-4f41-86ec-c114c470f7ab tempest-VolumesCloneTest-1067995497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:10 devstack sudo[111941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2 Jun 24 05:16:10 devstack sudo[111941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:10 devstack sudo[111938]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.683s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:10 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:16:10 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager._thread_info {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 05:16:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread count: 29 {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 05:16:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread info: [<_MainThread(MainThread, started 130211312517248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 05:16:11 devstack sudo[111941]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-bf1ba6cb-af74-4f41-86ec-c114c470f7ab tempest-VolumesCloneTest-1067995497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2" returned: 0 in 0.743s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-bf1ba6cb-af74-4f41-86ec-c114c470f7ab tempest-VolumesCloneTest-1067995497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:11 devstack sudo[111948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2 Jun 24 05:16:11 devstack sudo[111948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:11 devstack sudo[111948]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-bf1ba6cb-af74-4f41-86ec-c114c470f7ab tempest-VolumesCloneTest-1067995497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-eab4f00e-8da0-4236-935c-96171746c2a2" returned: 0 in 0.618s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:11 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-bf1ba6cb-af74-4f41-86ec-c114c470f7ab tempest-VolumesCloneTest-1067995497 None] Lock "cinder-quobyte-eab4f00e-8da0-4236-935c-96171746c2a2" released by "delete_volume" :: held 1.421s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:16:11 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-bf1ba6cb-af74-4f41-86ec-c114c470f7ab tempest-VolumesCloneTest-1067995497 None] Created reservations ['e8f521e5-fe92-4f54-b61b-95f758160ddc', 'af3047f8-75bb-4627-832d-ee6c780325ce', '1c058bed-65cb-4bb1-b7ee-284cc01fbc40', 'b50c412d-7a4e-4f84-8b16-d95f2b17387c'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:16:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-bf1ba6cb-af74-4f41-86ec-c114c470f7ab tempest-VolumesCloneTest-1067995497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:16:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-bf1ba6cb-af74-4f41-86ec-c114c470f7ab tempest-VolumesCloneTest-1067995497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:16:11 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-bf1ba6cb-af74-4f41-86ec-c114c470f7ab tempest-VolumesCloneTest-1067995497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:16:11 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-bf1ba6cb-af74-4f41-86ec-c114c470f7ab tempest-VolumesCloneTest-1067995497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:16:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-bf1ba6cb-af74-4f41-86ec-c114c470f7ab tempest-VolumesCloneTest-1067995497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:16:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-bf1ba6cb-af74-4f41-86ec-c114c470f7ab tempest-VolumesCloneTest-1067995497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:11 devstack sudo[111951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:16:11 devstack sudo[111951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:12 devstack sudo[111951]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-bf1ba6cb-af74-4f41-86ec-c114c470f7ab tempest-VolumesCloneTest-1067995497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.646s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:12 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-bf1ba6cb-af74-4f41-86ec-c114c470f7ab tempest-VolumesCloneTest-1067995497 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:16:12 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-bf1ba6cb-af74-4f41-86ec-c114c470f7ab tempest-VolumesCloneTest-1067995497 None] Deleted volume successfully. Jun 24 05:16:12 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-bf1ba6cb-af74-4f41-86ec-c114c470f7ab tempest-VolumesCloneTest-1067995497 None] Lock "cinder-eab4f00e-8da0-4236-935c-96171746c2a2-delete_volume" released by "delete_volume" :: held 2.295s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:16:13 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-f178ed1c-5f6d-41e9-8599-95b11ed15c3f req-5d97e321-1bdf-4d67-aaae-86804c3e6f42 tempest-TestServerVolumeAttachmentScenario-644772180 None] Terminate volume connection completed successfully. Jun 24 05:16:13 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-f178ed1c-5f6d-41e9-8599-95b11ed15c3f req-5d97e321-1bdf-4d67-aaae-86804c3e6f42 tempest-TestServerVolumeAttachmentScenario-644772180 None] Deleting attachment f92f2188-3f00-4436-a0b8-2dac13eaedd4. {{(pid=93830) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 05:16:15 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-45607ccc-2f2c-427f-9c3a-9b100e51c899 tempest-VolumesListTestJSON-1720623972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:16:15 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-45607ccc-2f2c-427f-9c3a-9b100e51c899 tempest-VolumesListTestJSON-1720623972 None] Flow 'volume_create_manager' (5c69bc36-1112-4eb8-ae35-787fd21d2050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:16:15 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-45607ccc-2f2c-427f-9c3a-9b100e51c899 tempest-VolumesListTestJSON-1720623972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e604e145-1ac8-496c-b5ed-02e6dc9b19cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:16:15 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-45607ccc-2f2c-427f-9c3a-9b100e51c899 tempest-VolumesListTestJSON-1720623972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e604e145-1ac8-496c-b5ed-02e6dc9b19cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-666952388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=453e6922-eef5-4c80-be5b-5db0560ae163,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='add23d70b0dd4585a269b25dfe94e969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:16:15Z,use_quota=True,user_id='20cccffe125a4c939a8c133637fb058a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:16:15 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-45607ccc-2f2c-427f-9c3a-9b100e51c899 tempest-VolumesListTestJSON-1720623972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d93e0757-b5b3-49aa-8421-7e775b6bd2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:16:15 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-45607ccc-2f2c-427f-9c3a-9b100e51c899 tempest-VolumesListTestJSON-1720623972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d93e0757-b5b3-49aa-8421-7e775b6bd2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:16:15 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-45607ccc-2f2c-427f-9c3a-9b100e51c899 tempest-VolumesListTestJSON-1720623972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8cb6050-268c-4ace-9d7d-fed2969ce7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:16:15 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-45607ccc-2f2c-427f-9c3a-9b100e51c899 tempest-VolumesListTestJSON-1720623972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8cb6050-268c-4ace-9d7d-fed2969ce7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '453e6922-eef5-4c80-be5b-5db0560ae163', 'volume_name': 'volume-453e6922-eef5-4c80-be5b-5db0560ae163', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:16:15 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-45607ccc-2f2c-427f-9c3a-9b100e51c899 tempest-VolumesListTestJSON-1720623972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4167dd7c-dcc8-4f52-a789-422fe6ceabae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:16:15 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-45607ccc-2f2c-427f-9c3a-9b100e51c899 tempest-VolumesListTestJSON-1720623972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4167dd7c-dcc8-4f52-a789-422fe6ceabae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:16:15 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-45607ccc-2f2c-427f-9c3a-9b100e51c899 tempest-VolumesListTestJSON-1720623972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2005d81c-10fd-4731-9dda-dca60bb07347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:16:15 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-45607ccc-2f2c-427f-9c3a-9b100e51c899 tempest-VolumesListTestJSON-1720623972 None] Volume 453e6922-eef5-4c80-be5b-5db0560ae163: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-453e6922-eef5-4c80-be5b-5db0560ae163', 'volume_size': 1} Jun 24 05:16:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-45607ccc-2f2c-427f-9c3a-9b100e51c899 tempest-VolumesListTestJSON-1720623972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:16:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-45607ccc-2f2c-427f-9c3a-9b100e51c899 tempest-VolumesListTestJSON-1720623972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:16:15 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-45607ccc-2f2c-427f-9c3a-9b100e51c899 tempest-VolumesListTestJSON-1720623972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-666952388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=453e6922-eef5-4c80-be5b-5db0560ae163,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='add23d70b0dd4585a269b25dfe94e969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:16:15Z,use_quota=True,user_id='20cccffe125a4c939a8c133637fb058a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:16:15 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-45607ccc-2f2c-427f-9c3a-9b100e51c899 tempest-VolumesListTestJSON-1720623972 None] Creating volume 453e6922-eef5-4c80-be5b-5db0560ae163 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:16:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-45607ccc-2f2c-427f-9c3a-9b100e51c899 tempest-VolumesListTestJSON-1720623972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:16:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-45607ccc-2f2c-427f-9c3a-9b100e51c899 tempest-VolumesListTestJSON-1720623972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:16:15 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-45607ccc-2f2c-427f-9c3a-9b100e51c899 tempest-VolumesListTestJSON-1720623972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:16:15 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-45607ccc-2f2c-427f-9c3a-9b100e51c899 tempest-VolumesListTestJSON-1720623972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:16:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-45607ccc-2f2c-427f-9c3a-9b100e51c899 tempest-VolumesListTestJSON-1720623972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:16:15 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-45607ccc-2f2c-427f-9c3a-9b100e51c899 tempest-VolumesListTestJSON-1720623972 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:16:15 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-45607ccc-2f2c-427f-9c3a-9b100e51c899 tempest-VolumesListTestJSON-1720623972 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:16:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-45607ccc-2f2c-427f-9c3a-9b100e51c899 tempest-VolumesListTestJSON-1720623972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-453e6922-eef5-4c80-be5b-5db0560ae163 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:15 devstack sudo[111959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-453e6922-eef5-4c80-be5b-5db0560ae163 1073741824 Jun 24 05:16:15 devstack sudo[111959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:16 devstack sudo[111959]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-45607ccc-2f2c-427f-9c3a-9b100e51c899 tempest-VolumesListTestJSON-1720623972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-453e6922-eef5-4c80-be5b-5db0560ae163 1073741824" returned: 0 in 0.797s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-45607ccc-2f2c-427f-9c3a-9b100e51c899 tempest-VolumesListTestJSON-1720623972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-453e6922-eef5-4c80-be5b-5db0560ae163 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:16 devstack sudo[111965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-453e6922-eef5-4c80-be5b-5db0560ae163 Jun 24 05:16:16 devstack sudo[111965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:16 devstack sudo[111965]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-45607ccc-2f2c-427f-9c3a-9b100e51c899 tempest-VolumesListTestJSON-1720623972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-453e6922-eef5-4c80-be5b-5db0560ae163" returned: 0 in 0.631s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:16 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-45607ccc-2f2c-427f-9c3a-9b100e51c899 tempest-VolumesListTestJSON-1720623972 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:16:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-45607ccc-2f2c-427f-9c3a-9b100e51c899 tempest-VolumesListTestJSON-1720623972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.480s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:16:16 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-45607ccc-2f2c-427f-9c3a-9b100e51c899 tempest-VolumesListTestJSON-1720623972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2005d81c-10fd-4731-9dda-dca60bb07347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-453e6922-eef5-4c80-be5b-5db0560ae163', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:16:16 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-45607ccc-2f2c-427f-9c3a-9b100e51c899 tempest-VolumesListTestJSON-1720623972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28ae81e7-6c8e-47a9-9a28-14172d65fb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:16:16 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-45607ccc-2f2c-427f-9c3a-9b100e51c899 tempest-VolumesListTestJSON-1720623972 None] Volume volume-453e6922-eef5-4c80-be5b-5db0560ae163 (453e6922-eef5-4c80-be5b-5db0560ae163): created successfully Jun 24 05:16:16 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-45607ccc-2f2c-427f-9c3a-9b100e51c899 tempest-VolumesListTestJSON-1720623972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28ae81e7-6c8e-47a9-9a28-14172d65fb6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:16:16 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-45607ccc-2f2c-427f-9c3a-9b100e51c899 tempest-VolumesListTestJSON-1720623972 None] Flow 'volume_create_manager' (5c69bc36-1112-4eb8-ae35-787fd21d2050) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:16:16 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-45607ccc-2f2c-427f-9c3a-9b100e51c899 tempest-VolumesListTestJSON-1720623972 None] Created volume successfully. Jun 24 05:16:17 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-683fc5a6-c80f-42a1-a97d-3c6e70dcfe48 req-3a03c815-d552-4537-9f1c-f43946583f03 tempest-TestServerVolumeAttachmentScenario-644772180 None] Terminate volume connection completed successfully. Jun 24 05:16:17 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-683fc5a6-c80f-42a1-a97d-3c6e70dcfe48 req-3a03c815-d552-4537-9f1c-f43946583f03 tempest-TestServerVolumeAttachmentScenario-644772180 None] Deleting attachment abe6dddb-bb1b-4ac3-9890-54e1aa093e0b. {{(pid=93830) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 05:16:17 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-1770264d-d35c-4725-9cdf-e5176eccd3c5 tempest-VolumesListTestJSON-1720623972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:16:17 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1770264d-d35c-4725-9cdf-e5176eccd3c5 tempest-VolumesListTestJSON-1720623972 None] Flow 'volume_create_manager' (ae756803-23bb-4602-95a1-30a82aac97f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:16:17 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1770264d-d35c-4725-9cdf-e5176eccd3c5 tempest-VolumesListTestJSON-1720623972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bd289e4-b433-4c85-9f31-cb894c7b02f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:16:17 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1770264d-d35c-4725-9cdf-e5176eccd3c5 tempest-VolumesListTestJSON-1720623972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bd289e4-b433-4c85-9f31-cb894c7b02f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-260530850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70c05c9b-4062-4179-a5ef-f11c0d50daab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='add23d70b0dd4585a269b25dfe94e969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:16:18Z,use_quota=True,user_id='20cccffe125a4c939a8c133637fb058a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:16:17 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1770264d-d35c-4725-9cdf-e5176eccd3c5 tempest-VolumesListTestJSON-1720623972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b102d38-120b-4007-bbe5-34dc3b6e4882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:16:17 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1770264d-d35c-4725-9cdf-e5176eccd3c5 tempest-VolumesListTestJSON-1720623972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b102d38-120b-4007-bbe5-34dc3b6e4882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:16:17 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1770264d-d35c-4725-9cdf-e5176eccd3c5 tempest-VolumesListTestJSON-1720623972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a23dd59-3df2-4de0-90a6-c5791a5e3637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:16:17 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1770264d-d35c-4725-9cdf-e5176eccd3c5 tempest-VolumesListTestJSON-1720623972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a23dd59-3df2-4de0-90a6-c5791a5e3637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70c05c9b-4062-4179-a5ef-f11c0d50daab', 'volume_name': 'volume-70c05c9b-4062-4179-a5ef-f11c0d50daab', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:16:17 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1770264d-d35c-4725-9cdf-e5176eccd3c5 tempest-VolumesListTestJSON-1720623972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f9ee1dd-0d93-498d-ae71-6e4d3b291b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:16:17 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1770264d-d35c-4725-9cdf-e5176eccd3c5 tempest-VolumesListTestJSON-1720623972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f9ee1dd-0d93-498d-ae71-6e4d3b291b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:16:17 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1770264d-d35c-4725-9cdf-e5176eccd3c5 tempest-VolumesListTestJSON-1720623972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0414eb16-0340-47bd-8d19-05235d11b91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:16:17 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-1770264d-d35c-4725-9cdf-e5176eccd3c5 tempest-VolumesListTestJSON-1720623972 None] Volume 70c05c9b-4062-4179-a5ef-f11c0d50daab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70c05c9b-4062-4179-a5ef-f11c0d50daab', 'volume_size': 1} Jun 24 05:16:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1770264d-d35c-4725-9cdf-e5176eccd3c5 tempest-VolumesListTestJSON-1720623972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:16:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1770264d-d35c-4725-9cdf-e5176eccd3c5 tempest-VolumesListTestJSON-1720623972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:16:17 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-1770264d-d35c-4725-9cdf-e5176eccd3c5 tempest-VolumesListTestJSON-1720623972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-260530850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70c05c9b-4062-4179-a5ef-f11c0d50daab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='add23d70b0dd4585a269b25dfe94e969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:16:18Z,use_quota=True,user_id='20cccffe125a4c939a8c133637fb058a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:16:17 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-1770264d-d35c-4725-9cdf-e5176eccd3c5 tempest-VolumesListTestJSON-1720623972 None] Creating volume 70c05c9b-4062-4179-a5ef-f11c0d50daab {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:16:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1770264d-d35c-4725-9cdf-e5176eccd3c5 tempest-VolumesListTestJSON-1720623972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:16:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1770264d-d35c-4725-9cdf-e5176eccd3c5 tempest-VolumesListTestJSON-1720623972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:16:17 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-1770264d-d35c-4725-9cdf-e5176eccd3c5 tempest-VolumesListTestJSON-1720623972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:16:17 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-1770264d-d35c-4725-9cdf-e5176eccd3c5 tempest-VolumesListTestJSON-1720623972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:16:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1770264d-d35c-4725-9cdf-e5176eccd3c5 tempest-VolumesListTestJSON-1720623972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:16:17 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-1770264d-d35c-4725-9cdf-e5176eccd3c5 tempest-VolumesListTestJSON-1720623972 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:16:17 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-1770264d-d35c-4725-9cdf-e5176eccd3c5 tempest-VolumesListTestJSON-1720623972 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:16:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1770264d-d35c-4725-9cdf-e5176eccd3c5 tempest-VolumesListTestJSON-1720623972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-70c05c9b-4062-4179-a5ef-f11c0d50daab 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:17 devstack sudo[111974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-70c05c9b-4062-4179-a5ef-f11c0d50daab 1073741824 Jun 24 05:16:17 devstack sudo[111974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:18 devstack sudo[111974]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1770264d-d35c-4725-9cdf-e5176eccd3c5 tempest-VolumesListTestJSON-1720623972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-70c05c9b-4062-4179-a5ef-f11c0d50daab 1073741824" returned: 0 in 0.810s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1770264d-d35c-4725-9cdf-e5176eccd3c5 tempest-VolumesListTestJSON-1720623972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-70c05c9b-4062-4179-a5ef-f11c0d50daab {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:18 devstack sudo[111980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-70c05c9b-4062-4179-a5ef-f11c0d50daab Jun 24 05:16:18 devstack sudo[111980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:19 devstack sudo[111980]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1770264d-d35c-4725-9cdf-e5176eccd3c5 tempest-VolumesListTestJSON-1720623972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-70c05c9b-4062-4179-a5ef-f11c0d50daab" returned: 0 in 0.651s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:19 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-1770264d-d35c-4725-9cdf-e5176eccd3c5 tempest-VolumesListTestJSON-1720623972 None] <== create_volume: return (1533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:16:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1770264d-d35c-4725-9cdf-e5176eccd3c5 tempest-VolumesListTestJSON-1720623972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.536s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:16:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1770264d-d35c-4725-9cdf-e5176eccd3c5 tempest-VolumesListTestJSON-1720623972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0414eb16-0340-47bd-8d19-05235d11b91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70c05c9b-4062-4179-a5ef-f11c0d50daab', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:16:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1770264d-d35c-4725-9cdf-e5176eccd3c5 tempest-VolumesListTestJSON-1720623972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1906f66-5fd5-4ee0-b01e-683183e541d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:16:19 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-1770264d-d35c-4725-9cdf-e5176eccd3c5 tempest-VolumesListTestJSON-1720623972 None] Volume volume-70c05c9b-4062-4179-a5ef-f11c0d50daab (70c05c9b-4062-4179-a5ef-f11c0d50daab): created successfully Jun 24 05:16:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1770264d-d35c-4725-9cdf-e5176eccd3c5 tempest-VolumesListTestJSON-1720623972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1906f66-5fd5-4ee0-b01e-683183e541d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:16:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1770264d-d35c-4725-9cdf-e5176eccd3c5 tempest-VolumesListTestJSON-1720623972 None] Flow 'volume_create_manager' (ae756803-23bb-4602-95a1-30a82aac97f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:16:19 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-1770264d-d35c-4725-9cdf-e5176eccd3c5 tempest-VolumesListTestJSON-1720623972 None] Created volume successfully. Jun 24 05:16:20 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e6ab055-bacb-420e-81c2-3c3ea9893aa1 tempest-VolumesListTestJSON-1720623972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:16:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1e6ab055-bacb-420e-81c2-3c3ea9893aa1 tempest-VolumesListTestJSON-1720623972 None] Flow 'volume_create_manager' (a5e0e227-3802-45e6-af6d-c8b2ea549e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:16:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1e6ab055-bacb-420e-81c2-3c3ea9893aa1 tempest-VolumesListTestJSON-1720623972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a253ff1e-9540-4cc8-9d0a-c9ca1e7e95ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:16:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1e6ab055-bacb-420e-81c2-3c3ea9893aa1 tempest-VolumesListTestJSON-1720623972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a253ff1e-9540-4cc8-9d0a-c9ca1e7e95ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1075008786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9bc5079-e224-49d2-bd71-d8b646ea8575,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='add23d70b0dd4585a269b25dfe94e969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:16:20Z,use_quota=True,user_id='20cccffe125a4c939a8c133637fb058a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:16:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1e6ab055-bacb-420e-81c2-3c3ea9893aa1 tempest-VolumesListTestJSON-1720623972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2e530a2-fdce-4535-b610-cefb8f702b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:16:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1e6ab055-bacb-420e-81c2-3c3ea9893aa1 tempest-VolumesListTestJSON-1720623972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2e530a2-fdce-4535-b610-cefb8f702b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:16:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1e6ab055-bacb-420e-81c2-3c3ea9893aa1 tempest-VolumesListTestJSON-1720623972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19dcdd4b-5afd-44ec-a876-543bc634570b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:16:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1e6ab055-bacb-420e-81c2-3c3ea9893aa1 tempest-VolumesListTestJSON-1720623972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19dcdd4b-5afd-44ec-a876-543bc634570b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9bc5079-e224-49d2-bd71-d8b646ea8575', 'volume_name': 'volume-c9bc5079-e224-49d2-bd71-d8b646ea8575', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:16:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1e6ab055-bacb-420e-81c2-3c3ea9893aa1 tempest-VolumesListTestJSON-1720623972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79922434-1c0b-4962-a460-80ee9e96db62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:16:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1e6ab055-bacb-420e-81c2-3c3ea9893aa1 tempest-VolumesListTestJSON-1720623972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79922434-1c0b-4962-a460-80ee9e96db62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:16:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1e6ab055-bacb-420e-81c2-3c3ea9893aa1 tempest-VolumesListTestJSON-1720623972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5c47b6a-ed4e-4a62-a2f4-ce41f9f30db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:16:20 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-1e6ab055-bacb-420e-81c2-3c3ea9893aa1 tempest-VolumesListTestJSON-1720623972 None] Volume c9bc5079-e224-49d2-bd71-d8b646ea8575: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9bc5079-e224-49d2-bd71-d8b646ea8575', 'volume_size': 1} Jun 24 05:16:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1e6ab055-bacb-420e-81c2-3c3ea9893aa1 tempest-VolumesListTestJSON-1720623972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:16:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1e6ab055-bacb-420e-81c2-3c3ea9893aa1 tempest-VolumesListTestJSON-1720623972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:16:20 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-1e6ab055-bacb-420e-81c2-3c3ea9893aa1 tempest-VolumesListTestJSON-1720623972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1075008786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9bc5079-e224-49d2-bd71-d8b646ea8575,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='add23d70b0dd4585a269b25dfe94e969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:16:20Z,use_quota=True,user_id='20cccffe125a4c939a8c133637fb058a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:16:20 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-1e6ab055-bacb-420e-81c2-3c3ea9893aa1 tempest-VolumesListTestJSON-1720623972 None] Creating volume c9bc5079-e224-49d2-bd71-d8b646ea8575 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:16:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1e6ab055-bacb-420e-81c2-3c3ea9893aa1 tempest-VolumesListTestJSON-1720623972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:16:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1e6ab055-bacb-420e-81c2-3c3ea9893aa1 tempest-VolumesListTestJSON-1720623972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:16:20 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-1e6ab055-bacb-420e-81c2-3c3ea9893aa1 tempest-VolumesListTestJSON-1720623972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:16:20 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-1e6ab055-bacb-420e-81c2-3c3ea9893aa1 tempest-VolumesListTestJSON-1720623972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:16:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1e6ab055-bacb-420e-81c2-3c3ea9893aa1 tempest-VolumesListTestJSON-1720623972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:16:20 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-1e6ab055-bacb-420e-81c2-3c3ea9893aa1 tempest-VolumesListTestJSON-1720623972 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:16:20 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-1e6ab055-bacb-420e-81c2-3c3ea9893aa1 tempest-VolumesListTestJSON-1720623972 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:16:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1e6ab055-bacb-420e-81c2-3c3ea9893aa1 tempest-VolumesListTestJSON-1720623972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c9bc5079-e224-49d2-bd71-d8b646ea8575 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:20 devstack sudo[112014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c9bc5079-e224-49d2-bd71-d8b646ea8575 1073741824 Jun 24 05:16:20 devstack sudo[112014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:21 devstack sudo[112014]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1e6ab055-bacb-420e-81c2-3c3ea9893aa1 tempest-VolumesListTestJSON-1720623972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c9bc5079-e224-49d2-bd71-d8b646ea8575 1073741824" returned: 0 in 0.941s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1e6ab055-bacb-420e-81c2-3c3ea9893aa1 tempest-VolumesListTestJSON-1720623972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c9bc5079-e224-49d2-bd71-d8b646ea8575 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:21 devstack sudo[112036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c9bc5079-e224-49d2-bd71-d8b646ea8575 Jun 24 05:16:21 devstack sudo[112036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:22 devstack sudo[112036]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1e6ab055-bacb-420e-81c2-3c3ea9893aa1 tempest-VolumesListTestJSON-1720623972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c9bc5079-e224-49d2-bd71-d8b646ea8575" returned: 0 in 0.646s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:22 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-1e6ab055-bacb-420e-81c2-3c3ea9893aa1 tempest-VolumesListTestJSON-1720623972 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:16:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1e6ab055-bacb-420e-81c2-3c3ea9893aa1 tempest-VolumesListTestJSON-1720623972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:16:22 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1e6ab055-bacb-420e-81c2-3c3ea9893aa1 tempest-VolumesListTestJSON-1720623972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5c47b6a-ed4e-4a62-a2f4-ce41f9f30db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9bc5079-e224-49d2-bd71-d8b646ea8575', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:16:22 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1e6ab055-bacb-420e-81c2-3c3ea9893aa1 tempest-VolumesListTestJSON-1720623972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bab86a63-8e1f-4460-ad67-0fee8da78032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:16:22 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:UPDATE=56,cinder:DELETE=4,cinder:INSERT=10,cinder:SELECT=46 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:16:22 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-1e6ab055-bacb-420e-81c2-3c3ea9893aa1 tempest-VolumesListTestJSON-1720623972 None] Volume volume-c9bc5079-e224-49d2-bd71-d8b646ea8575 (c9bc5079-e224-49d2-bd71-d8b646ea8575): created successfully Jun 24 05:16:22 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1e6ab055-bacb-420e-81c2-3c3ea9893aa1 tempest-VolumesListTestJSON-1720623972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bab86a63-8e1f-4460-ad67-0fee8da78032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:16:22 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1e6ab055-bacb-420e-81c2-3c3ea9893aa1 tempest-VolumesListTestJSON-1720623972 None] Flow 'volume_create_manager' (a5e0e227-3802-45e6-af6d-c8b2ea549e8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:16:22 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-1e6ab055-bacb-420e-81c2-3c3ea9893aa1 tempest-VolumesListTestJSON-1720623972 None] Created volume successfully. Jun 24 05:16:24 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-1d834226-84ff-453c-8ab6-067f4fe07e46 tempest-VolumesListTestJSON-1720623972 None] Acquiring lock "cinder-c9bc5079-e224-49d2-bd71-d8b646ea8575-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:16:24 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-1d834226-84ff-453c-8ab6-067f4fe07e46 tempest-VolumesListTestJSON-1720623972 None] Lock "cinder-c9bc5079-e224-49d2-bd71-d8b646ea8575-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:16:24 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:SELECT=47,cinder:INSERT=11,cinder:UPDATE=43,cinder:DELETE=6 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:16:24 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-1d834226-84ff-453c-8ab6-067f4fe07e46 tempest-VolumesListTestJSON-1720623972 None] Acquiring lock "cinder-quobyte-c9bc5079-e224-49d2-bd71-d8b646ea8575" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:16:24 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-1d834226-84ff-453c-8ab6-067f4fe07e46 tempest-VolumesListTestJSON-1720623972 None] Lock "cinder-quobyte-c9bc5079-e224-49d2-bd71-d8b646ea8575" acquired by "delete_volume" :: waited 0.017s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:16:24 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec72882-5a58-45e8-a2ab-f68feb9bda66]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:16:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1d834226-84ff-453c-8ab6-067f4fe07e46 tempest-VolumesListTestJSON-1720623972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c9bc5079-e224-49d2-bd71-d8b646ea8575 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:24 devstack sudo[112043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c9bc5079-e224-49d2-bd71-d8b646ea8575 Jun 24 05:16:24 devstack sudo[112043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:25 devstack sudo[112043]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1d834226-84ff-453c-8ab6-067f4fe07e46 tempest-VolumesListTestJSON-1720623972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c9bc5079-e224-49d2-bd71-d8b646ea8575" returned: 0 in 0.803s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1d834226-84ff-453c-8ab6-067f4fe07e46 tempest-VolumesListTestJSON-1720623972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c9bc5079-e224-49d2-bd71-d8b646ea8575 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:25 devstack sudo[112050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c9bc5079-e224-49d2-bd71-d8b646ea8575 Jun 24 05:16:25 devstack sudo[112050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:26 devstack sudo[112050]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1d834226-84ff-453c-8ab6-067f4fe07e46 tempest-VolumesListTestJSON-1720623972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c9bc5079-e224-49d2-bd71-d8b646ea8575" returned: 0 in 0.664s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:26 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-1d834226-84ff-453c-8ab6-067f4fe07e46 tempest-VolumesListTestJSON-1720623972 None] Lock "cinder-quobyte-c9bc5079-e224-49d2-bd71-d8b646ea8575" released by "delete_volume" :: held 1.505s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:16:26 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-1d834226-84ff-453c-8ab6-067f4fe07e46 tempest-VolumesListTestJSON-1720623972 None] Created reservations ['bb5ba09e-fa5f-44f1-a4e8-e9b80724255f', '537ac696-314a-4d81-92d4-e021963fa6cb', 'b80ddb60-a9a0-4630-b50d-adc536441cc9', '196e07e2-4c3b-4f2f-9180-5e7486ae5971'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:16:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1d834226-84ff-453c-8ab6-067f4fe07e46 tempest-VolumesListTestJSON-1720623972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:16:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1d834226-84ff-453c-8ab6-067f4fe07e46 tempest-VolumesListTestJSON-1720623972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:16:26 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-1d834226-84ff-453c-8ab6-067f4fe07e46 tempest-VolumesListTestJSON-1720623972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:16:26 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-1d834226-84ff-453c-8ab6-067f4fe07e46 tempest-VolumesListTestJSON-1720623972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:16:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1d834226-84ff-453c-8ab6-067f4fe07e46 tempest-VolumesListTestJSON-1720623972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:16:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1d834226-84ff-453c-8ab6-067f4fe07e46 tempest-VolumesListTestJSON-1720623972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:26 devstack sudo[112053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:16:26 devstack sudo[112053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:26 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-89f9e3f8-a5bd-4d7e-b9ae-1a2e4fce5f8f tempest-VolumesListTestJSON-1720623972 None] Acquiring lock "cinder-70c05c9b-4062-4179-a5ef-f11c0d50daab-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:16:26 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-89f9e3f8-a5bd-4d7e-b9ae-1a2e4fce5f8f tempest-VolumesListTestJSON-1720623972 None] Lock "cinder-70c05c9b-4062-4179-a5ef-f11c0d50daab-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:16:26 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-89f9e3f8-a5bd-4d7e-b9ae-1a2e4fce5f8f tempest-VolumesListTestJSON-1720623972 None] Acquiring lock "cinder-quobyte-70c05c9b-4062-4179-a5ef-f11c0d50daab" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:16:26 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-89f9e3f8-a5bd-4d7e-b9ae-1a2e4fce5f8f tempest-VolumesListTestJSON-1720623972 None] Lock "cinder-quobyte-70c05c9b-4062-4179-a5ef-f11c0d50daab" acquired by "delete_volume" :: waited 0.019s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:16:26 devstack sudo[112053]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1d834226-84ff-453c-8ab6-067f4fe07e46 tempest-VolumesListTestJSON-1720623972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.708s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:26 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-1d834226-84ff-453c-8ab6-067f4fe07e46 tempest-VolumesListTestJSON-1720623972 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:16:26 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-1d834226-84ff-453c-8ab6-067f4fe07e46 tempest-VolumesListTestJSON-1720623972 None] Deleted volume successfully. Jun 24 05:16:26 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[59dd4546-a3bd-42cd-900c-fc0986672b99]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:16:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-89f9e3f8-a5bd-4d7e-b9ae-1a2e4fce5f8f tempest-VolumesListTestJSON-1720623972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-70c05c9b-4062-4179-a5ef-f11c0d50daab {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:26 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-1d834226-84ff-453c-8ab6-067f4fe07e46 tempest-VolumesListTestJSON-1720623972 None] Lock "cinder-c9bc5079-e224-49d2-bd71-d8b646ea8575-delete_volume" released by "delete_volume" :: held 2.441s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:16:27 devstack sudo[112056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-70c05c9b-4062-4179-a5ef-f11c0d50daab Jun 24 05:16:27 devstack sudo[112056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:27 devstack sudo[112056]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-89f9e3f8-a5bd-4d7e-b9ae-1a2e4fce5f8f tempest-VolumesListTestJSON-1720623972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-70c05c9b-4062-4179-a5ef-f11c0d50daab" returned: 0 in 0.826s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-89f9e3f8-a5bd-4d7e-b9ae-1a2e4fce5f8f tempest-VolumesListTestJSON-1720623972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-70c05c9b-4062-4179-a5ef-f11c0d50daab {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:27 devstack sudo[112061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-70c05c9b-4062-4179-a5ef-f11c0d50daab Jun 24 05:16:27 devstack sudo[112061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:27 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-dde4a34a-8c34-4251-ae9e-1776cda18a0d tempest-TestServerVolumeAttachmentScenario-644772180 None] Acquiring lock "cinder-bb2f83dd-8f69-433d-aa35-a17e96ad097c-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:16:27 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-dde4a34a-8c34-4251-ae9e-1776cda18a0d tempest-TestServerVolumeAttachmentScenario-644772180 None] Lock "cinder-bb2f83dd-8f69-433d-aa35-a17e96ad097c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:16:27 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-dde4a34a-8c34-4251-ae9e-1776cda18a0d tempest-TestServerVolumeAttachmentScenario-644772180 None] Acquiring lock "cinder-quobyte-bb2f83dd-8f69-433d-aa35-a17e96ad097c" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:16:27 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-dde4a34a-8c34-4251-ae9e-1776cda18a0d tempest-TestServerVolumeAttachmentScenario-644772180 None] Lock "cinder-quobyte-bb2f83dd-8f69-433d-aa35-a17e96ad097c" acquired by "delete_volume" :: waited 0.018s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:16:27 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[44422f0d-2a71-444b-a566-9ffa3dd4e79d]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:16:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dde4a34a-8c34-4251-ae9e-1776cda18a0d tempest-TestServerVolumeAttachmentScenario-644772180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bb2f83dd-8f69-433d-aa35-a17e96ad097c {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:28 devstack sudo[112063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bb2f83dd-8f69-433d-aa35-a17e96ad097c Jun 24 05:16:28 devstack sudo[112063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:28 devstack sudo[112061]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-89f9e3f8-a5bd-4d7e-b9ae-1a2e4fce5f8f tempest-VolumesListTestJSON-1720623972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-70c05c9b-4062-4179-a5ef-f11c0d50daab" returned: 0 in 0.711s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:28 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-89f9e3f8-a5bd-4d7e-b9ae-1a2e4fce5f8f tempest-VolumesListTestJSON-1720623972 None] Lock "cinder-quobyte-70c05c9b-4062-4179-a5ef-f11c0d50daab" released by "delete_volume" :: held 1.598s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:16:28 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-89f9e3f8-a5bd-4d7e-b9ae-1a2e4fce5f8f tempest-VolumesListTestJSON-1720623972 None] Created reservations ['22d3b7ce-1b01-4843-9cd5-6c04c8f99f6a', '115ebf6d-d2a0-4190-89e9-e93573a532eb', '0e180e6a-afb9-4b5d-ba69-5437801b7631', '44b3e745-eec5-429f-bbc5-7d40d7b9ace7'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:16:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-89f9e3f8-a5bd-4d7e-b9ae-1a2e4fce5f8f tempest-VolumesListTestJSON-1720623972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:16:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-89f9e3f8-a5bd-4d7e-b9ae-1a2e4fce5f8f tempest-VolumesListTestJSON-1720623972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:16:28 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-89f9e3f8-a5bd-4d7e-b9ae-1a2e4fce5f8f tempest-VolumesListTestJSON-1720623972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:16:28 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-89f9e3f8-a5bd-4d7e-b9ae-1a2e4fce5f8f tempest-VolumesListTestJSON-1720623972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:16:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-89f9e3f8-a5bd-4d7e-b9ae-1a2e4fce5f8f tempest-VolumesListTestJSON-1720623972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:16:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-89f9e3f8-a5bd-4d7e-b9ae-1a2e4fce5f8f tempest-VolumesListTestJSON-1720623972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:28 devstack sudo[112066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:16:28 devstack sudo[112066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:28 devstack sudo[112063]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dde4a34a-8c34-4251-ae9e-1776cda18a0d tempest-TestServerVolumeAttachmentScenario-644772180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bb2f83dd-8f69-433d-aa35-a17e96ad097c" returned: 0 in 0.762s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dde4a34a-8c34-4251-ae9e-1776cda18a0d tempest-TestServerVolumeAttachmentScenario-644772180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bb2f83dd-8f69-433d-aa35-a17e96ad097c {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:28 devstack sudo[112071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bb2f83dd-8f69-433d-aa35-a17e96ad097c Jun 24 05:16:28 devstack sudo[112071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:29 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-fb518b8f-037a-4393-aa6d-7dcf24cdb207 tempest-VolumesListTestJSON-1720623972 None] Acquiring lock "cinder-453e6922-eef5-4c80-be5b-5db0560ae163-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:16:29 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-fb518b8f-037a-4393-aa6d-7dcf24cdb207 tempest-VolumesListTestJSON-1720623972 None] Lock "cinder-453e6922-eef5-4c80-be5b-5db0560ae163-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:16:29 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-fb518b8f-037a-4393-aa6d-7dcf24cdb207 tempest-VolumesListTestJSON-1720623972 None] Acquiring lock "cinder-quobyte-453e6922-eef5-4c80-be5b-5db0560ae163" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:16:29 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-fb518b8f-037a-4393-aa6d-7dcf24cdb207 tempest-VolumesListTestJSON-1720623972 None] Lock "cinder-quobyte-453e6922-eef5-4c80-be5b-5db0560ae163" acquired by "delete_volume" :: waited 0.016s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:16:29 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[310b234d-4bc4-4db1-aa56-59175b5a0013]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:16:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fb518b8f-037a-4393-aa6d-7dcf24cdb207 tempest-VolumesListTestJSON-1720623972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-453e6922-eef5-4c80-be5b-5db0560ae163 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:29 devstack sudo[112066]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-89f9e3f8-a5bd-4d7e-b9ae-1a2e4fce5f8f tempest-VolumesListTestJSON-1720623972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.677s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:29 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-89f9e3f8-a5bd-4d7e-b9ae-1a2e4fce5f8f tempest-VolumesListTestJSON-1720623972 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:16:29 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-89f9e3f8-a5bd-4d7e-b9ae-1a2e4fce5f8f tempest-VolumesListTestJSON-1720623972 None] Deleted volume successfully. Jun 24 05:16:29 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-89f9e3f8-a5bd-4d7e-b9ae-1a2e4fce5f8f tempest-VolumesListTestJSON-1720623972 None] Lock "cinder-70c05c9b-4062-4179-a5ef-f11c0d50daab-delete_volume" released by "delete_volume" :: held 2.495s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:16:29 devstack sudo[112074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-453e6922-eef5-4c80-be5b-5db0560ae163 Jun 24 05:16:29 devstack sudo[112074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:29 devstack sudo[112071]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dde4a34a-8c34-4251-ae9e-1776cda18a0d tempest-TestServerVolumeAttachmentScenario-644772180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-bb2f83dd-8f69-433d-aa35-a17e96ad097c" returned: 0 in 0.717s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:29 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-dde4a34a-8c34-4251-ae9e-1776cda18a0d tempest-TestServerVolumeAttachmentScenario-644772180 None] Lock "cinder-quobyte-bb2f83dd-8f69-433d-aa35-a17e96ad097c" released by "delete_volume" :: held 1.523s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:16:29 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-dde4a34a-8c34-4251-ae9e-1776cda18a0d tempest-TestServerVolumeAttachmentScenario-644772180 None] Created reservations ['f1e6e54a-e61f-4b89-abf7-9c3929971838', 'e4199601-ad8d-4e25-b109-563eff5a4b5d', 'a3febf99-c0d2-47b1-80c6-b1f5d6dd92d1', '3c0b422f-a483-4dba-9497-7ff2492001da'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:16:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-dde4a34a-8c34-4251-ae9e-1776cda18a0d tempest-TestServerVolumeAttachmentScenario-644772180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:16:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-dde4a34a-8c34-4251-ae9e-1776cda18a0d tempest-TestServerVolumeAttachmentScenario-644772180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:16:29 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-dde4a34a-8c34-4251-ae9e-1776cda18a0d tempest-TestServerVolumeAttachmentScenario-644772180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:16:29 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-dde4a34a-8c34-4251-ae9e-1776cda18a0d tempest-TestServerVolumeAttachmentScenario-644772180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:16:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-dde4a34a-8c34-4251-ae9e-1776cda18a0d tempest-TestServerVolumeAttachmentScenario-644772180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:16:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dde4a34a-8c34-4251-ae9e-1776cda18a0d tempest-TestServerVolumeAttachmentScenario-644772180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:29 devstack sudo[112077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:16:29 devstack sudo[112077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:29 devstack sudo[112074]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fb518b8f-037a-4393-aa6d-7dcf24cdb207 tempest-VolumesListTestJSON-1720623972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-453e6922-eef5-4c80-be5b-5db0560ae163" returned: 0 in 0.764s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fb518b8f-037a-4393-aa6d-7dcf24cdb207 tempest-VolumesListTestJSON-1720623972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-453e6922-eef5-4c80-be5b-5db0560ae163 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:30 devstack sudo[112082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-453e6922-eef5-4c80-be5b-5db0560ae163 Jun 24 05:16:30 devstack sudo[112082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:30 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-7ddbffd2-8371-4264-9552-f729024592af tempest-TestServerVolumeAttachmentScenario-644772180 None] Acquiring lock "cinder-75d787cf-9926-4a8a-a4f7-4f068eb2e358-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:16:30 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-7ddbffd2-8371-4264-9552-f729024592af tempest-TestServerVolumeAttachmentScenario-644772180 None] Lock "cinder-75d787cf-9926-4a8a-a4f7-4f068eb2e358-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:16:30 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-7ddbffd2-8371-4264-9552-f729024592af tempest-TestServerVolumeAttachmentScenario-644772180 None] Acquiring lock "cinder-quobyte-75d787cf-9926-4a8a-a4f7-4f068eb2e358" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:16:30 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-7ddbffd2-8371-4264-9552-f729024592af tempest-TestServerVolumeAttachmentScenario-644772180 None] Lock "cinder-quobyte-75d787cf-9926-4a8a-a4f7-4f068eb2e358" acquired by "delete_volume" :: waited 0.019s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:16:30 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf24545-e34f-43de-87ce-2f770536e2c5]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:16:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7ddbffd2-8371-4264-9552-f729024592af tempest-TestServerVolumeAttachmentScenario-644772180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-75d787cf-9926-4a8a-a4f7-4f068eb2e358 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:30 devstack sudo[112077]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dde4a34a-8c34-4251-ae9e-1776cda18a0d tempest-TestServerVolumeAttachmentScenario-644772180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.701s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:30 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-dde4a34a-8c34-4251-ae9e-1776cda18a0d tempest-TestServerVolumeAttachmentScenario-644772180 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:16:30 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-dde4a34a-8c34-4251-ae9e-1776cda18a0d tempest-TestServerVolumeAttachmentScenario-644772180 None] Deleted volume successfully. Jun 24 05:16:30 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-dde4a34a-8c34-4251-ae9e-1776cda18a0d tempest-TestServerVolumeAttachmentScenario-644772180 None] Lock "cinder-bb2f83dd-8f69-433d-aa35-a17e96ad097c-delete_volume" released by "delete_volume" :: held 2.442s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:16:30 devstack sudo[112085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-75d787cf-9926-4a8a-a4f7-4f068eb2e358 Jun 24 05:16:30 devstack sudo[112085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:30 devstack sudo[112082]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fb518b8f-037a-4393-aa6d-7dcf24cdb207 tempest-VolumesListTestJSON-1720623972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-453e6922-eef5-4c80-be5b-5db0560ae163" returned: 0 in 0.740s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:30 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-fb518b8f-037a-4393-aa6d-7dcf24cdb207 tempest-VolumesListTestJSON-1720623972 None] Lock "cinder-quobyte-453e6922-eef5-4c80-be5b-5db0560ae163" released by "delete_volume" :: held 1.548s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:16:30 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-fb518b8f-037a-4393-aa6d-7dcf24cdb207 tempest-VolumesListTestJSON-1720623972 None] Created reservations ['37e6da74-b173-4f8a-acc7-c767f18486c0', 'db2e35ad-bf79-4331-a405-60d11310a2bc', '5859f8f8-385d-409b-83e0-6120964dad62', 'a944f0bb-3e9e-491b-9fac-f48e3b74e0c2'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:16:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fb518b8f-037a-4393-aa6d-7dcf24cdb207 tempest-VolumesListTestJSON-1720623972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:16:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fb518b8f-037a-4393-aa6d-7dcf24cdb207 tempest-VolumesListTestJSON-1720623972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:16:30 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-fb518b8f-037a-4393-aa6d-7dcf24cdb207 tempest-VolumesListTestJSON-1720623972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:16:30 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-fb518b8f-037a-4393-aa6d-7dcf24cdb207 tempest-VolumesListTestJSON-1720623972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:16:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fb518b8f-037a-4393-aa6d-7dcf24cdb207 tempest-VolumesListTestJSON-1720623972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:16:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fb518b8f-037a-4393-aa6d-7dcf24cdb207 tempest-VolumesListTestJSON-1720623972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:30 devstack sudo[112089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:16:30 devstack sudo[112089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:31 devstack sudo[112085]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7ddbffd2-8371-4264-9552-f729024592af tempest-TestServerVolumeAttachmentScenario-644772180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-75d787cf-9926-4a8a-a4f7-4f068eb2e358" returned: 0 in 0.815s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7ddbffd2-8371-4264-9552-f729024592af tempest-TestServerVolumeAttachmentScenario-644772180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-75d787cf-9926-4a8a-a4f7-4f068eb2e358 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:31 devstack sudo[112094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-75d787cf-9926-4a8a-a4f7-4f068eb2e358 Jun 24 05:16:31 devstack sudo[112094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:31 devstack sudo[112089]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fb518b8f-037a-4393-aa6d-7dcf24cdb207 tempest-VolumesListTestJSON-1720623972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.689s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:31 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-fb518b8f-037a-4393-aa6d-7dcf24cdb207 tempest-VolumesListTestJSON-1720623972 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:16:31 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-fb518b8f-037a-4393-aa6d-7dcf24cdb207 tempest-VolumesListTestJSON-1720623972 None] Deleted volume successfully. Jun 24 05:16:31 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-fb518b8f-037a-4393-aa6d-7dcf24cdb207 tempest-VolumesListTestJSON-1720623972 None] Lock "cinder-453e6922-eef5-4c80-be5b-5db0560ae163-delete_volume" released by "delete_volume" :: held 2.459s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:16:31 devstack sudo[112094]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7ddbffd2-8371-4264-9552-f729024592af tempest-TestServerVolumeAttachmentScenario-644772180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-75d787cf-9926-4a8a-a4f7-4f068eb2e358" returned: 0 in 0.659s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:31 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-7ddbffd2-8371-4264-9552-f729024592af tempest-TestServerVolumeAttachmentScenario-644772180 None] Lock "cinder-quobyte-75d787cf-9926-4a8a-a4f7-4f068eb2e358" released by "delete_volume" :: held 1.523s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:16:31 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-7ddbffd2-8371-4264-9552-f729024592af tempest-TestServerVolumeAttachmentScenario-644772180 None] Created reservations ['fce3058c-811b-42f1-a6b5-76a8004d64e9', 'ea832a70-4d30-4d4e-8553-0ef058bab0e6', '5bd98df3-e436-4ca3-9c72-bfbbe1f594bd', '4ca4dad5-1a8e-4182-90e4-58eaa1485cf9'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:16:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7ddbffd2-8371-4264-9552-f729024592af tempest-TestServerVolumeAttachmentScenario-644772180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:16:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7ddbffd2-8371-4264-9552-f729024592af tempest-TestServerVolumeAttachmentScenario-644772180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:16:31 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7ddbffd2-8371-4264-9552-f729024592af tempest-TestServerVolumeAttachmentScenario-644772180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:16:31 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7ddbffd2-8371-4264-9552-f729024592af tempest-TestServerVolumeAttachmentScenario-644772180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:16:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7ddbffd2-8371-4264-9552-f729024592af tempest-TestServerVolumeAttachmentScenario-644772180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:16:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7ddbffd2-8371-4264-9552-f729024592af tempest-TestServerVolumeAttachmentScenario-644772180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:31 devstack sudo[112098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:16:31 devstack sudo[112098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:32 devstack sudo[112098]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7ddbffd2-8371-4264-9552-f729024592af tempest-TestServerVolumeAttachmentScenario-644772180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.692s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:32 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-7ddbffd2-8371-4264-9552-f729024592af tempest-TestServerVolumeAttachmentScenario-644772180 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:16:32 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-7ddbffd2-8371-4264-9552-f729024592af tempest-TestServerVolumeAttachmentScenario-644772180 None] Deleted volume successfully. Jun 24 05:16:32 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-7ddbffd2-8371-4264-9552-f729024592af tempest-TestServerVolumeAttachmentScenario-644772180 None] Lock "cinder-75d787cf-9926-4a8a-a4f7-4f068eb2e358-delete_volume" released by "delete_volume" :: held 2.432s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:16:41 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:SELECT=22,cinder:INSERT=12,cinder:UPDATE=44,cinder:DELETE=2 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:16:42 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:UPDATE=37,cinder:SELECT=27,cinder:INSERT=8,cinder:DELETE=3 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:16:43 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dffad65-f9c9-492a-80e3-69c778dd1d97 tempest-VolumesSnapshotTestJSON-268858105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:16:43 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8dffad65-f9c9-492a-80e3-69c778dd1d97 tempest-VolumesSnapshotTestJSON-268858105 None] Flow 'volume_create_manager' (4df9fb52-d76a-43c5-a43e-a014a0a3805d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:16:43 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8dffad65-f9c9-492a-80e3-69c778dd1d97 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d497ef7a-06e5-489d-a884-4070b74162f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:16:43 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8dffad65-f9c9-492a-80e3-69c778dd1d97 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d497ef7a-06e5-489d-a884-4070b74162f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-105853796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0d01c73-e94e-4d71-be79-e47ce3a94994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='390db83f169841879138cce76379638a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:16:44Z,use_quota=True,user_id='3a06fbd7a84145c29954cf3e37281e88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:16:43 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8dffad65-f9c9-492a-80e3-69c778dd1d97 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51464067-96d9-4c09-9554-8f94e1d2ec76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:16:43 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8dffad65-f9c9-492a-80e3-69c778dd1d97 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51464067-96d9-4c09-9554-8f94e1d2ec76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:16:43 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8dffad65-f9c9-492a-80e3-69c778dd1d97 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a99125c3-6f25-4113-9a97-340dc3485e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:16:43 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8dffad65-f9c9-492a-80e3-69c778dd1d97 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a99125c3-6f25-4113-9a97-340dc3485e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0d01c73-e94e-4d71-be79-e47ce3a94994', 'volume_name': 'volume-c0d01c73-e94e-4d71-be79-e47ce3a94994', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:16:43 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8dffad65-f9c9-492a-80e3-69c778dd1d97 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2feb118-5fea-4723-ac80-c961ecb05f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:16:43 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8dffad65-f9c9-492a-80e3-69c778dd1d97 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2feb118-5fea-4723-ac80-c961ecb05f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:16:43 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8dffad65-f9c9-492a-80e3-69c778dd1d97 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (594a955e-ff36-4b1c-be99-c2f777f2c6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:16:43 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-8dffad65-f9c9-492a-80e3-69c778dd1d97 tempest-VolumesSnapshotTestJSON-268858105 None] Volume c0d01c73-e94e-4d71-be79-e47ce3a94994: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0d01c73-e94e-4d71-be79-e47ce3a94994', 'volume_size': 1} Jun 24 05:16:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-8dffad65-f9c9-492a-80e3-69c778dd1d97 tempest-VolumesSnapshotTestJSON-268858105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:16:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-8dffad65-f9c9-492a-80e3-69c778dd1d97 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:16:43 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-8dffad65-f9c9-492a-80e3-69c778dd1d97 tempest-VolumesSnapshotTestJSON-268858105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-105853796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0d01c73-e94e-4d71-be79-e47ce3a94994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='390db83f169841879138cce76379638a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:16:44Z,use_quota=True,user_id='3a06fbd7a84145c29954cf3e37281e88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:16:43 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-8dffad65-f9c9-492a-80e3-69c778dd1d97 tempest-VolumesSnapshotTestJSON-268858105 None] Creating volume c0d01c73-e94e-4d71-be79-e47ce3a94994 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:16:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-8dffad65-f9c9-492a-80e3-69c778dd1d97 tempest-VolumesSnapshotTestJSON-268858105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:16:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-8dffad65-f9c9-492a-80e3-69c778dd1d97 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:16:43 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-8dffad65-f9c9-492a-80e3-69c778dd1d97 tempest-VolumesSnapshotTestJSON-268858105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:16:43 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-8dffad65-f9c9-492a-80e3-69c778dd1d97 tempest-VolumesSnapshotTestJSON-268858105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:16:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-8dffad65-f9c9-492a-80e3-69c778dd1d97 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:16:43 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-8dffad65-f9c9-492a-80e3-69c778dd1d97 tempest-VolumesSnapshotTestJSON-268858105 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:16:43 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-8dffad65-f9c9-492a-80e3-69c778dd1d97 tempest-VolumesSnapshotTestJSON-268858105 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:16:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8dffad65-f9c9-492a-80e3-69c778dd1d97 tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:43 devstack sudo[112144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994 1073741824 Jun 24 05:16:43 devstack sudo[112144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:44 devstack sudo[112144]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8dffad65-f9c9-492a-80e3-69c778dd1d97 tempest-VolumesSnapshotTestJSON-268858105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994 1073741824" returned: 0 in 0.874s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8dffad65-f9c9-492a-80e3-69c778dd1d97 tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:44 devstack sudo[112154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994 Jun 24 05:16:44 devstack sudo[112154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:45 devstack sudo[112154]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8dffad65-f9c9-492a-80e3-69c778dd1d97 tempest-VolumesSnapshotTestJSON-268858105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994" returned: 0 in 0.649s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:45 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-8dffad65-f9c9-492a-80e3-69c778dd1d97 tempest-VolumesSnapshotTestJSON-268858105 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:16:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-8dffad65-f9c9-492a-80e3-69c778dd1d97 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:16:45 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8dffad65-f9c9-492a-80e3-69c778dd1d97 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (594a955e-ff36-4b1c-be99-c2f777f2c6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0d01c73-e94e-4d71-be79-e47ce3a94994', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:16:45 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8dffad65-f9c9-492a-80e3-69c778dd1d97 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60f70912-9546-4919-9b46-f6c4bfa69b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:16:45 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-8dffad65-f9c9-492a-80e3-69c778dd1d97 tempest-VolumesSnapshotTestJSON-268858105 None] Volume volume-c0d01c73-e94e-4d71-be79-e47ce3a94994 (c0d01c73-e94e-4d71-be79-e47ce3a94994): created successfully Jun 24 05:16:45 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8dffad65-f9c9-492a-80e3-69c778dd1d97 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60f70912-9546-4919-9b46-f6c4bfa69b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:16:45 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8dffad65-f9c9-492a-80e3-69c778dd1d97 tempest-VolumesSnapshotTestJSON-268858105 None] Flow 'volume_create_manager' (4df9fb52-d76a-43c5-a43e-a014a0a3805d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:16:45 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-8dffad65-f9c9-492a-80e3-69c778dd1d97 tempest-VolumesSnapshotTestJSON-268858105 None] Created volume successfully. Jun 24 05:16:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-d28334f6-e84d-4f57-ae54-87cdb1a16c2b tempest-VolumesSnapshotTestJSON-268858105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:16:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-d28334f6-e84d-4f57-ae54-87cdb1a16c2b tempest-VolumesSnapshotTestJSON-268858105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:16:46 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-d28334f6-e84d-4f57-ae54-87cdb1a16c2b tempest-VolumesSnapshotTestJSON-268858105 None] Creating offline snapshot 9c90a86e-fe3f-461f-941a-a14a2de65c51 of volume c0d01c73-e94e-4d71-be79-e47ce3a94994 {{(pid=93830) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 05:16:46 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[3461824f-ba48-4caf-80e3-58dd3a45e214]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:16:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d28334f6-e84d-4f57-ae54-87cdb1a16c2b tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:46 devstack sudo[112158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994 Jun 24 05:16:46 devstack sudo[112158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:46 devstack sudo[112158]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d28334f6-e84d-4f57-ae54-87cdb1a16c2b tempest-VolumesSnapshotTestJSON-268858105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994" returned: 0 in 0.788s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d28334f6-e84d-4f57-ae54-87cdb1a16c2b tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994.9c90a86e-fe3f-461f-941a-a14a2de65c51 1G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:46 devstack sudo[112163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994.9c90a86e-fe3f-461f-941a-a14a2de65c51 1G Jun 24 05:16:46 devstack sudo[112163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:47 devstack sudo[112163]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d28334f6-e84d-4f57-ae54-87cdb1a16c2b tempest-VolumesSnapshotTestJSON-268858105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994.9c90a86e-fe3f-461f-941a-a14a2de65c51 1G" returned: 0 in 0.847s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d28334f6-e84d-4f57-ae54-87cdb1a16c2b tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0d01c73-e94e-4d71-be79-e47ce3a94994 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994.9c90a86e-fe3f-461f-941a-a14a2de65c51 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:47 devstack sudo[112168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0d01c73-e94e-4d71-be79-e47ce3a94994 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994.9c90a86e-fe3f-461f-941a-a14a2de65c51 Jun 24 05:16:47 devstack sudo[112168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:48 devstack sudo[112168]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d28334f6-e84d-4f57-ae54-87cdb1a16c2b tempest-VolumesSnapshotTestJSON-268858105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0d01c73-e94e-4d71-be79-e47ce3a94994 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994.9c90a86e-fe3f-461f-941a-a14a2de65c51" returned: 0 in 0.718s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:48 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-d28334f6-e84d-4f57-ae54-87cdb1a16c2b tempest-VolumesSnapshotTestJSON-268858105 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994.9c90a86e-fe3f-461f-941a-a14a2de65c51 is being set with open permissions: ugo+rw Jun 24 05:16:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d28334f6-e84d-4f57-ae54-87cdb1a16c2b tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994.9c90a86e-fe3f-461f-941a-a14a2de65c51 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:48 devstack sudo[112173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994.9c90a86e-fe3f-461f-941a-a14a2de65c51 Jun 24 05:16:48 devstack sudo[112173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:49 devstack sudo[112173]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d28334f6-e84d-4f57-ae54-87cdb1a16c2b tempest-VolumesSnapshotTestJSON-268858105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994.9c90a86e-fe3f-461f-941a-a14a2de65c51" returned: 0 in 0.665s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d28334f6-e84d-4f57-ae54-87cdb1a16c2b tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:49 devstack sudo[112176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994.info Jun 24 05:16:49 devstack sudo[112176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:50 devstack sudo[112176]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d28334f6-e84d-4f57-ae54-87cdb1a16c2b tempest-VolumesSnapshotTestJSON-268858105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994.info" returned: 0 in 0.797s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:50 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-d28334f6-e84d-4f57-ae54-87cdb1a16c2b tempest-VolumesSnapshotTestJSON-268858105 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994.info is being set with open permissions: ugo+rw Jun 24 05:16:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d28334f6-e84d-4f57-ae54-87cdb1a16c2b tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:50 devstack sudo[112179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994.info Jun 24 05:16:50 devstack sudo[112179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:50 devstack sudo[112179]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d28334f6-e84d-4f57-ae54-87cdb1a16c2b tempest-VolumesSnapshotTestJSON-268858105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994.info" returned: 0 in 0.663s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-d28334f6-e84d-4f57-ae54-87cdb1a16c2b tempest-VolumesSnapshotTestJSON-268858105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.578s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:16:50 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-d28334f6-e84d-4f57-ae54-87cdb1a16c2b tempest-VolumesSnapshotTestJSON-268858105 None] Create snapshot completed successfully Jun 24 05:16:51 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a54fd076-2c4c-4741-9c54-47850251db68 tempest-VolumesSnapshotTestJSON-268858105 None] Acquiring lock "cinder-9c90a86e-fe3f-461f-941a-a14a2de65c51-delete_snapshot" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:16:51 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a54fd076-2c4c-4741-9c54-47850251db68 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "cinder-9c90a86e-fe3f-461f-941a-a14a2de65c51-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:16:51 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a54fd076-2c4c-4741-9c54-47850251db68 tempest-VolumesSnapshotTestJSON-268858105 None] Acquiring lock "cinder-quobyte-c0d01c73-e94e-4d71-be79-e47ce3a94994" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:16:51 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a54fd076-2c4c-4741-9c54-47850251db68 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "cinder-quobyte-c0d01c73-e94e-4d71-be79-e47ce3a94994" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:16:51 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a54fd076-2c4c-4741-9c54-47850251db68 tempest-VolumesSnapshotTestJSON-268858105 None] Acquiring lock "cinder-quobyte-9c90a86e-fe3f-461f-941a-a14a2de65c51" by "_delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:16:51 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a54fd076-2c4c-4741-9c54-47850251db68 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "cinder-quobyte-9c90a86e-fe3f-461f-941a-a14a2de65c51" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:16:51 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-a54fd076-2c4c-4741-9c54-47850251db68 tempest-VolumesSnapshotTestJSON-268858105 None] Deleting offline snapshot 9c90a86e-fe3f-461f-941a-a14a2de65c51 of volume c0d01c73-e94e-4d71-be79-e47ce3a94994 {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 05:16:51 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-a54fd076-2c4c-4741-9c54-47850251db68 tempest-VolumesSnapshotTestJSON-268858105 None] snapshot_file for this snap is: volume-c0d01c73-e94e-4d71-be79-e47ce3a94994.9c90a86e-fe3f-461f-941a-a14a2de65c51 {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 05:16:51 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[517d1e39-f8ee-49b1-9751-1e648bfd1d4e]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:16:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a54fd076-2c4c-4741-9c54-47850251db68 tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994.9c90a86e-fe3f-461f-941a-a14a2de65c51 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:51 devstack sudo[112183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994.9c90a86e-fe3f-461f-941a-a14a2de65c51 Jun 24 05:16:51 devstack sudo[112183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:52 devstack sudo[112183]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a54fd076-2c4c-4741-9c54-47850251db68 tempest-VolumesSnapshotTestJSON-268858105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994.9c90a86e-fe3f-461f-941a-a14a2de65c51" returned: 0 in 0.839s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:52 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-a54fd076-2c4c-4741-9c54-47850251db68 tempest-VolumesSnapshotTestJSON-268858105 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0d01c73-e94e-4d71-be79-e47ce3a94994(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:16:52 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d900740-fa2b-4c0b-be00-b3b679ef6c04]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:16:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a54fd076-2c4c-4741-9c54-47850251db68 tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:52 devstack sudo[112188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994 Jun 24 05:16:52 devstack sudo[112188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:53 devstack sudo[112188]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a54fd076-2c4c-4741-9c54-47850251db68 tempest-VolumesSnapshotTestJSON-268858105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994" returned: 0 in 0.793s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a54fd076-2c4c-4741-9c54-47850251db68 tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994.9c90a86e-fe3f-461f-941a-a14a2de65c51 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:53 devstack sudo[112193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994.9c90a86e-fe3f-461f-941a-a14a2de65c51 Jun 24 05:16:53 devstack sudo[112193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:54 devstack sudo[112193]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a54fd076-2c4c-4741-9c54-47850251db68 tempest-VolumesSnapshotTestJSON-268858105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994.9c90a86e-fe3f-461f-941a-a14a2de65c51" returned: 0 in 0.785s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a54fd076-2c4c-4741-9c54-47850251db68 tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994.9c90a86e-fe3f-461f-941a-a14a2de65c51 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:54 devstack sudo[112198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994.9c90a86e-fe3f-461f-941a-a14a2de65c51 Jun 24 05:16:54 devstack sudo[112198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:54 devstack sudo[112198]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a54fd076-2c4c-4741-9c54-47850251db68 tempest-VolumesSnapshotTestJSON-268858105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994.9c90a86e-fe3f-461f-941a-a14a2de65c51" returned: 0 in 0.700s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:54 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a54fd076-2c4c-4741-9c54-47850251db68 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "cinder-quobyte-9c90a86e-fe3f-461f-941a-a14a2de65c51" released by "_delete_snapshot" :: held 3.251s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:16:54 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a54fd076-2c4c-4741-9c54-47850251db68 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "cinder-quobyte-c0d01c73-e94e-4d71-be79-e47ce3a94994" released by "delete_snapshot" :: held 3.275s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:16:54 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-a54fd076-2c4c-4741-9c54-47850251db68 tempest-VolumesSnapshotTestJSON-268858105 None] Created reservations ['1ca5a3cc-521e-4b90-a2fc-4e35052b8f12', 'bfb23d3c-302e-45ca-acf8-460d3ceab0d9', '7a68ae9f-399a-4654-b852-0f6407049357', '3de07173-897f-4302-b41b-168ec71c4430'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:16:54 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-a54fd076-2c4c-4741-9c54-47850251db68 tempest-VolumesSnapshotTestJSON-268858105 None] Delete snapshot completed successfully. Jun 24 05:16:55 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a54fd076-2c4c-4741-9c54-47850251db68 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "cinder-9c90a86e-fe3f-461f-941a-a14a2de65c51-delete_snapshot" released by "delete_snapshot" :: held 3.497s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:16:56 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-f218056e-461e-41d2-b5f0-c9b2de5eca34 tempest-VolumesSnapshotTestJSON-268858105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:16:56 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f218056e-461e-41d2-b5f0-c9b2de5eca34 tempest-VolumesSnapshotTestJSON-268858105 None] Flow 'volume_create_manager' (3059a7e9-29d1-400c-b635-b5e09d142701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:16:56 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f218056e-461e-41d2-b5f0-c9b2de5eca34 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a7faf99-28b6-4a96-a769-28441718bd3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:16:56 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f218056e-461e-41d2-b5f0-c9b2de5eca34 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a7faf99-28b6-4a96-a769-28441718bd3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-867475368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21e8da9f-e1f7-4c61-9164-26fd362c1e28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='390db83f169841879138cce76379638a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:16:56Z,use_quota=True,user_id='3a06fbd7a84145c29954cf3e37281e88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:16:56 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f218056e-461e-41d2-b5f0-c9b2de5eca34 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5293e10-f81b-46b1-8479-5cfa1f9fa277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:16:56 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f218056e-461e-41d2-b5f0-c9b2de5eca34 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5293e10-f81b-46b1-8479-5cfa1f9fa277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:16:56 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f218056e-461e-41d2-b5f0-c9b2de5eca34 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a83ceb6-2a9d-43a3-918a-7a2fb4c06900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:16:56 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f218056e-461e-41d2-b5f0-c9b2de5eca34 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a83ceb6-2a9d-43a3-918a-7a2fb4c06900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21e8da9f-e1f7-4c61-9164-26fd362c1e28', 'volume_name': 'volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:16:56 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f218056e-461e-41d2-b5f0-c9b2de5eca34 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40472825-f8c4-4085-871b-2ef966a72aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:16:56 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f218056e-461e-41d2-b5f0-c9b2de5eca34 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40472825-f8c4-4085-871b-2ef966a72aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:16:56 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f218056e-461e-41d2-b5f0-c9b2de5eca34 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea59b1a1-5e10-4250-b1fd-867584e6d662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:16:56 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-f218056e-461e-41d2-b5f0-c9b2de5eca34 tempest-VolumesSnapshotTestJSON-268858105 None] Volume 21e8da9f-e1f7-4c61-9164-26fd362c1e28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28', 'volume_size': 1} Jun 24 05:16:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f218056e-461e-41d2-b5f0-c9b2de5eca34 tempest-VolumesSnapshotTestJSON-268858105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:16:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f218056e-461e-41d2-b5f0-c9b2de5eca34 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:16:56 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f218056e-461e-41d2-b5f0-c9b2de5eca34 tempest-VolumesSnapshotTestJSON-268858105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-867475368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21e8da9f-e1f7-4c61-9164-26fd362c1e28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='390db83f169841879138cce76379638a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:16:56Z,use_quota=True,user_id='3a06fbd7a84145c29954cf3e37281e88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:16:56 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-f218056e-461e-41d2-b5f0-c9b2de5eca34 tempest-VolumesSnapshotTestJSON-268858105 None] Creating volume 21e8da9f-e1f7-4c61-9164-26fd362c1e28 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:16:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f218056e-461e-41d2-b5f0-c9b2de5eca34 tempest-VolumesSnapshotTestJSON-268858105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:16:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f218056e-461e-41d2-b5f0-c9b2de5eca34 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:16:56 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f218056e-461e-41d2-b5f0-c9b2de5eca34 tempest-VolumesSnapshotTestJSON-268858105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:16:56 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f218056e-461e-41d2-b5f0-c9b2de5eca34 tempest-VolumesSnapshotTestJSON-268858105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:16:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f218056e-461e-41d2-b5f0-c9b2de5eca34 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:16:56 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f218056e-461e-41d2-b5f0-c9b2de5eca34 tempest-VolumesSnapshotTestJSON-268858105 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:16:56 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-f218056e-461e-41d2-b5f0-c9b2de5eca34 tempest-VolumesSnapshotTestJSON-268858105 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:16:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f218056e-461e-41d2-b5f0-c9b2de5eca34 tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:56 devstack sudo[112201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28 1073741824 Jun 24 05:16:56 devstack sudo[112201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:57 devstack sudo[112201]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f218056e-461e-41d2-b5f0-c9b2de5eca34 tempest-VolumesSnapshotTestJSON-268858105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28 1073741824" returned: 0 in 0.950s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f218056e-461e-41d2-b5f0-c9b2de5eca34 tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:57 devstack sudo[112207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28 Jun 24 05:16:57 devstack sudo[112207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:58 devstack sudo[112207]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f218056e-461e-41d2-b5f0-c9b2de5eca34 tempest-VolumesSnapshotTestJSON-268858105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28" returned: 0 in 0.679s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:58 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f218056e-461e-41d2-b5f0-c9b2de5eca34 tempest-VolumesSnapshotTestJSON-268858105 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:16:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f218056e-461e-41d2-b5f0-c9b2de5eca34 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.682s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:16:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f218056e-461e-41d2-b5f0-c9b2de5eca34 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea59b1a1-5e10-4250-b1fd-867584e6d662) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:16:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f218056e-461e-41d2-b5f0-c9b2de5eca34 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94816e69-b670-4b29-9c53-78c05615b0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:16:58 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-f218056e-461e-41d2-b5f0-c9b2de5eca34 tempest-VolumesSnapshotTestJSON-268858105 None] Volume volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28 (21e8da9f-e1f7-4c61-9164-26fd362c1e28): created successfully Jun 24 05:16:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f218056e-461e-41d2-b5f0-c9b2de5eca34 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94816e69-b670-4b29-9c53-78c05615b0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:16:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f218056e-461e-41d2-b5f0-c9b2de5eca34 tempest-VolumesSnapshotTestJSON-268858105 None] Flow 'volume_create_manager' (3059a7e9-29d1-400c-b635-b5e09d142701) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:16:58 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-f218056e-461e-41d2-b5f0-c9b2de5eca34 tempest-VolumesSnapshotTestJSON-268858105 None] Created volume successfully. Jun 24 05:16:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-97360708-cfac-49a7-9395-abedea12f9d1 tempest-VolumesSnapshotTestJSON-268858105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:16:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-97360708-cfac-49a7-9395-abedea12f9d1 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:16:58 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-97360708-cfac-49a7-9395-abedea12f9d1 tempest-VolumesSnapshotTestJSON-268858105 None] Creating offline snapshot 7a6b6f9f-3826-45db-9444-7896860349c1 of volume 21e8da9f-e1f7-4c61-9164-26fd362c1e28 {{(pid=93830) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 05:16:58 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c8667b-a0d5-4480-a5fc-761a1780be67]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:16:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-97360708-cfac-49a7-9395-abedea12f9d1 tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:58 devstack sudo[112210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28 Jun 24 05:16:58 devstack sudo[112210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:16:59 devstack sudo[112210]: pam_unix(sudo:session): session closed for user root Jun 24 05:16:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-97360708-cfac-49a7-9395-abedea12f9d1 tempest-VolumesSnapshotTestJSON-268858105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28" returned: 0 in 0.835s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:16:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-97360708-cfac-49a7-9395-abedea12f9d1 tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28.7a6b6f9f-3826-45db-9444-7896860349c1 1G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:16:59 devstack sudo[112215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28.7a6b6f9f-3826-45db-9444-7896860349c1 1G Jun 24 05:16:59 devstack sudo[112215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:00 devstack sudo[112215]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-97360708-cfac-49a7-9395-abedea12f9d1 tempest-VolumesSnapshotTestJSON-268858105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28.7a6b6f9f-3826-45db-9444-7896860349c1 1G" returned: 0 in 0.878s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-97360708-cfac-49a7-9395-abedea12f9d1 tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28.7a6b6f9f-3826-45db-9444-7896860349c1 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:00 devstack sudo[112221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28.7a6b6f9f-3826-45db-9444-7896860349c1 Jun 24 05:17:00 devstack sudo[112221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:01 devstack sudo[112221]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-97360708-cfac-49a7-9395-abedea12f9d1 tempest-VolumesSnapshotTestJSON-268858105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28.7a6b6f9f-3826-45db-9444-7896860349c1" returned: 0 in 0.886s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:01 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-97360708-cfac-49a7-9395-abedea12f9d1 tempest-VolumesSnapshotTestJSON-268858105 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28.7a6b6f9f-3826-45db-9444-7896860349c1 is being set with open permissions: ugo+rw Jun 24 05:17:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-97360708-cfac-49a7-9395-abedea12f9d1 tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28.7a6b6f9f-3826-45db-9444-7896860349c1 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:01 devstack sudo[112227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28.7a6b6f9f-3826-45db-9444-7896860349c1 Jun 24 05:17:01 devstack sudo[112227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:01 devstack sudo[112227]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-97360708-cfac-49a7-9395-abedea12f9d1 tempest-VolumesSnapshotTestJSON-268858105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28.7a6b6f9f-3826-45db-9444-7896860349c1" returned: 0 in 0.737s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-97360708-cfac-49a7-9395-abedea12f9d1 tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:02 devstack sudo[112233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28.info Jun 24 05:17:02 devstack sudo[112233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:02 devstack sudo[112233]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-97360708-cfac-49a7-9395-abedea12f9d1 tempest-VolumesSnapshotTestJSON-268858105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28.info" returned: 0 in 0.805s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:02 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-97360708-cfac-49a7-9395-abedea12f9d1 tempest-VolumesSnapshotTestJSON-268858105 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28.info is being set with open permissions: ugo+rw Jun 24 05:17:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-97360708-cfac-49a7-9395-abedea12f9d1 tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:02 devstack sudo[112236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28.info Jun 24 05:17:02 devstack sudo[112236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:03 devstack sudo[112236]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-97360708-cfac-49a7-9395-abedea12f9d1 tempest-VolumesSnapshotTestJSON-268858105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28.info" returned: 0 in 0.721s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-97360708-cfac-49a7-9395-abedea12f9d1 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.971s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:17:03 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-97360708-cfac-49a7-9395-abedea12f9d1 tempest-VolumesSnapshotTestJSON-268858105 None] Create snapshot completed successfully Jun 24 05:17:05 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:17:05 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Flow 'volume_create_manager' (1d06a8eb-9ecd-4ced-a771-de2e0c2ff1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:17:05 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fd3ff09-5485-4d9d-b487-fd3ddd5f2b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:17:05 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fd3ff09-5485-4d9d-b487-fd3ddd5f2b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:17:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1389023850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=778f873a-6f80-4062-9b50-9963eee980e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='390db83f169841879138cce76379638a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:17:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=7a6b6f9f-3826-45db-9444-7896860349c1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:17:05Z,use_quota=True,user_id='3a06fbd7a84145c29954cf3e37281e88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:17:05 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9101c7b8-fa69-4167-ad45-42c66b8c726d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:17:05 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9101c7b8-fa69-4167-ad45-42c66b8c726d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:17:05 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cb082f6-046d-479a-a95c-bbec489165b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:17:05 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cb082f6-046d-479a-a95c-bbec489165b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '778f873a-6f80-4062-9b50-9963eee980e0', 'volume_name': 'volume-778f873a-6f80-4062-9b50-9963eee980e0', 'volume_size': 2, 'snapshot_id': '7a6b6f9f-3826-45db-9444-7896860349c1'}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:17:05 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77e09deb-e1e6-41f8-ba36-32b0cf0893c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:17:05 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77e09deb-e1e6-41f8-ba36-32b0cf0893c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:17:05 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (850709a2-a5fb-40a8-aea5-adb9f32e3e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:17:05 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Volume 778f873a-6f80-4062-9b50-9963eee980e0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-778f873a-6f80-4062-9b50-9963eee980e0', 'volume_size': 2, 'snapshot_id': '7a6b6f9f-3826-45db-9444-7896860349c1'} Jun 24 05:17:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:17:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:17:05 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Acquiring lock "cinder-quobyte-7a6b6f9f-3826-45db-9444-7896860349c1-778f873a-6f80-4062-9b50-9963eee980e0" by "_create_volume_from_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:17:05 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "cinder-quobyte-7a6b6f9f-3826-45db-9444-7896860349c1-778f873a-6f80-4062-9b50-9963eee980e0" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:17:05 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Creating volume 778f873a-6f80-4062-9b50-9963eee980e0 from snapshot 7a6b6f9f-3826-45db-9444-7896860349c1 {{(pid=93830) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 24 05:17:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:17:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:17:05 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:17:05 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:17:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:17:05 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:17:05 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Acquiring lock "cinder-quobyte-778f873a-6f80-4062-9b50-9963eee980e0" by "_copy_volume_from_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:17:06 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "cinder-quobyte-778f873a-6f80-4062-9b50-9963eee980e0" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:17:06 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] snapshot: 7a6b6f9f-3826-45db-9444-7896860349c1, volume: 778f873a-6f80-4062-9b50-9963eee980e0, {{(pid=93830) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 05:17:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:17:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:17:06 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:17:06 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:17:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:17:06 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c787e66-5c21-4f1a-a050-b502c4ada55f]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:17:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28.7a6b6f9f-3826-45db-9444-7896860349c1 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:06 devstack sudo[112245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28.7a6b6f9f-3826-45db-9444-7896860349c1 Jun 24 05:17:06 devstack sudo[112245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:06 devstack sudo[112245]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28.7a6b6f9f-3826-45db-9444-7896860349c1" returned: 0 in 0.770s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:06 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:17:06 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28 {{(pid=93830) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 05:17:06 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Creating direct copy from snapshot {{(pid=93830) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 05:17:06 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd1fd81-3424-4a58-b61f-65007e4faecf]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:17:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:06 devstack sudo[112250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28 Jun 24 05:17:06 devstack sudo[112250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:07 devstack sudo[112250]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28" returned: 0 in 0.756s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:07 devstack cinder-volume[93830]: DEBUG cinder.utils [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Path /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-778f873a-6f80-4062-9b50-9963eee980e0 not found in is_blk_device check {{(pid=93830) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 05:17:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-778f873a-6f80-4062-9b50-9963eee980e0 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:07 devstack sudo[112255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-778f873a-6f80-4062-9b50-9963eee980e0 Jun 24 05:17:07 devstack sudo[112255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:09 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 05:17:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:17:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:17:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:17:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:17:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:17:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:09 devstack sudo[112267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:17:09 devstack sudo[112267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:11 devstack sudo[112267]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 1.627s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:11 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:17:11 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager._thread_info {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 05:17:11 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread count: 29 {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 05:17:11 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread info: [<_MainThread(MainThread, started 130211312517248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 05:17:12 devstack sudo[112255]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-778f873a-6f80-4062-9b50-9963eee980e0" returned: 0 in 5.156s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:12 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[4255c5b3-afca-4777-bd1f-cba9d4c77751]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:17:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:12 devstack sudo[112271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28 Jun 24 05:17:12 devstack sudo[112271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:13 devstack sudo[112271]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28" returned: 0 in 1.009s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:13 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Image conversion details: src /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28, size 1024.00 MB, duration 5.16 sec, destination /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-778f873a-6f80-4062-9b50-9963eee980e0 {{(pid=93830) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 05:17:13 devstack cinder-volume[93830]: INFO cinder.image.image_utils [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Converted 1024.00 MB image at 198.56 MB/s Jun 24 05:17:13 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-778f873a-6f80-4062-9b50-9963eee980e0 is being set with open permissions: ugo+rw Jun 24 05:17:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-778f873a-6f80-4062-9b50-9963eee980e0 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:13 devstack sudo[112277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-778f873a-6f80-4062-9b50-9963eee980e0 Jun 24 05:17:13 devstack sudo[112277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:14 devstack sudo[112277]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:14 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-778f873a-6f80-4062-9b50-9963eee980e0" returned: 0 in 0.704s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:14 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "cinder-quobyte-778f873a-6f80-4062-9b50-9963eee980e0" released by "_copy_volume_from_snapshot" :: held 8.488s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:17:14 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "cinder-quobyte-7a6b6f9f-3826-45db-9444-7896860349c1-778f873a-6f80-4062-9b50-9963eee980e0" released by "_create_volume_from_snapshot" :: held 8.517s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:17:14 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.532s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:17:14 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (850709a2-a5fb-40a8-aea5-adb9f32e3e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-778f873a-6f80-4062-9b50-9963eee980e0', 'volume_size': 2, 'snapshot_id': '7a6b6f9f-3826-45db-9444-7896860349c1'}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:17:14 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef77fa50-9c7c-4bca-b002-a83c656eb292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:17:14 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Volume volume-778f873a-6f80-4062-9b50-9963eee980e0 (778f873a-6f80-4062-9b50-9963eee980e0): created successfully Jun 24 05:17:14 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef77fa50-9c7c-4bca-b002-a83c656eb292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:17:14 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Flow 'volume_create_manager' (1d06a8eb-9ecd-4ced-a771-de2e0c2ff1da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:17:14 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-7320c108-ebe0-420c-8d89-fd981c3b4fd7 tempest-VolumesSnapshotTestJSON-268858105 None] Created volume successfully. Jun 24 05:17:15 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:17:15 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Flow 'volume_create_manager' (492a0b24-5f20-435e-84a9-45b9939da9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:17:15 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e29d3bf6-1f11-4122-8aa2-6c2e8bf20b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:17:15 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e29d3bf6-1f11-4122-8aa2-6c2e8bf20b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1323782178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6536f660-fe0e-4e47-be61-f45478126152,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f910f9c397a46b08332ca8aff9dec94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:17:15Z,use_quota=True,user_id='f628fe7ff04e4ee4a93d16557f5d5d89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:17:15 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a98bb3-0168-4027-b4e2-79a29d8e893c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:17:15 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a98bb3-0168-4027-b4e2-79a29d8e893c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:17:15 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (649122e5-1750-44f0-9f7c-fe141bbae8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:17:15 devstack cinder-volume[93830]: DEBUG cinder.image.glance [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Creating Keystone auth plugin from conf {{(pid=93830) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 24 05:17:15 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-67ac35d1-301d-4e8a-9aa7-8cf164cc293c tempest-VolumesSnapshotTestJSON-268858105 None] Acquiring lock "cinder-778f873a-6f80-4062-9b50-9963eee980e0-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:17:15 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-67ac35d1-301d-4e8a-9aa7-8cf164cc293c tempest-VolumesSnapshotTestJSON-268858105 None] Lock "cinder-778f873a-6f80-4062-9b50-9963eee980e0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:17:15 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-67ac35d1-301d-4e8a-9aa7-8cf164cc293c tempest-VolumesSnapshotTestJSON-268858105 None] Acquiring lock "cinder-quobyte-778f873a-6f80-4062-9b50-9963eee980e0" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:17:15 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-67ac35d1-301d-4e8a-9aa7-8cf164cc293c tempest-VolumesSnapshotTestJSON-268858105 None] Lock "cinder-quobyte-778f873a-6f80-4062-9b50-9963eee980e0" acquired by "delete_volume" :: waited 0.014s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:17:15 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[a148f063-976b-414b-afd7-463c4abfad83]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:17:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-67ac35d1-301d-4e8a-9aa7-8cf164cc293c tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-778f873a-6f80-4062-9b50-9963eee980e0 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:15 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (649122e5-1750-44f0-9f7c-fe141bbae8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6536f660-fe0e-4e47-be61-f45478126152', 'volume_name': 'volume-6536f660-fe0e-4e47-be61-f45478126152', 'volume_size': 1, 'image_id': 'f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f7b9466e67614ef6a2783f0123a80489', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'created_at': datetime.datetime(2026, 6, 24, 2, 51, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 51, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:17:15 devstack sudo[112280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-778f873a-6f80-4062-9b50-9963eee980e0 Jun 24 05:17:15 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd3006e-fb1d-44ae-9c03-b414716c7df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:17:15 devstack sudo[112280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:15 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd3006e-fb1d-44ae-9c03-b414716c7df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:17:15 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (018ebbe5-f627-4895-a84e-922457ae88d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:17:15 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Volume 6536f660-fe0e-4e47-be61-f45478126152: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6536f660-fe0e-4e47-be61-f45478126152', 'volume_size': 1, 'image_id': 'f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f7b9466e67614ef6a2783f0123a80489', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'created_at': datetime.datetime(2026, 6, 24, 2, 51, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 51, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 24 05:17:15 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Trying to clone 6536f660-fe0e-4e47-be61-f45478126152 from image f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'metadata': {}}]). {{(pid=93830) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 24 05:17:16 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_y4dfud6ydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93830) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 24 05:17:16 devstack cinder-volume[93830]: INFO cinder.image.image_utils [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Image download 20.69 MB at 20.69 MB/s Jun 24 05:17:16 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b6fd6c-410c-45ac-95e8-19e4faa3b2dd]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:17:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_y4dfud6ydevstack@QuobyteHD {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:16 devstack sudo[112283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_y4dfud6ydevstack@QuobyteHD Jun 24 05:17:16 devstack sudo[112283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:16 devstack sudo[112280]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-67ac35d1-301d-4e8a-9aa7-8cf164cc293c tempest-VolumesSnapshotTestJSON-268858105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-778f873a-6f80-4062-9b50-9963eee980e0" returned: 0 in 0.798s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-67ac35d1-301d-4e8a-9aa7-8cf164cc293c tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-778f873a-6f80-4062-9b50-9963eee980e0 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:16 devstack sudo[112288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-778f873a-6f80-4062-9b50-9963eee980e0 Jun 24 05:17:16 devstack sudo[112288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:16 devstack sudo[112283]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_y4dfud6ydevstack@QuobyteHD" returned: 0 in 0.749s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:16 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Temporary image f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1 is fetched for user f628fe7ff04e4ee4a93d16557f5d5d89. {{(pid=93830) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 24 05:17:16 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[679ec54f-c5b4-4f28-8e58-4952420736d8]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:17:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_y4dfud6ydevstack@QuobyteHD {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:17 devstack sudo[112293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_y4dfud6ydevstack@QuobyteHD Jun 24 05:17:17 devstack sudo[112293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:17 devstack sudo[112288]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-67ac35d1-301d-4e8a-9aa7-8cf164cc293c tempest-VolumesSnapshotTestJSON-268858105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-778f873a-6f80-4062-9b50-9963eee980e0" returned: 0 in 0.664s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:17 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-67ac35d1-301d-4e8a-9aa7-8cf164cc293c tempest-VolumesSnapshotTestJSON-268858105 None] Lock "cinder-quobyte-778f873a-6f80-4062-9b50-9963eee980e0" released by "delete_volume" :: held 1.511s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:17:17 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-67ac35d1-301d-4e8a-9aa7-8cf164cc293c tempest-VolumesSnapshotTestJSON-268858105 None] Created reservations ['16b521ca-ec2a-44f2-a94c-a3fb10add736', '88f5e81e-91b0-45b7-b699-d3e9cf57ed92', 'c2ca01b4-586a-4429-ad48-d6a2f868a412', 'b03fc2de-e882-442c-9f3b-e87514d4c6a3'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:17:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-67ac35d1-301d-4e8a-9aa7-8cf164cc293c tempest-VolumesSnapshotTestJSON-268858105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:17:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-67ac35d1-301d-4e8a-9aa7-8cf164cc293c tempest-VolumesSnapshotTestJSON-268858105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:17:17 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-67ac35d1-301d-4e8a-9aa7-8cf164cc293c tempest-VolumesSnapshotTestJSON-268858105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:17:17 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-67ac35d1-301d-4e8a-9aa7-8cf164cc293c tempest-VolumesSnapshotTestJSON-268858105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:17:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-67ac35d1-301d-4e8a-9aa7-8cf164cc293c tempest-VolumesSnapshotTestJSON-268858105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:17:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-67ac35d1-301d-4e8a-9aa7-8cf164cc293c tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:17 devstack sudo[112296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:17:17 devstack sudo[112296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:17 devstack sudo[112293]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_y4dfud6ydevstack@QuobyteHD" returned: 0 in 0.756s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:17:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:17:17 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1323782178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6536f660-fe0e-4e47-be61-f45478126152,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f910f9c397a46b08332ca8aff9dec94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:17:15Z,use_quota=True,user_id='f628fe7ff04e4ee4a93d16557f5d5d89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:17:17 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Creating volume 6536f660-fe0e-4e47-be61-f45478126152 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:17:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:17:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:17:17 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:17:17 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:17:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:17:17 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:17:17 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:17:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6536f660-fe0e-4e47-be61-f45478126152 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:17 devstack sudo[112301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6536f660-fe0e-4e47-be61-f45478126152 1073741824 Jun 24 05:17:17 devstack sudo[112301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:17 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-624bff7b-d41f-4c3b-ad9f-2a0467c3f442 tempest-VolumesSnapshotTestJSON-268858105 None] Acquiring lock "cinder-7a6b6f9f-3826-45db-9444-7896860349c1-delete_snapshot" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:17:17 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-624bff7b-d41f-4c3b-ad9f-2a0467c3f442 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "cinder-7a6b6f9f-3826-45db-9444-7896860349c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:17:17 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-624bff7b-d41f-4c3b-ad9f-2a0467c3f442 tempest-VolumesSnapshotTestJSON-268858105 None] Acquiring lock "cinder-quobyte-21e8da9f-e1f7-4c61-9164-26fd362c1e28" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:17:17 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-624bff7b-d41f-4c3b-ad9f-2a0467c3f442 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "cinder-quobyte-21e8da9f-e1f7-4c61-9164-26fd362c1e28" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:17:17 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-624bff7b-d41f-4c3b-ad9f-2a0467c3f442 tempest-VolumesSnapshotTestJSON-268858105 None] Acquiring lock "cinder-quobyte-7a6b6f9f-3826-45db-9444-7896860349c1" by "_delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:17:17 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-624bff7b-d41f-4c3b-ad9f-2a0467c3f442 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "cinder-quobyte-7a6b6f9f-3826-45db-9444-7896860349c1" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:17:17 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-624bff7b-d41f-4c3b-ad9f-2a0467c3f442 tempest-VolumesSnapshotTestJSON-268858105 None] Deleting offline snapshot 7a6b6f9f-3826-45db-9444-7896860349c1 of volume 21e8da9f-e1f7-4c61-9164-26fd362c1e28 {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 05:17:17 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-624bff7b-d41f-4c3b-ad9f-2a0467c3f442 tempest-VolumesSnapshotTestJSON-268858105 None] snapshot_file for this snap is: volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28.7a6b6f9f-3826-45db-9444-7896860349c1 {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 05:17:17 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71e54fe-2eef-4228-96dd-220bfa92ab66]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:17:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-624bff7b-d41f-4c3b-ad9f-2a0467c3f442 tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28.7a6b6f9f-3826-45db-9444-7896860349c1 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:17 devstack sudo[112296]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-67ac35d1-301d-4e8a-9aa7-8cf164cc293c tempest-VolumesSnapshotTestJSON-268858105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.718s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:17 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-67ac35d1-301d-4e8a-9aa7-8cf164cc293c tempest-VolumesSnapshotTestJSON-268858105 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:17:17 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-67ac35d1-301d-4e8a-9aa7-8cf164cc293c tempest-VolumesSnapshotTestJSON-268858105 None] Deleted volume successfully. Jun 24 05:17:18 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-67ac35d1-301d-4e8a-9aa7-8cf164cc293c tempest-VolumesSnapshotTestJSON-268858105 None] Lock "cinder-778f873a-6f80-4062-9b50-9963eee980e0-delete_volume" released by "delete_volume" :: held 2.447s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:17:18 devstack sudo[112304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28.7a6b6f9f-3826-45db-9444-7896860349c1 Jun 24 05:17:18 devstack sudo[112304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:18 devstack sudo[112301]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6536f660-fe0e-4e47-be61-f45478126152 1073741824" returned: 0 in 0.844s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6536f660-fe0e-4e47-be61-f45478126152 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:18 devstack sudo[112309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6536f660-fe0e-4e47-be61-f45478126152 Jun 24 05:17:18 devstack sudo[112309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:18 devstack sudo[112304]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-624bff7b-d41f-4c3b-ad9f-2a0467c3f442 tempest-VolumesSnapshotTestJSON-268858105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28.7a6b6f9f-3826-45db-9444-7896860349c1" returned: 0 in 0.829s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:18 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-624bff7b-d41f-4c3b-ad9f-2a0467c3f442 tempest-VolumesSnapshotTestJSON-268858105 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:17:18 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[516627ae-9ede-4ace-a62d-302089ee3392]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:17:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-624bff7b-d41f-4c3b-ad9f-2a0467c3f442 tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:18 devstack sudo[112314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28 Jun 24 05:17:18 devstack sudo[112314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:19 devstack sudo[112309]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6536f660-fe0e-4e47-be61-f45478126152" returned: 0 in 0.682s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:19 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] <== create_volume: return (1579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:17:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:17:19 devstack cinder-volume[93830]: DEBUG cinder.volume.volume_utils [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Attempting download of f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1 ((None, [{'url': 'file:///opt/stack/data/glance/images/f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'metadata': {}}])) to volume 6536f660-fe0e-4e47-be61-f45478126152. {{(pid=93830) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 24 05:17:19 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7fe890-7f2e-413c-9cc3-a51b7720d75d]: (4, 'raw') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:17:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_0u0i7rz7 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:19 devstack sudo[112317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_0u0i7rz7 Jun 24 05:17:19 devstack sudo[112317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:19 devstack sudo[112314]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-624bff7b-d41f-4c3b-ad9f-2a0467c3f442 tempest-VolumesSnapshotTestJSON-268858105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28" returned: 0 in 0.769s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-624bff7b-d41f-4c3b-ad9f-2a0467c3f442 tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28.7a6b6f9f-3826-45db-9444-7896860349c1 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:19 devstack sudo[112322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28.7a6b6f9f-3826-45db-9444-7896860349c1 Jun 24 05:17:19 devstack sudo[112322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:20 devstack sudo[112317]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_0u0i7rz7" returned: 0 in 0.760s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_0u0i7rz7 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:20 devstack sudo[112328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_0u0i7rz7 Jun 24 05:17:20 devstack sudo[112328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:20 devstack sudo[112322]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-624bff7b-d41f-4c3b-ad9f-2a0467c3f442 tempest-VolumesSnapshotTestJSON-268858105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28.7a6b6f9f-3826-45db-9444-7896860349c1" returned: 0 in 0.771s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-624bff7b-d41f-4c3b-ad9f-2a0467c3f442 tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28.7a6b6f9f-3826-45db-9444-7896860349c1 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:20 devstack sudo[112331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28.7a6b6f9f-3826-45db-9444-7896860349c1 Jun 24 05:17:20 devstack sudo[112331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:20 devstack sudo[112328]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_0u0i7rz7" returned: 1 in 0.710s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_0u0i7rz7' failed. Not Retrying. {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 05:17:20 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6307de2-2d2e-4d8c-9dea-44b0f7200c39]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:17:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_y4dfud6ydevstack@QuobyteHD {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:20 devstack sudo[112336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_y4dfud6ydevstack@QuobyteHD Jun 24 05:17:20 devstack sudo[112336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:20 devstack sudo[112331]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-624bff7b-d41f-4c3b-ad9f-2a0467c3f442 tempest-VolumesSnapshotTestJSON-268858105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28.7a6b6f9f-3826-45db-9444-7896860349c1" returned: 0 in 0.651s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:21 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-624bff7b-d41f-4c3b-ad9f-2a0467c3f442 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "cinder-quobyte-7a6b6f9f-3826-45db-9444-7896860349c1" released by "_delete_snapshot" :: held 3.128s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:17:21 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-624bff7b-d41f-4c3b-ad9f-2a0467c3f442 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "cinder-quobyte-21e8da9f-e1f7-4c61-9164-26fd362c1e28" released by "delete_snapshot" :: held 3.160s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:17:21 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-624bff7b-d41f-4c3b-ad9f-2a0467c3f442 tempest-VolumesSnapshotTestJSON-268858105 None] Created reservations ['88b8b00a-0934-447a-b0e2-6a1ab30fcfcc', 'ed720579-8282-4a9e-9aa3-afe876346853', '51d326b2-da2e-42b6-9d63-137289c30752', 'a53f9db8-4add-4c8d-8385-1b667123c088'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:17:21 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-624bff7b-d41f-4c3b-ad9f-2a0467c3f442 tempest-VolumesSnapshotTestJSON-268858105 None] Delete snapshot completed successfully. Jun 24 05:17:21 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-624bff7b-d41f-4c3b-ad9f-2a0467c3f442 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "cinder-7a6b6f9f-3826-45db-9444-7896860349c1-delete_snapshot" released by "delete_snapshot" :: held 3.298s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:17:21 devstack sudo[112336]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_y4dfud6ydevstack@QuobyteHD" returned: 0 in 0.713s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:21 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1 was qcow2, converting to raw {{(pid=93830) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 24 05:17:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_y4dfud6ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6536f660-fe0e-4e47-be61-f45478126152 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:21 devstack sudo[112342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_y4dfud6ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6536f660-fe0e-4e47-be61-f45478126152 Jun 24 05:17:21 devstack sudo[112342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:22 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9a81b47b-84c4-4cc4-8728-148323889c95 tempest-VolumesSnapshotTestJSON-268858105 None] Acquiring lock "cinder-21e8da9f-e1f7-4c61-9164-26fd362c1e28-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:17:22 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9a81b47b-84c4-4cc4-8728-148323889c95 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "cinder-21e8da9f-e1f7-4c61-9164-26fd362c1e28-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:17:22 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9a81b47b-84c4-4cc4-8728-148323889c95 tempest-VolumesSnapshotTestJSON-268858105 None] Acquiring lock "cinder-quobyte-21e8da9f-e1f7-4c61-9164-26fd362c1e28" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:17:22 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9a81b47b-84c4-4cc4-8728-148323889c95 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "cinder-quobyte-21e8da9f-e1f7-4c61-9164-26fd362c1e28" acquired by "delete_volume" :: waited 0.018s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:17:22 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf040a13-4551-4d32-9213-6188d176132f]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:17:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9a81b47b-84c4-4cc4-8728-148323889c95 tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:22 devstack sudo[112352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28 Jun 24 05:17:22 devstack sudo[112352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:23 devstack sudo[112352]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9a81b47b-84c4-4cc4-8728-148323889c95 tempest-VolumesSnapshotTestJSON-268858105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28" returned: 0 in 0.862s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9a81b47b-84c4-4cc4-8728-148323889c95 tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:23 devstack sudo[112358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28 Jun 24 05:17:23 devstack sudo[112358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:23 devstack sudo[112342]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_y4dfud6ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6536f660-fe0e-4e47-be61-f45478126152" returned: 0 in 1.840s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:23 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1_y4dfud6ydevstack@QuobyteHD, size 112.00 MB, duration 1.84 sec, destination /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6536f660-fe0e-4e47-be61-f45478126152 {{(pid=93830) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 05:17:23 devstack cinder-volume[93830]: INFO cinder.image.image_utils [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Converted 112.00 MB image at 60.82 MB/s Jun 24 05:17:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6536f660-fe0e-4e47-be61-f45478126152 1G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:23 devstack sudo[112360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6536f660-fe0e-4e47-be61-f45478126152 1G Jun 24 05:17:23 devstack sudo[112360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:23 devstack sudo[112358]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9a81b47b-84c4-4cc4-8728-148323889c95 tempest-VolumesSnapshotTestJSON-268858105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-21e8da9f-e1f7-4c61-9164-26fd362c1e28" returned: 0 in 0.642s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:23 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9a81b47b-84c4-4cc4-8728-148323889c95 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "cinder-quobyte-21e8da9f-e1f7-4c61-9164-26fd362c1e28" released by "delete_volume" :: held 1.565s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:17:23 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-9a81b47b-84c4-4cc4-8728-148323889c95 tempest-VolumesSnapshotTestJSON-268858105 None] Created reservations ['f26f213d-3e0d-4c99-b90e-41cb37ea1e25', '3f87685b-74f2-4671-8cb0-7349ffef9092', 'ada6498d-5744-4916-a778-9198e7f838c6', '224e8e04-3c5c-4af3-8212-6f77a122e5ba'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:17:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9a81b47b-84c4-4cc4-8728-148323889c95 tempest-VolumesSnapshotTestJSON-268858105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:17:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9a81b47b-84c4-4cc4-8728-148323889c95 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:17:23 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-9a81b47b-84c4-4cc4-8728-148323889c95 tempest-VolumesSnapshotTestJSON-268858105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:17:23 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-9a81b47b-84c4-4cc4-8728-148323889c95 tempest-VolumesSnapshotTestJSON-268858105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:17:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9a81b47b-84c4-4cc4-8728-148323889c95 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:17:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9a81b47b-84c4-4cc4-8728-148323889c95 tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:23 devstack sudo[112363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:17:23 devstack sudo[112363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:24 devstack sudo[112360]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6536f660-fe0e-4e47-be61-f45478126152 1G" returned: 0 in 0.678s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:24 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[d497301c-19d6-4e59-aefe-9bb4993c8aa8]: (4, 'raw') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:17:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6536f660-fe0e-4e47-be61-f45478126152 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:24 devstack sudo[112368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6536f660-fe0e-4e47-be61-f45478126152 Jun 24 05:17:24 devstack sudo[112368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:24 devstack sudo[112363]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9a81b47b-84c4-4cc4-8728-148323889c95 tempest-VolumesSnapshotTestJSON-268858105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.670s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:24 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-9a81b47b-84c4-4cc4-8728-148323889c95 tempest-VolumesSnapshotTestJSON-268858105 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:17:24 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-9a81b47b-84c4-4cc4-8728-148323889c95 tempest-VolumesSnapshotTestJSON-268858105 None] Deleted volume successfully. Jun 24 05:17:24 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9a81b47b-84c4-4cc4-8728-148323889c95 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "cinder-21e8da9f-e1f7-4c61-9164-26fd362c1e28-delete_volume" released by "delete_volume" :: held 2.446s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:17:24 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-52693136-bc36-4ee8-8301-e891c039a522 tempest-VolumesSnapshotTestJSON-268858105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:17:24 devstack sudo[112368]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-52693136-bc36-4ee8-8301-e891c039a522 tempest-VolumesSnapshotTestJSON-268858105 None] Flow 'volume_create_manager' (113c40b6-c937-402c-ac4d-f171475e6a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:17:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-52693136-bc36-4ee8-8301-e891c039a522 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (199e894c-b06a-4929-a534-4ad460be3fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:17:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6536f660-fe0e-4e47-be61-f45478126152" returned: 0 in 0.805s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6536f660-fe0e-4e47-be61-f45478126152 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-52693136-bc36-4ee8-8301-e891c039a522 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (199e894c-b06a-4929-a534-4ad460be3fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-118962878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64c426ea-0914-414d-84c8-aab2a6bae7df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='390db83f169841879138cce76379638a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:17:25Z,use_quota=True,user_id='3a06fbd7a84145c29954cf3e37281e88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:17:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-52693136-bc36-4ee8-8301-e891c039a522 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d19cdd01-01ba-42de-8b96-273328d90ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:17:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-52693136-bc36-4ee8-8301-e891c039a522 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d19cdd01-01ba-42de-8b96-273328d90ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:17:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-52693136-bc36-4ee8-8301-e891c039a522 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a89956e8-27d9-4d41-a772-4f60a328cfe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:17:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-52693136-bc36-4ee8-8301-e891c039a522 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a89956e8-27d9-4d41-a772-4f60a328cfe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64c426ea-0914-414d-84c8-aab2a6bae7df', 'volume_name': 'volume-64c426ea-0914-414d-84c8-aab2a6bae7df', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:17:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-52693136-bc36-4ee8-8301-e891c039a522 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21d7f479-75f5-412c-9afb-64c0b76e35a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:17:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-52693136-bc36-4ee8-8301-e891c039a522 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21d7f479-75f5-412c-9afb-64c0b76e35a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:17:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-52693136-bc36-4ee8-8301-e891c039a522 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a128bcef-359a-489c-8497-42cc41374ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:17:24 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-52693136-bc36-4ee8-8301-e891c039a522 tempest-VolumesSnapshotTestJSON-268858105 None] Volume 64c426ea-0914-414d-84c8-aab2a6bae7df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64c426ea-0914-414d-84c8-aab2a6bae7df', 'volume_size': 1} Jun 24 05:17:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-52693136-bc36-4ee8-8301-e891c039a522 tempest-VolumesSnapshotTestJSON-268858105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:17:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-52693136-bc36-4ee8-8301-e891c039a522 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:17:24 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-52693136-bc36-4ee8-8301-e891c039a522 tempest-VolumesSnapshotTestJSON-268858105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-118962878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64c426ea-0914-414d-84c8-aab2a6bae7df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='390db83f169841879138cce76379638a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:17:25Z,use_quota=True,user_id='3a06fbd7a84145c29954cf3e37281e88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:17:24 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-52693136-bc36-4ee8-8301-e891c039a522 tempest-VolumesSnapshotTestJSON-268858105 None] Creating volume 64c426ea-0914-414d-84c8-aab2a6bae7df {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:17:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-52693136-bc36-4ee8-8301-e891c039a522 tempest-VolumesSnapshotTestJSON-268858105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:17:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-52693136-bc36-4ee8-8301-e891c039a522 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:17:24 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-52693136-bc36-4ee8-8301-e891c039a522 tempest-VolumesSnapshotTestJSON-268858105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:17:25 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-52693136-bc36-4ee8-8301-e891c039a522 tempest-VolumesSnapshotTestJSON-268858105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:17:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-52693136-bc36-4ee8-8301-e891c039a522 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:17:25 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-52693136-bc36-4ee8-8301-e891c039a522 tempest-VolumesSnapshotTestJSON-268858105 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:17:25 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-52693136-bc36-4ee8-8301-e891c039a522 tempest-VolumesSnapshotTestJSON-268858105 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:17:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-52693136-bc36-4ee8-8301-e891c039a522 tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:25 devstack sudo[112374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df 1073741824 Jun 24 05:17:25 devstack sudo[112374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:25 devstack sudo[112373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6536f660-fe0e-4e47-be61-f45478126152 Jun 24 05:17:25 devstack sudo[112373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:25 devstack sudo[112373]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6536f660-fe0e-4e47-be61-f45478126152" returned: 1 in 0.770s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6536f660-fe0e-4e47-be61-f45478126152' failed. Not Retrying. {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 05:17:25 devstack cinder-volume[93830]: DEBUG cinder.volume.volume_utils [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Downloaded image f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1 ((None, [{'url': 'file:///opt/stack/data/glance/images/f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'metadata': {}}])) to volume 6536f660-fe0e-4e47-be61-f45478126152 successfully. {{(pid=93830) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 24 05:17:25 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Temporary image f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1 for user f628fe7ff04e4ee4a93d16557f5d5d89 is deleted. {{(pid=93830) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 24 05:17:25 devstack cinder-volume[93830]: DEBUG cinder.volume.volume_utils [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Marking volume 6536f660-fe0e-4e47-be61-f45478126152 as bootable. {{(pid=93830) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 24 05:17:25 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Copying metadata from image f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1 to 6536f660-fe0e-4e47-be61-f45478126152. {{(pid=93830) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 24 05:17:25 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Creating volume glance metadata for volume 6536f660-fe0e-4e47-be61-f45478126152 backed by image f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93830) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 24 05:17:25 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (018ebbe5-f627-4895-a84e-922457ae88d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6536f660-fe0e-4e47-be61-f45478126152', 'volume_size': 1, 'image_id': 'f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f7b9466e67614ef6a2783f0123a80489', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1', 'created_at': datetime.datetime(2026, 6, 24, 2, 51, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 2, 51, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f10ea8c6-83f8-4e34-84e8-46ef1c4bebe1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:17:25 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f59bde42-b068-4922-b47b-3b0947edfe69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:17:25 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Volume volume-6536f660-fe0e-4e47-be61-f45478126152 (6536f660-fe0e-4e47-be61-f45478126152): created successfully Jun 24 05:17:25 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f59bde42-b068-4922-b47b-3b0947edfe69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:17:25 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Flow 'volume_create_manager' (492a0b24-5f20-435e-84a9-45b9939da9b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:17:25 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-39f77c59-7873-4ee6-b3b9-8111fd1a137c tempest-TestShelveInstance-413355169 None] Created volume successfully. Jun 24 05:17:25 devstack sudo[112374]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-52693136-bc36-4ee8-8301-e891c039a522 tempest-VolumesSnapshotTestJSON-268858105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df 1073741824" returned: 0 in 0.863s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-52693136-bc36-4ee8-8301-e891c039a522 tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:25 devstack sudo[112386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df Jun 24 05:17:25 devstack sudo[112386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:26 devstack sudo[112386]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-52693136-bc36-4ee8-8301-e891c039a522 tempest-VolumesSnapshotTestJSON-268858105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df" returned: 0 in 0.630s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:26 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-52693136-bc36-4ee8-8301-e891c039a522 tempest-VolumesSnapshotTestJSON-268858105 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:17:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-52693136-bc36-4ee8-8301-e891c039a522 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:17:26 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-52693136-bc36-4ee8-8301-e891c039a522 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a128bcef-359a-489c-8497-42cc41374ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64c426ea-0914-414d-84c8-aab2a6bae7df', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:17:26 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-52693136-bc36-4ee8-8301-e891c039a522 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c95c0037-35b7-49f7-8e6e-03e3a2a255ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:17:26 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-52693136-bc36-4ee8-8301-e891c039a522 tempest-VolumesSnapshotTestJSON-268858105 None] Volume volume-64c426ea-0914-414d-84c8-aab2a6bae7df (64c426ea-0914-414d-84c8-aab2a6bae7df): created successfully Jun 24 05:17:26 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-52693136-bc36-4ee8-8301-e891c039a522 tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c95c0037-35b7-49f7-8e6e-03e3a2a255ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:17:26 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-52693136-bc36-4ee8-8301-e891c039a522 tempest-VolumesSnapshotTestJSON-268858105 None] Flow 'volume_create_manager' (113c40b6-c937-402c-ac4d-f171475e6a3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:17:26 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-52693136-bc36-4ee8-8301-e891c039a522 tempest-VolumesSnapshotTestJSON-268858105 None] Created volume successfully. Jun 24 05:17:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a2c49934-5994-4fdd-9ff7-f96513e3c0ff tempest-VolumesSnapshotTestJSON-268858105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:17:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a2c49934-5994-4fdd-9ff7-f96513e3c0ff tempest-VolumesSnapshotTestJSON-268858105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:17:27 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-a2c49934-5994-4fdd-9ff7-f96513e3c0ff tempest-VolumesSnapshotTestJSON-268858105 None] Creating offline snapshot bf1709e3-4ced-4fd6-9278-3e26bed4750a of volume 64c426ea-0914-414d-84c8-aab2a6bae7df {{(pid=93830) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 05:17:27 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cefb1e3-e8ee-4bbd-8d09-05324acb1605]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:17:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a2c49934-5994-4fdd-9ff7-f96513e3c0ff tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:27 devstack sudo[112389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df Jun 24 05:17:27 devstack sudo[112389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:28 devstack sudo[112389]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a2c49934-5994-4fdd-9ff7-f96513e3c0ff tempest-VolumesSnapshotTestJSON-268858105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df" returned: 0 in 0.830s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a2c49934-5994-4fdd-9ff7-f96513e3c0ff tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df.bf1709e3-4ced-4fd6-9278-3e26bed4750a 1G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:28 devstack sudo[112397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df.bf1709e3-4ced-4fd6-9278-3e26bed4750a 1G Jun 24 05:17:28 devstack sudo[112397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:28 devstack sudo[112397]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a2c49934-5994-4fdd-9ff7-f96513e3c0ff tempest-VolumesSnapshotTestJSON-268858105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df.bf1709e3-4ced-4fd6-9278-3e26bed4750a 1G" returned: 0 in 0.829s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a2c49934-5994-4fdd-9ff7-f96513e3c0ff tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64c426ea-0914-414d-84c8-aab2a6bae7df -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df.bf1709e3-4ced-4fd6-9278-3e26bed4750a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:28 devstack sudo[112402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64c426ea-0914-414d-84c8-aab2a6bae7df -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df.bf1709e3-4ced-4fd6-9278-3e26bed4750a Jun 24 05:17:28 devstack sudo[112402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:29 devstack sudo[112402]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a2c49934-5994-4fdd-9ff7-f96513e3c0ff tempest-VolumesSnapshotTestJSON-268858105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64c426ea-0914-414d-84c8-aab2a6bae7df -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df.bf1709e3-4ced-4fd6-9278-3e26bed4750a" returned: 0 in 0.741s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:29 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-a2c49934-5994-4fdd-9ff7-f96513e3c0ff tempest-VolumesSnapshotTestJSON-268858105 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df.bf1709e3-4ced-4fd6-9278-3e26bed4750a is being set with open permissions: ugo+rw Jun 24 05:17:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a2c49934-5994-4fdd-9ff7-f96513e3c0ff tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df.bf1709e3-4ced-4fd6-9278-3e26bed4750a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:29 devstack sudo[112407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df.bf1709e3-4ced-4fd6-9278-3e26bed4750a Jun 24 05:17:29 devstack sudo[112407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:30 devstack sudo[112407]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a2c49934-5994-4fdd-9ff7-f96513e3c0ff tempest-VolumesSnapshotTestJSON-268858105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df.bf1709e3-4ced-4fd6-9278-3e26bed4750a" returned: 0 in 0.670s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a2c49934-5994-4fdd-9ff7-f96513e3c0ff tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:30 devstack sudo[112410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df.info Jun 24 05:17:30 devstack sudo[112410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:30 devstack sudo[112410]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a2c49934-5994-4fdd-9ff7-f96513e3c0ff tempest-VolumesSnapshotTestJSON-268858105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df.info" returned: 0 in 0.642s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:30 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-a2c49934-5994-4fdd-9ff7-f96513e3c0ff tempest-VolumesSnapshotTestJSON-268858105 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df.info is being set with open permissions: ugo+rw Jun 24 05:17:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a2c49934-5994-4fdd-9ff7-f96513e3c0ff tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:31 devstack sudo[112414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df.info Jun 24 05:17:31 devstack sudo[112414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:31 devstack sudo[112414]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a2c49934-5994-4fdd-9ff7-f96513e3c0ff tempest-VolumesSnapshotTestJSON-268858105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df.info" returned: 0 in 0.632s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a2c49934-5994-4fdd-9ff7-f96513e3c0ff tempest-VolumesSnapshotTestJSON-268858105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.433s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:17:31 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-a2c49934-5994-4fdd-9ff7-f96513e3c0ff tempest-VolumesSnapshotTestJSON-268858105 None] Create snapshot completed successfully Jun 24 05:17:34 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:17:34 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Flow 'volume_create_manager' (0f4e379f-291e-46c9-81f8-ba0504fb9fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:17:34 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0991190-7e62-4e9a-93b1-9f6a724e9375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:17:34 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0991190-7e62-4e9a-93b1-9f6a724e9375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1690134595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e34e61b0-ba9e-4832-9862-df56a6d2f995,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='390db83f169841879138cce76379638a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bf1709e3-4ced-4fd6-9278-3e26bed4750a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:17:34Z,use_quota=True,user_id='3a06fbd7a84145c29954cf3e37281e88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:17:34 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf1c1ecc-8faf-433c-961b-c556b22ff9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:17:34 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf1c1ecc-8faf-433c-961b-c556b22ff9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:17:34 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2252cb08-442b-4129-b153-5e3f5b6a31a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:17:34 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2252cb08-442b-4129-b153-5e3f5b6a31a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e34e61b0-ba9e-4832-9862-df56a6d2f995', 'volume_name': 'volume-e34e61b0-ba9e-4832-9862-df56a6d2f995', 'volume_size': 1, 'snapshot_id': 'bf1709e3-4ced-4fd6-9278-3e26bed4750a'}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:17:34 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d473d78a-5cbf-4798-8222-42f589a3bd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:17:34 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d473d78a-5cbf-4798-8222-42f589a3bd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:17:34 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60570937-9d76-4e81-81b0-469c7e657b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:17:34 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Volume e34e61b0-ba9e-4832-9862-df56a6d2f995: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e34e61b0-ba9e-4832-9862-df56a6d2f995', 'volume_size': 1, 'snapshot_id': 'bf1709e3-4ced-4fd6-9278-3e26bed4750a'} Jun 24 05:17:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:17:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:17:34 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Acquiring lock "cinder-quobyte-bf1709e3-4ced-4fd6-9278-3e26bed4750a-e34e61b0-ba9e-4832-9862-df56a6d2f995" by "_create_volume_from_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:17:34 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Lock "cinder-quobyte-bf1709e3-4ced-4fd6-9278-3e26bed4750a-e34e61b0-ba9e-4832-9862-df56a6d2f995" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:17:34 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Creating volume e34e61b0-ba9e-4832-9862-df56a6d2f995 from snapshot bf1709e3-4ced-4fd6-9278-3e26bed4750a {{(pid=93830) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 24 05:17:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:17:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:17:34 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:17:34 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:17:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:17:34 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:17:34 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Acquiring lock "cinder-quobyte-e34e61b0-ba9e-4832-9862-df56a6d2f995" by "_copy_volume_from_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:17:34 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Lock "cinder-quobyte-e34e61b0-ba9e-4832-9862-df56a6d2f995" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:17:34 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] snapshot: bf1709e3-4ced-4fd6-9278-3e26bed4750a, volume: e34e61b0-ba9e-4832-9862-df56a6d2f995, {{(pid=93830) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 05:17:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:17:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:17:34 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:17:34 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:17:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:17:34 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[13dd1523-70da-4e08-a91b-573648a49bc0]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:17:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df.bf1709e3-4ced-4fd6-9278-3e26bed4750a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:34 devstack sudo[112421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df.bf1709e3-4ced-4fd6-9278-3e26bed4750a Jun 24 05:17:34 devstack sudo[112421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-fc1af2a0-6c27-4386-b93f-c1700a44015f req-56b9e58b-bac2-47ea-b029-f417ecf43edc tempest-TestShelveInstance-413355169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:17:35 devstack sudo[112421]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df.bf1709e3-4ced-4fd6-9278-3e26bed4750a" returned: 0 in 0.805s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:35 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64c426ea-0914-414d-84c8-aab2a6bae7df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:17:35 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df {{(pid=93830) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 05:17:35 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Creating direct copy from snapshot {{(pid=93830) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 05:17:35 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b40e7a-27fc-4be5-b085-65cf095500e6]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:17:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:35 devstack sudo[112431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df Jun 24 05:17:35 devstack sudo[112431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:36 devstack sudo[112431]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df" returned: 0 in 0.770s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:36 devstack cinder-volume[93830]: DEBUG cinder.utils [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Path /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e34e61b0-ba9e-4832-9862-df56a6d2f995 not found in is_blk_device check {{(pid=93830) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 05:17:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e34e61b0-ba9e-4832-9862-df56a6d2f995 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:36 devstack sudo[112437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e34e61b0-ba9e-4832-9862-df56a6d2f995 Jun 24 05:17:36 devstack sudo[112437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:40 devstack sudo[112437]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e34e61b0-ba9e-4832-9862-df56a6d2f995" returned: 0 in 4.842s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:40 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[faad5b66-2610-4b2b-b6bd-096d71ab1051]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:17:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:40 devstack sudo[112488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df Jun 24 05:17:40 devstack sudo[112488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:41 devstack sudo[112488]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df" returned: 0 in 0.955s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:41 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Image conversion details: src /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df, size 1024.00 MB, duration 4.84 sec, destination /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e34e61b0-ba9e-4832-9862-df56a6d2f995 {{(pid=93830) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 05:17:41 devstack cinder-volume[93830]: INFO cinder.image.image_utils [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Converted 1024.00 MB image at 211.44 MB/s Jun 24 05:17:41 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e34e61b0-ba9e-4832-9862-df56a6d2f995 is being set with open permissions: ugo+rw Jun 24 05:17:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e34e61b0-ba9e-4832-9862-df56a6d2f995 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:41 devstack sudo[112493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e34e61b0-ba9e-4832-9862-df56a6d2f995 Jun 24 05:17:41 devstack sudo[112493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:42 devstack sudo[112493]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e34e61b0-ba9e-4832-9862-df56a6d2f995" returned: 0 in 0.673s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:42 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Lock "cinder-quobyte-e34e61b0-ba9e-4832-9862-df56a6d2f995" released by "_copy_volume_from_snapshot" :: held 8.168s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:17:42 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Lock "cinder-quobyte-bf1709e3-4ced-4fd6-9278-3e26bed4750a-e34e61b0-ba9e-4832-9862-df56a6d2f995" released by "_create_volume_from_snapshot" :: held 8.207s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:17:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.222s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:17:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-fc1af2a0-6c27-4386-b93f-c1700a44015f req-56b9e58b-bac2-47ea-b029-f417ecf43edc tempest-TestShelveInstance-413355169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.870s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:17:42 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:SELECT=60,cinder:UPDATE=49,cinder:DELETE=7,cinder:INSERT=14 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:17:42 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60570937-9d76-4e81-81b0-469c7e657b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e34e61b0-ba9e-4832-9862-df56a6d2f995', 'volume_size': 1, 'snapshot_id': 'bf1709e3-4ced-4fd6-9278-3e26bed4750a'}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:17:42 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (201d8b93-4083-4a75-a9d9-0458ad2d265a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:17:42 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5776cc-be44-4a9c-909f-b13d1ba22dac]: (4, 'raw') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:17:42 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:UPDATE=49,cinder:SELECT=58,cinder:INSERT=22,cinder:DELETE=3 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:17:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-fc1af2a0-6c27-4386-b93f-c1700a44015f req-56b9e58b-bac2-47ea-b029-f417ecf43edc tempest-TestShelveInstance-413355169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6536f660-fe0e-4e47-be61-f45478126152 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:42 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Volume volume-e34e61b0-ba9e-4832-9862-df56a6d2f995 (e34e61b0-ba9e-4832-9862-df56a6d2f995): created successfully Jun 24 05:17:42 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (201d8b93-4083-4a75-a9d9-0458ad2d265a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:17:42 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Flow 'volume_create_manager' (0f4e379f-291e-46c9-81f8-ba0504fb9fba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:17:42 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-e3676b94-fbbc-4db8-ac31-fcf5fd8f070b tempest-VolumesSnapshotTestJSON-268858105 None] Created volume successfully. Jun 24 05:17:42 devstack sudo[112496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6536f660-fe0e-4e47-be61-f45478126152 Jun 24 05:17:42 devstack sudo[112496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:43 devstack sudo[112496]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-fc1af2a0-6c27-4386-b93f-c1700a44015f req-56b9e58b-bac2-47ea-b029-f417ecf43edc tempest-TestShelveInstance-413355169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6536f660-fe0e-4e47-be61-f45478126152" returned: 0 in 0.770s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-fc1af2a0-6c27-4386-b93f-c1700a44015f req-56b9e58b-bac2-47ea-b029-f417ecf43edc tempest-TestShelveInstance-413355169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6536f660-fe0e-4e47-be61-f45478126152 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:43 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-8e1325f5-7f54-482b-8c41-24436cee98d8 tempest-VolumesSnapshotTestJSON-268858105 None] Acquiring lock "cinder-e34e61b0-ba9e-4832-9862-df56a6d2f995-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:17:43 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-8e1325f5-7f54-482b-8c41-24436cee98d8 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "cinder-e34e61b0-ba9e-4832-9862-df56a6d2f995-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:17:43 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-8e1325f5-7f54-482b-8c41-24436cee98d8 tempest-VolumesSnapshotTestJSON-268858105 None] Acquiring lock "cinder-quobyte-e34e61b0-ba9e-4832-9862-df56a6d2f995" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:17:43 devstack sudo[112500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6536f660-fe0e-4e47-be61-f45478126152 Jun 24 05:17:43 devstack sudo[112500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:43 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-8e1325f5-7f54-482b-8c41-24436cee98d8 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "cinder-quobyte-e34e61b0-ba9e-4832-9862-df56a6d2f995" acquired by "delete_volume" :: waited 0.021s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:17:43 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[3650a41d-8c60-4b36-8b59-e3554260b71d]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:17:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8e1325f5-7f54-482b-8c41-24436cee98d8 tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e34e61b0-ba9e-4832-9862-df56a6d2f995 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:43 devstack sudo[112502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e34e61b0-ba9e-4832-9862-df56a6d2f995 Jun 24 05:17:43 devstack sudo[112502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:44 devstack sudo[112500]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-fc1af2a0-6c27-4386-b93f-c1700a44015f req-56b9e58b-bac2-47ea-b029-f417ecf43edc tempest-TestShelveInstance-413355169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6536f660-fe0e-4e47-be61-f45478126152" returned: 1 in 0.802s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-fc1af2a0-6c27-4386-b93f-c1700a44015f req-56b9e58b-bac2-47ea-b029-f417ecf43edc tempest-TestShelveInstance-413355169 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6536f660-fe0e-4e47-be61-f45478126152' failed. Not Retrying. {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 05:17:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-fc1af2a0-6c27-4386-b93f-c1700a44015f req-56b9e58b-bac2-47ea-b029-f417ecf43edc tempest-TestShelveInstance-413355169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.624s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:17:44 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-fc1af2a0-6c27-4386-b93f-c1700a44015f req-56b9e58b-bac2-47ea-b029-f417ecf43edc tempest-TestShelveInstance-413355169 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05', 'name': 'volume-6536f660-fe0e-4e47-be61-f45478126152', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '24a36804-62e6-4387-ba96-e9e8786250dd', 'enforce_multipath': True} {{(pid=93830) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 05:17:44 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-fc1af2a0-6c27-4386-b93f-c1700a44015f req-56b9e58b-bac2-47ea-b029-f417ecf43edc tempest-TestShelveInstance-413355169 None] attachment_update completed successfully. Jun 24 05:17:44 devstack sudo[112502]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8e1325f5-7f54-482b-8c41-24436cee98d8 tempest-VolumesSnapshotTestJSON-268858105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e34e61b0-ba9e-4832-9862-df56a6d2f995" returned: 0 in 0.737s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8e1325f5-7f54-482b-8c41-24436cee98d8 tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e34e61b0-ba9e-4832-9862-df56a6d2f995 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:44 devstack sudo[112510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e34e61b0-ba9e-4832-9862-df56a6d2f995 Jun 24 05:17:44 devstack sudo[112510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:44 devstack sudo[112510]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8e1325f5-7f54-482b-8c41-24436cee98d8 tempest-VolumesSnapshotTestJSON-268858105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e34e61b0-ba9e-4832-9862-df56a6d2f995" returned: 0 in 0.629s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:44 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-8e1325f5-7f54-482b-8c41-24436cee98d8 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "cinder-quobyte-e34e61b0-ba9e-4832-9862-df56a6d2f995" released by "delete_volume" :: held 1.406s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:17:44 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-8e1325f5-7f54-482b-8c41-24436cee98d8 tempest-VolumesSnapshotTestJSON-268858105 None] Created reservations ['05886f11-ea2e-45d0-b8f0-2722077459a5', '5b47e912-3413-4668-87fc-5db4af66e6b9', '41f463ba-0cc7-4cb6-b9ae-52d93a3ca35a', 'f099af50-5338-4731-9469-1d2fe7a842e8'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:17:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-8e1325f5-7f54-482b-8c41-24436cee98d8 tempest-VolumesSnapshotTestJSON-268858105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:17:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-8e1325f5-7f54-482b-8c41-24436cee98d8 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:17:44 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-8e1325f5-7f54-482b-8c41-24436cee98d8 tempest-VolumesSnapshotTestJSON-268858105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:17:44 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-8e1325f5-7f54-482b-8c41-24436cee98d8 tempest-VolumesSnapshotTestJSON-268858105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:17:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-8e1325f5-7f54-482b-8c41-24436cee98d8 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:17:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8e1325f5-7f54-482b-8c41-24436cee98d8 tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:45 devstack sudo[112514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:17:45 devstack sudo[112514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:45 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-1eb8bcb6-685e-45e2-8d9a-da0e9c344409 tempest-VolumesSnapshotTestJSON-268858105 None] Acquiring lock "cinder-bf1709e3-4ced-4fd6-9278-3e26bed4750a-delete_snapshot" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:17:45 devstack sudo[112514]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8e1325f5-7f54-482b-8c41-24436cee98d8 tempest-VolumesSnapshotTestJSON-268858105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.661s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:45 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-8e1325f5-7f54-482b-8c41-24436cee98d8 tempest-VolumesSnapshotTestJSON-268858105 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:17:45 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-1eb8bcb6-685e-45e2-8d9a-da0e9c344409 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "cinder-bf1709e3-4ced-4fd6-9278-3e26bed4750a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:17:45 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-1eb8bcb6-685e-45e2-8d9a-da0e9c344409 tempest-VolumesSnapshotTestJSON-268858105 None] Acquiring lock "cinder-quobyte-64c426ea-0914-414d-84c8-aab2a6bae7df" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:17:45 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-8e1325f5-7f54-482b-8c41-24436cee98d8 tempest-VolumesSnapshotTestJSON-268858105 None] Deleted volume successfully. Jun 24 05:17:45 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-1eb8bcb6-685e-45e2-8d9a-da0e9c344409 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "cinder-quobyte-64c426ea-0914-414d-84c8-aab2a6bae7df" acquired by "delete_snapshot" :: waited 0.034s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:17:45 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-1eb8bcb6-685e-45e2-8d9a-da0e9c344409 tempest-VolumesSnapshotTestJSON-268858105 None] Acquiring lock "cinder-quobyte-bf1709e3-4ced-4fd6-9278-3e26bed4750a" by "_delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:17:45 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-8e1325f5-7f54-482b-8c41-24436cee98d8 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "cinder-e34e61b0-ba9e-4832-9862-df56a6d2f995-delete_volume" released by "delete_volume" :: held 2.298s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:17:45 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-1eb8bcb6-685e-45e2-8d9a-da0e9c344409 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "cinder-quobyte-bf1709e3-4ced-4fd6-9278-3e26bed4750a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:17:45 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-1eb8bcb6-685e-45e2-8d9a-da0e9c344409 tempest-VolumesSnapshotTestJSON-268858105 None] Deleting offline snapshot bf1709e3-4ced-4fd6-9278-3e26bed4750a of volume 64c426ea-0914-414d-84c8-aab2a6bae7df {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 05:17:45 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-1eb8bcb6-685e-45e2-8d9a-da0e9c344409 tempest-VolumesSnapshotTestJSON-268858105 None] snapshot_file for this snap is: volume-64c426ea-0914-414d-84c8-aab2a6bae7df.bf1709e3-4ced-4fd6-9278-3e26bed4750a {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 05:17:45 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[032786f2-c7b1-4b89-a352-71ad9458ad6c]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:17:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1eb8bcb6-685e-45e2-8d9a-da0e9c344409 tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df.bf1709e3-4ced-4fd6-9278-3e26bed4750a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:45 devstack sudo[112517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df.bf1709e3-4ced-4fd6-9278-3e26bed4750a Jun 24 05:17:45 devstack sudo[112517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:46 devstack sudo[112517]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1eb8bcb6-685e-45e2-8d9a-da0e9c344409 tempest-VolumesSnapshotTestJSON-268858105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df.bf1709e3-4ced-4fd6-9278-3e26bed4750a" returned: 0 in 0.763s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:46 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-1eb8bcb6-685e-45e2-8d9a-da0e9c344409 tempest-VolumesSnapshotTestJSON-268858105 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64c426ea-0914-414d-84c8-aab2a6bae7df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:17:46 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[370d8813-3825-4254-b533-7cbf415ddb76]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:17:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1eb8bcb6-685e-45e2-8d9a-da0e9c344409 tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:46 devstack sudo[112587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df Jun 24 05:17:46 devstack sudo[112587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:47 devstack sudo[112587]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1eb8bcb6-685e-45e2-8d9a-da0e9c344409 tempest-VolumesSnapshotTestJSON-268858105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df" returned: 0 in 0.742s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1eb8bcb6-685e-45e2-8d9a-da0e9c344409 tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df.bf1709e3-4ced-4fd6-9278-3e26bed4750a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:47 devstack sudo[112594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df.bf1709e3-4ced-4fd6-9278-3e26bed4750a Jun 24 05:17:47 devstack sudo[112594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:47 devstack sudo[112594]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1eb8bcb6-685e-45e2-8d9a-da0e9c344409 tempest-VolumesSnapshotTestJSON-268858105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df.bf1709e3-4ced-4fd6-9278-3e26bed4750a" returned: 0 in 0.725s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1eb8bcb6-685e-45e2-8d9a-da0e9c344409 tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df.bf1709e3-4ced-4fd6-9278-3e26bed4750a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:48 devstack sudo[112602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df.bf1709e3-4ced-4fd6-9278-3e26bed4750a Jun 24 05:17:48 devstack sudo[112602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:48 devstack sudo[112602]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1eb8bcb6-685e-45e2-8d9a-da0e9c344409 tempest-VolumesSnapshotTestJSON-268858105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df.bf1709e3-4ced-4fd6-9278-3e26bed4750a" returned: 0 in 0.656s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:48 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-1eb8bcb6-685e-45e2-8d9a-da0e9c344409 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "cinder-quobyte-bf1709e3-4ced-4fd6-9278-3e26bed4750a" released by "_delete_snapshot" :: held 2.984s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:17:48 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-1eb8bcb6-685e-45e2-8d9a-da0e9c344409 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "cinder-quobyte-64c426ea-0914-414d-84c8-aab2a6bae7df" released by "delete_snapshot" :: held 3.004s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:17:48 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-1eb8bcb6-685e-45e2-8d9a-da0e9c344409 tempest-VolumesSnapshotTestJSON-268858105 None] Created reservations ['69230ac5-42e4-4747-8958-06c44ee4f559', 'fe3093d1-748f-4e82-afeb-fe605559dfde', '9d4f07c0-8ec8-49f9-ae52-6a195aea2c2b', 'b9ed8d3f-8540-4e29-906c-be0e8b3f61da'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:17:48 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-1eb8bcb6-685e-45e2-8d9a-da0e9c344409 tempest-VolumesSnapshotTestJSON-268858105 None] Delete snapshot completed successfully. Jun 24 05:17:48 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-1eb8bcb6-685e-45e2-8d9a-da0e9c344409 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "cinder-bf1709e3-4ced-4fd6-9278-3e26bed4750a-delete_snapshot" released by "delete_snapshot" :: held 3.156s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:17:50 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-5f19e165-808a-45c1-862c-8f0f28534e44 tempest-VolumesSnapshotTestJSON-268858105 None] Acquiring lock "cinder-64c426ea-0914-414d-84c8-aab2a6bae7df-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:17:50 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-5f19e165-808a-45c1-862c-8f0f28534e44 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "cinder-64c426ea-0914-414d-84c8-aab2a6bae7df-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:17:50 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-5f19e165-808a-45c1-862c-8f0f28534e44 tempest-VolumesSnapshotTestJSON-268858105 None] Acquiring lock "cinder-quobyte-64c426ea-0914-414d-84c8-aab2a6bae7df" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:17:50 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-5f19e165-808a-45c1-862c-8f0f28534e44 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "cinder-quobyte-64c426ea-0914-414d-84c8-aab2a6bae7df" acquired by "delete_volume" :: waited 0.022s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:17:50 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbea922-7b20-4e6e-88af-d702e9275ec9]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:17:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5f19e165-808a-45c1-862c-8f0f28534e44 tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:50 devstack sudo[112968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df Jun 24 05:17:50 devstack sudo[112968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:51 devstack sudo[112968]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5f19e165-808a-45c1-862c-8f0f28534e44 tempest-VolumesSnapshotTestJSON-268858105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df" returned: 0 in 0.967s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5f19e165-808a-45c1-862c-8f0f28534e44 tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:51 devstack sudo[113002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df Jun 24 05:17:51 devstack sudo[113002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:51 devstack sudo[113002]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5f19e165-808a-45c1-862c-8f0f28534e44 tempest-VolumesSnapshotTestJSON-268858105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-64c426ea-0914-414d-84c8-aab2a6bae7df" returned: 0 in 0.693s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:51 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-5f19e165-808a-45c1-862c-8f0f28534e44 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "cinder-quobyte-64c426ea-0914-414d-84c8-aab2a6bae7df" released by "delete_volume" :: held 1.755s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:17:51 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-5f19e165-808a-45c1-862c-8f0f28534e44 tempest-VolumesSnapshotTestJSON-268858105 None] Created reservations ['87212eba-e408-49ca-8253-cdd82cfac80f', 'af67a046-6e41-4d2a-99a6-ea72f4442212', '91352e56-a0c2-4eca-b945-d3d59846512f', '9fc41101-6503-48b8-a888-7c61a032fb63'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:17:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5f19e165-808a-45c1-862c-8f0f28534e44 tempest-VolumesSnapshotTestJSON-268858105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:17:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5f19e165-808a-45c1-862c-8f0f28534e44 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:17:52 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-5f19e165-808a-45c1-862c-8f0f28534e44 tempest-VolumesSnapshotTestJSON-268858105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:17:52 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-5f19e165-808a-45c1-862c-8f0f28534e44 tempest-VolumesSnapshotTestJSON-268858105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:17:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5f19e165-808a-45c1-862c-8f0f28534e44 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:17:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5f19e165-808a-45c1-862c-8f0f28534e44 tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:52 devstack sudo[113007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:17:52 devstack sudo[113007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:52 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e3713399-aedf-4373-a5a7-29c9d0fde66b tempest-VolumesSnapshotTestJSON-268858105 None] Acquiring lock "cinder-c0d01c73-e94e-4d71-be79-e47ce3a94994-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:17:52 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e3713399-aedf-4373-a5a7-29c9d0fde66b tempest-VolumesSnapshotTestJSON-268858105 None] Lock "cinder-c0d01c73-e94e-4d71-be79-e47ce3a94994-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:17:52 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e3713399-aedf-4373-a5a7-29c9d0fde66b tempest-VolumesSnapshotTestJSON-268858105 None] Acquiring lock "cinder-quobyte-c0d01c73-e94e-4d71-be79-e47ce3a94994" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:17:52 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e3713399-aedf-4373-a5a7-29c9d0fde66b tempest-VolumesSnapshotTestJSON-268858105 None] Lock "cinder-quobyte-c0d01c73-e94e-4d71-be79-e47ce3a94994" acquired by "delete_volume" :: waited 0.034s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:17:52 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[5654e260-224b-4735-bba0-95077e00b43d]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:17:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e3713399-aedf-4373-a5a7-29c9d0fde66b tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:52 devstack sudo[113009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994 Jun 24 05:17:52 devstack sudo[113009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:52 devstack sudo[113007]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5f19e165-808a-45c1-862c-8f0f28534e44 tempest-VolumesSnapshotTestJSON-268858105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.855s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:52 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-5f19e165-808a-45c1-862c-8f0f28534e44 tempest-VolumesSnapshotTestJSON-268858105 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:17:52 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-5f19e165-808a-45c1-862c-8f0f28534e44 tempest-VolumesSnapshotTestJSON-268858105 None] Deleted volume successfully. Jun 24 05:17:52 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-5f19e165-808a-45c1-862c-8f0f28534e44 tempest-VolumesSnapshotTestJSON-268858105 None] Lock "cinder-64c426ea-0914-414d-84c8-aab2a6bae7df-delete_volume" released by "delete_volume" :: held 2.921s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:17:53 devstack sudo[113009]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e3713399-aedf-4373-a5a7-29c9d0fde66b tempest-VolumesSnapshotTestJSON-268858105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994" returned: 0 in 0.981s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e3713399-aedf-4373-a5a7-29c9d0fde66b tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:53 devstack sudo[113015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994 Jun 24 05:17:53 devstack sudo[113015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:54 devstack sudo[113015]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e3713399-aedf-4373-a5a7-29c9d0fde66b tempest-VolumesSnapshotTestJSON-268858105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c0d01c73-e94e-4d71-be79-e47ce3a94994" returned: 0 in 0.740s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:54 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e3713399-aedf-4373-a5a7-29c9d0fde66b tempest-VolumesSnapshotTestJSON-268858105 None] Lock "cinder-quobyte-c0d01c73-e94e-4d71-be79-e47ce3a94994" released by "delete_volume" :: held 1.835s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:17:54 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-e3713399-aedf-4373-a5a7-29c9d0fde66b tempest-VolumesSnapshotTestJSON-268858105 None] Created reservations ['229e315a-c803-4f08-8cd9-77caa74d3dff', '049e49b3-b29f-462d-aa91-9f5f8ca4187a', '4f5a710b-3656-4b71-b053-cea8ad0532d2', '4e1264ac-272d-4fcc-9555-d269e297e6b7'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:17:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e3713399-aedf-4373-a5a7-29c9d0fde66b tempest-VolumesSnapshotTestJSON-268858105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:17:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e3713399-aedf-4373-a5a7-29c9d0fde66b tempest-VolumesSnapshotTestJSON-268858105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:17:54 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e3713399-aedf-4373-a5a7-29c9d0fde66b tempest-VolumesSnapshotTestJSON-268858105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:17:54 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e3713399-aedf-4373-a5a7-29c9d0fde66b tempest-VolumesSnapshotTestJSON-268858105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:17:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e3713399-aedf-4373-a5a7-29c9d0fde66b tempest-VolumesSnapshotTestJSON-268858105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:17:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e3713399-aedf-4373-a5a7-29c9d0fde66b tempest-VolumesSnapshotTestJSON-268858105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:17:54 devstack sudo[113018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:17:54 devstack sudo[113018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:17:55 devstack sudo[113018]: pam_unix(sudo:session): session closed for user root Jun 24 05:17:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e3713399-aedf-4373-a5a7-29c9d0fde66b tempest-VolumesSnapshotTestJSON-268858105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.868s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:17:55 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-e3713399-aedf-4373-a5a7-29c9d0fde66b tempest-VolumesSnapshotTestJSON-268858105 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:17:55 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-e3713399-aedf-4373-a5a7-29c9d0fde66b tempest-VolumesSnapshotTestJSON-268858105 None] Deleted volume successfully. Jun 24 05:17:55 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e3713399-aedf-4373-a5a7-29c9d0fde66b tempest-VolumesSnapshotTestJSON-268858105 None] Lock "cinder-c0d01c73-e94e-4d71-be79-e47ce3a94994-delete_volume" released by "delete_volume" :: held 3.020s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:18:01 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6662014-6600-4479-a6b9-a12b7a6a7b88 tempest-CreateVolumesFromImageTest-58557174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:18:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f6662014-6600-4479-a6b9-a12b7a6a7b88 tempest-CreateVolumesFromImageTest-58557174 None] Flow 'volume_create_manager' (f9d5deab-9f9b-4095-a77e-faf123aedb1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:18:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f6662014-6600-4479-a6b9-a12b7a6a7b88 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbd5d76c-5b8a-4907-adfc-bef5a4cade94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f6662014-6600-4479-a6b9-a12b7a6a7b88 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbd5d76c-5b8a-4907-adfc-bef5a4cade94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1735547080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28f57a8c-c99a-4f0a-9921-146a15b6e71e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec7c7ecb3da34b05b804f3dce7e6f2a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:18:01Z,use_quota=True,user_id='283fbe841a9847278274c30af959e0ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f6662014-6600-4479-a6b9-a12b7a6a7b88 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a670e310-344b-42bb-b5f9-f079c015e164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f6662014-6600-4479-a6b9-a12b7a6a7b88 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a670e310-344b-42bb-b5f9-f079c015e164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f6662014-6600-4479-a6b9-a12b7a6a7b88 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e54ef1-74eb-4b89-92b7-61786496da50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f6662014-6600-4479-a6b9-a12b7a6a7b88 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e54ef1-74eb-4b89-92b7-61786496da50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28f57a8c-c99a-4f0a-9921-146a15b6e71e', 'volume_name': 'volume-28f57a8c-c99a-4f0a-9921-146a15b6e71e', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f6662014-6600-4479-a6b9-a12b7a6a7b88 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da27dd40-83ee-4c0a-baae-17877097bb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f6662014-6600-4479-a6b9-a12b7a6a7b88 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da27dd40-83ee-4c0a-baae-17877097bb64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f6662014-6600-4479-a6b9-a12b7a6a7b88 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e472b348-b8ec-4a48-8149-efc2ba7a9537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:01 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-f6662014-6600-4479-a6b9-a12b7a6a7b88 tempest-CreateVolumesFromImageTest-58557174 None] Volume 28f57a8c-c99a-4f0a-9921-146a15b6e71e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28f57a8c-c99a-4f0a-9921-146a15b6e71e', 'volume_size': 1} Jun 24 05:18:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f6662014-6600-4479-a6b9-a12b7a6a7b88 tempest-CreateVolumesFromImageTest-58557174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:18:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f6662014-6600-4479-a6b9-a12b7a6a7b88 tempest-CreateVolumesFromImageTest-58557174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:18:01 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f6662014-6600-4479-a6b9-a12b7a6a7b88 tempest-CreateVolumesFromImageTest-58557174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1735547080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28f57a8c-c99a-4f0a-9921-146a15b6e71e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec7c7ecb3da34b05b804f3dce7e6f2a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:18:01Z,use_quota=True,user_id='283fbe841a9847278274c30af959e0ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:18:01 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-f6662014-6600-4479-a6b9-a12b7a6a7b88 tempest-CreateVolumesFromImageTest-58557174 None] Creating volume 28f57a8c-c99a-4f0a-9921-146a15b6e71e {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:18:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f6662014-6600-4479-a6b9-a12b7a6a7b88 tempest-CreateVolumesFromImageTest-58557174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:18:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f6662014-6600-4479-a6b9-a12b7a6a7b88 tempest-CreateVolumesFromImageTest-58557174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:18:01 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f6662014-6600-4479-a6b9-a12b7a6a7b88 tempest-CreateVolumesFromImageTest-58557174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:18:01 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f6662014-6600-4479-a6b9-a12b7a6a7b88 tempest-CreateVolumesFromImageTest-58557174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:18:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f6662014-6600-4479-a6b9-a12b7a6a7b88 tempest-CreateVolumesFromImageTest-58557174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:18:01 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f6662014-6600-4479-a6b9-a12b7a6a7b88 tempest-CreateVolumesFromImageTest-58557174 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:18:01 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-f6662014-6600-4479-a6b9-a12b7a6a7b88 tempest-CreateVolumesFromImageTest-58557174 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:18:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f6662014-6600-4479-a6b9-a12b7a6a7b88 tempest-CreateVolumesFromImageTest-58557174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-28f57a8c-c99a-4f0a-9921-146a15b6e71e 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:01 devstack sudo[113026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-28f57a8c-c99a-4f0a-9921-146a15b6e71e 1073741824 Jun 24 05:18:01 devstack sudo[113026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:01 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdcd88f7-fa3e-4fbe-9206-3e559f8dba56 tempest-CreateVolumesFromImageTest-58557174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:18:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cdcd88f7-fa3e-4fbe-9206-3e559f8dba56 tempest-CreateVolumesFromImageTest-58557174 None] Flow 'volume_create_manager' (63e46e31-4d34-4b24-a148-a2dae80d0116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:18:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cdcd88f7-fa3e-4fbe-9206-3e559f8dba56 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aa1c9d8-6132-4423-a888-d9a3b0825acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cdcd88f7-fa3e-4fbe-9206-3e559f8dba56 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aa1c9d8-6132-4423-a888-d9a3b0825acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2061305786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7261056e-1fe4-4594-9eec-d65e043a4912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec7c7ecb3da34b05b804f3dce7e6f2a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:18:02Z,use_quota=True,user_id='283fbe841a9847278274c30af959e0ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cdcd88f7-fa3e-4fbe-9206-3e559f8dba56 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fd6a444-aeb1-4cc6-830c-968e47ccf368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cdcd88f7-fa3e-4fbe-9206-3e559f8dba56 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fd6a444-aeb1-4cc6-830c-968e47ccf368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cdcd88f7-fa3e-4fbe-9206-3e559f8dba56 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (289f5f86-ea19-4860-974f-400aa9d44728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cdcd88f7-fa3e-4fbe-9206-3e559f8dba56 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (289f5f86-ea19-4860-974f-400aa9d44728) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7261056e-1fe4-4594-9eec-d65e043a4912', 'volume_name': 'volume-7261056e-1fe4-4594-9eec-d65e043a4912', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cdcd88f7-fa3e-4fbe-9206-3e559f8dba56 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (178f15ec-6a5d-4391-915b-aa76c5c47641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cdcd88f7-fa3e-4fbe-9206-3e559f8dba56 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (178f15ec-6a5d-4391-915b-aa76c5c47641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cdcd88f7-fa3e-4fbe-9206-3e559f8dba56 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddce25cc-b608-46f7-a53c-eef8df44e1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:01 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-cdcd88f7-fa3e-4fbe-9206-3e559f8dba56 tempest-CreateVolumesFromImageTest-58557174 None] Volume 7261056e-1fe4-4594-9eec-d65e043a4912: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7261056e-1fe4-4594-9eec-d65e043a4912', 'volume_size': 1} Jun 24 05:18:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-cdcd88f7-fa3e-4fbe-9206-3e559f8dba56 tempest-CreateVolumesFromImageTest-58557174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:18:02 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-b21119a5-cfc5-4585-92c7-009e6ed88d59 tempest-CreateVolumesFromImageTest-58557174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:18:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b21119a5-cfc5-4585-92c7-009e6ed88d59 tempest-CreateVolumesFromImageTest-58557174 None] Flow 'volume_create_manager' (dba1b235-cbd0-4a6f-a5da-d2e618b8895a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:18:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b21119a5-cfc5-4585-92c7-009e6ed88d59 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (222ad8e6-e34d-44c4-99bb-022e69e6aab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b21119a5-cfc5-4585-92c7-009e6ed88d59 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (222ad8e6-e34d-44c4-99bb-022e69e6aab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:18:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-873463027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=174a0708-6a7e-4452-ba8c-88099a44b66e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec7c7ecb3da34b05b804f3dce7e6f2a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:18:02Z,use_quota=True,user_id='283fbe841a9847278274c30af959e0ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b21119a5-cfc5-4585-92c7-009e6ed88d59 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52dad889-abf6-4e35-80f8-ff8766893849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b21119a5-cfc5-4585-92c7-009e6ed88d59 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52dad889-abf6-4e35-80f8-ff8766893849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b21119a5-cfc5-4585-92c7-009e6ed88d59 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7be1a5e-9407-413f-8b1c-5fbd6b5df9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b21119a5-cfc5-4585-92c7-009e6ed88d59 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7be1a5e-9407-413f-8b1c-5fbd6b5df9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '174a0708-6a7e-4452-ba8c-88099a44b66e', 'volume_name': 'volume-174a0708-6a7e-4452-ba8c-88099a44b66e', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b21119a5-cfc5-4585-92c7-009e6ed88d59 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e9b42fd-61bb-4bf8-95fc-b064641b3529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b21119a5-cfc5-4585-92c7-009e6ed88d59 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e9b42fd-61bb-4bf8-95fc-b064641b3529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b21119a5-cfc5-4585-92c7-009e6ed88d59 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99192473-0e1b-4c8f-a9e2-70ff870f82d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:02 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-b21119a5-cfc5-4585-92c7-009e6ed88d59 tempest-CreateVolumesFromImageTest-58557174 None] Volume 174a0708-6a7e-4452-ba8c-88099a44b66e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-174a0708-6a7e-4452-ba8c-88099a44b66e', 'volume_size': 1} Jun 24 05:18:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-b21119a5-cfc5-4585-92c7-009e6ed88d59 tempest-CreateVolumesFromImageTest-58557174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:18:02 devstack sudo[113026]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f6662014-6600-4479-a6b9-a12b7a6a7b88 tempest-CreateVolumesFromImageTest-58557174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-28f57a8c-c99a-4f0a-9921-146a15b6e71e 1073741824" returned: 0 in 1.042s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f6662014-6600-4479-a6b9-a12b7a6a7b88 tempest-CreateVolumesFromImageTest-58557174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-28f57a8c-c99a-4f0a-9921-146a15b6e71e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:02 devstack sudo[113032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-28f57a8c-c99a-4f0a-9921-146a15b6e71e Jun 24 05:18:02 devstack sudo[113032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:02 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ac6c14f-8d23-4f03-98c6-8ffd1ab30d36 tempest-CreateVolumesFromImageTest-58557174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:18:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7ac6c14f-8d23-4f03-98c6-8ffd1ab30d36 tempest-CreateVolumesFromImageTest-58557174 None] Flow 'volume_create_manager' (b96648aa-711a-4933-b03c-fab591871390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:18:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7ac6c14f-8d23-4f03-98c6-8ffd1ab30d36 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ead44392-1a79-4480-bf16-2923c5c4eea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7ac6c14f-8d23-4f03-98c6-8ffd1ab30d36 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ead44392-1a79-4480-bf16-2923c5c4eea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:18:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2022784825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceefb9eb-6c7c-495d-bf23-23908560530e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec7c7ecb3da34b05b804f3dce7e6f2a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:18:03Z,use_quota=True,user_id='283fbe841a9847278274c30af959e0ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7ac6c14f-8d23-4f03-98c6-8ffd1ab30d36 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f67051a9-cb41-4cb0-bef4-36d95ef20b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7ac6c14f-8d23-4f03-98c6-8ffd1ab30d36 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f67051a9-cb41-4cb0-bef4-36d95ef20b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7ac6c14f-8d23-4f03-98c6-8ffd1ab30d36 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3620c0a2-0a81-48cf-9fa3-90c427b41db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7ac6c14f-8d23-4f03-98c6-8ffd1ab30d36 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3620c0a2-0a81-48cf-9fa3-90c427b41db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ceefb9eb-6c7c-495d-bf23-23908560530e', 'volume_name': 'volume-ceefb9eb-6c7c-495d-bf23-23908560530e', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7ac6c14f-8d23-4f03-98c6-8ffd1ab30d36 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72e03a09-31c7-4473-921b-862caa94ca3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7ac6c14f-8d23-4f03-98c6-8ffd1ab30d36 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72e03a09-31c7-4473-921b-862caa94ca3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:02 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7ac6c14f-8d23-4f03-98c6-8ffd1ab30d36 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c57549b5-52d1-4884-90d9-19e0122230b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:02 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-7ac6c14f-8d23-4f03-98c6-8ffd1ab30d36 tempest-CreateVolumesFromImageTest-58557174 None] Volume ceefb9eb-6c7c-495d-bf23-23908560530e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ceefb9eb-6c7c-495d-bf23-23908560530e', 'volume_size': 1} Jun 24 05:18:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7ac6c14f-8d23-4f03-98c6-8ffd1ab30d36 tempest-CreateVolumesFromImageTest-58557174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:18:03 devstack sudo[113032]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f6662014-6600-4479-a6b9-a12b7a6a7b88 tempest-CreateVolumesFromImageTest-58557174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-28f57a8c-c99a-4f0a-9921-146a15b6e71e" returned: 0 in 0.713s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:03 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f6662014-6600-4479-a6b9-a12b7a6a7b88 tempest-CreateVolumesFromImageTest-58557174 None] <== create_volume: return (1825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:18:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f6662014-6600-4479-a6b9-a12b7a6a7b88 tempest-CreateVolumesFromImageTest-58557174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.830s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:18:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-cdcd88f7-fa3e-4fbe-9206-3e559f8dba56 tempest-CreateVolumesFromImageTest-58557174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.418s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:18:03 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-cdcd88f7-fa3e-4fbe-9206-3e559f8dba56 tempest-CreateVolumesFromImageTest-58557174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2061305786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7261056e-1fe4-4594-9eec-d65e043a4912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec7c7ecb3da34b05b804f3dce7e6f2a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:18:02Z,use_quota=True,user_id='283fbe841a9847278274c30af959e0ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:18:03 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-cdcd88f7-fa3e-4fbe-9206-3e559f8dba56 tempest-CreateVolumesFromImageTest-58557174 None] Creating volume 7261056e-1fe4-4594-9eec-d65e043a4912 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:18:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-cdcd88f7-fa3e-4fbe-9206-3e559f8dba56 tempest-CreateVolumesFromImageTest-58557174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:18:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-cdcd88f7-fa3e-4fbe-9206-3e559f8dba56 tempest-CreateVolumesFromImageTest-58557174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:18:03 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-cdcd88f7-fa3e-4fbe-9206-3e559f8dba56 tempest-CreateVolumesFromImageTest-58557174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:18:03 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-cdcd88f7-fa3e-4fbe-9206-3e559f8dba56 tempest-CreateVolumesFromImageTest-58557174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:18:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-cdcd88f7-fa3e-4fbe-9206-3e559f8dba56 tempest-CreateVolumesFromImageTest-58557174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:18:03 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-cdcd88f7-fa3e-4fbe-9206-3e559f8dba56 tempest-CreateVolumesFromImageTest-58557174 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:18:03 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-cdcd88f7-fa3e-4fbe-9206-3e559f8dba56 tempest-CreateVolumesFromImageTest-58557174 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:18:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-cdcd88f7-fa3e-4fbe-9206-3e559f8dba56 tempest-CreateVolumesFromImageTest-58557174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7261056e-1fe4-4594-9eec-d65e043a4912 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:03 devstack sudo[113035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7261056e-1fe4-4594-9eec-d65e043a4912 1073741824 Jun 24 05:18:03 devstack sudo[113035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:03 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f6662014-6600-4479-a6b9-a12b7a6a7b88 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e472b348-b8ec-4a48-8149-efc2ba7a9537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28f57a8c-c99a-4f0a-9921-146a15b6e71e', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:03 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f6662014-6600-4479-a6b9-a12b7a6a7b88 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7785a2b9-e26c-4516-a3e0-658d64718bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:03 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-f6662014-6600-4479-a6b9-a12b7a6a7b88 tempest-CreateVolumesFromImageTest-58557174 None] Volume volume-28f57a8c-c99a-4f0a-9921-146a15b6e71e (28f57a8c-c99a-4f0a-9921-146a15b6e71e): created successfully Jun 24 05:18:03 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f6662014-6600-4479-a6b9-a12b7a6a7b88 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7785a2b9-e26c-4516-a3e0-658d64718bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:03 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f6662014-6600-4479-a6b9-a12b7a6a7b88 tempest-CreateVolumesFromImageTest-58557174 None] Flow 'volume_create_manager' (f9d5deab-9f9b-4095-a77e-faf123aedb1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:18:03 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-f6662014-6600-4479-a6b9-a12b7a6a7b88 tempest-CreateVolumesFromImageTest-58557174 None] Created volume successfully. Jun 24 05:18:03 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7681b66-7f9c-4df1-a901-0b7242d83f9c tempest-CreateVolumesFromImageTest-58557174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:18:03 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e7681b66-7f9c-4df1-a901-0b7242d83f9c tempest-CreateVolumesFromImageTest-58557174 None] Flow 'volume_create_manager' (56619d73-182f-4a9e-b4ce-af33d8a73f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:18:03 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e7681b66-7f9c-4df1-a901-0b7242d83f9c tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e6d5cbc-2aa5-401a-9794-49970d32fcee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:03 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e7681b66-7f9c-4df1-a901-0b7242d83f9c tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e6d5cbc-2aa5-401a-9794-49970d32fcee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-59790668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26482bb4-1c9b-4621-a7cc-de0e04123a4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec7c7ecb3da34b05b804f3dce7e6f2a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:18:03Z,use_quota=True,user_id='283fbe841a9847278274c30af959e0ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:03 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e7681b66-7f9c-4df1-a901-0b7242d83f9c tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b95c4e7c-54c1-4802-b20b-6b9e6f17162b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:03 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e7681b66-7f9c-4df1-a901-0b7242d83f9c tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b95c4e7c-54c1-4802-b20b-6b9e6f17162b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:03 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e7681b66-7f9c-4df1-a901-0b7242d83f9c tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6105840d-b24d-4df0-9fa3-f0113f6926d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:03 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e7681b66-7f9c-4df1-a901-0b7242d83f9c tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6105840d-b24d-4df0-9fa3-f0113f6926d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26482bb4-1c9b-4621-a7cc-de0e04123a4d', 'volume_name': 'volume-26482bb4-1c9b-4621-a7cc-de0e04123a4d', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:03 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e7681b66-7f9c-4df1-a901-0b7242d83f9c tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1885fd1c-5355-47d2-80fb-3dcbae18678d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:03 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e7681b66-7f9c-4df1-a901-0b7242d83f9c tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1885fd1c-5355-47d2-80fb-3dcbae18678d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:03 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e7681b66-7f9c-4df1-a901-0b7242d83f9c tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95a9042c-f7f2-4090-977a-90d56ef957a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:03 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-e7681b66-7f9c-4df1-a901-0b7242d83f9c tempest-CreateVolumesFromImageTest-58557174 None] Volume 26482bb4-1c9b-4621-a7cc-de0e04123a4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26482bb4-1c9b-4621-a7cc-de0e04123a4d', 'volume_size': 1} Jun 24 05:18:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e7681b66-7f9c-4df1-a901-0b7242d83f9c tempest-CreateVolumesFromImageTest-58557174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:18:04 devstack sudo[113035]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-cdcd88f7-fa3e-4fbe-9206-3e559f8dba56 tempest-CreateVolumesFromImageTest-58557174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7261056e-1fe4-4594-9eec-d65e043a4912 1073741824" returned: 0 in 0.836s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-cdcd88f7-fa3e-4fbe-9206-3e559f8dba56 tempest-CreateVolumesFromImageTest-58557174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7261056e-1fe4-4594-9eec-d65e043a4912 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:04 devstack sudo[113041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7261056e-1fe4-4594-9eec-d65e043a4912 Jun 24 05:18:04 devstack sudo[113041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:04 devstack sudo[113041]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-cdcd88f7-fa3e-4fbe-9206-3e559f8dba56 tempest-CreateVolumesFromImageTest-58557174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7261056e-1fe4-4594-9eec-d65e043a4912" returned: 0 in 0.634s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:04 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-cdcd88f7-fa3e-4fbe-9206-3e559f8dba56 tempest-CreateVolumesFromImageTest-58557174 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:18:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-cdcd88f7-fa3e-4fbe-9206-3e559f8dba56 tempest-CreateVolumesFromImageTest-58557174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:18:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-b21119a5-cfc5-4585-92c7-009e6ed88d59 tempest-CreateVolumesFromImageTest-58557174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.481s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:18:04 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-b21119a5-cfc5-4585-92c7-009e6ed88d59 tempest-CreateVolumesFromImageTest-58557174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:18:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-873463027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=174a0708-6a7e-4452-ba8c-88099a44b66e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec7c7ecb3da34b05b804f3dce7e6f2a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:18:02Z,use_quota=True,user_id='283fbe841a9847278274c30af959e0ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:18:04 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-b21119a5-cfc5-4585-92c7-009e6ed88d59 tempest-CreateVolumesFromImageTest-58557174 None] Creating volume 174a0708-6a7e-4452-ba8c-88099a44b66e {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:18:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-b21119a5-cfc5-4585-92c7-009e6ed88d59 tempest-CreateVolumesFromImageTest-58557174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:18:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-b21119a5-cfc5-4585-92c7-009e6ed88d59 tempest-CreateVolumesFromImageTest-58557174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:18:04 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-b21119a5-cfc5-4585-92c7-009e6ed88d59 tempest-CreateVolumesFromImageTest-58557174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:18:04 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-b21119a5-cfc5-4585-92c7-009e6ed88d59 tempest-CreateVolumesFromImageTest-58557174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:18:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-b21119a5-cfc5-4585-92c7-009e6ed88d59 tempest-CreateVolumesFromImageTest-58557174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:18:04 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-b21119a5-cfc5-4585-92c7-009e6ed88d59 tempest-CreateVolumesFromImageTest-58557174 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:18:04 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-b21119a5-cfc5-4585-92c7-009e6ed88d59 tempest-CreateVolumesFromImageTest-58557174 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:18:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-b21119a5-cfc5-4585-92c7-009e6ed88d59 tempest-CreateVolumesFromImageTest-58557174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-174a0708-6a7e-4452-ba8c-88099a44b66e 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:04 devstack sudo[113044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-174a0708-6a7e-4452-ba8c-88099a44b66e 1073741824 Jun 24 05:18:04 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cdcd88f7-fa3e-4fbe-9206-3e559f8dba56 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddce25cc-b608-46f7-a53c-eef8df44e1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7261056e-1fe4-4594-9eec-d65e043a4912', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:04 devstack sudo[113044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:04 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cdcd88f7-fa3e-4fbe-9206-3e559f8dba56 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bff0bf85-2150-4d58-bec5-3bb47d8c400f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:04 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-cdcd88f7-fa3e-4fbe-9206-3e559f8dba56 tempest-CreateVolumesFromImageTest-58557174 None] Volume volume-7261056e-1fe4-4594-9eec-d65e043a4912 (7261056e-1fe4-4594-9eec-d65e043a4912): created successfully Jun 24 05:18:04 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cdcd88f7-fa3e-4fbe-9206-3e559f8dba56 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bff0bf85-2150-4d58-bec5-3bb47d8c400f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:04 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cdcd88f7-fa3e-4fbe-9206-3e559f8dba56 tempest-CreateVolumesFromImageTest-58557174 None] Flow 'volume_create_manager' (63e46e31-4d34-4b24-a148-a2dae80d0116) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:18:04 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-cdcd88f7-fa3e-4fbe-9206-3e559f8dba56 tempest-CreateVolumesFromImageTest-58557174 None] Created volume successfully. Jun 24 05:18:05 devstack sudo[113044]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-b21119a5-cfc5-4585-92c7-009e6ed88d59 tempest-CreateVolumesFromImageTest-58557174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-174a0708-6a7e-4452-ba8c-88099a44b66e 1073741824" returned: 0 in 0.845s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-b21119a5-cfc5-4585-92c7-009e6ed88d59 tempest-CreateVolumesFromImageTest-58557174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-174a0708-6a7e-4452-ba8c-88099a44b66e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:05 devstack sudo[113055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-174a0708-6a7e-4452-ba8c-88099a44b66e Jun 24 05:18:05 devstack sudo[113055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:06 devstack sudo[113055]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-b21119a5-cfc5-4585-92c7-009e6ed88d59 tempest-CreateVolumesFromImageTest-58557174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-174a0708-6a7e-4452-ba8c-88099a44b66e" returned: 0 in 0.678s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:06 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-b21119a5-cfc5-4585-92c7-009e6ed88d59 tempest-CreateVolumesFromImageTest-58557174 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:18:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-b21119a5-cfc5-4585-92c7-009e6ed88d59 tempest-CreateVolumesFromImageTest-58557174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:18:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7ac6c14f-8d23-4f03-98c6-8ffd1ab30d36 tempest-CreateVolumesFromImageTest-58557174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.489s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:18:06 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7ac6c14f-8d23-4f03-98c6-8ffd1ab30d36 tempest-CreateVolumesFromImageTest-58557174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:18:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2022784825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceefb9eb-6c7c-495d-bf23-23908560530e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec7c7ecb3da34b05b804f3dce7e6f2a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:18:03Z,use_quota=True,user_id='283fbe841a9847278274c30af959e0ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:18:06 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-7ac6c14f-8d23-4f03-98c6-8ffd1ab30d36 tempest-CreateVolumesFromImageTest-58557174 None] Creating volume ceefb9eb-6c7c-495d-bf23-23908560530e {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:18:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7ac6c14f-8d23-4f03-98c6-8ffd1ab30d36 tempest-CreateVolumesFromImageTest-58557174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:18:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7ac6c14f-8d23-4f03-98c6-8ffd1ab30d36 tempest-CreateVolumesFromImageTest-58557174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:18:06 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7ac6c14f-8d23-4f03-98c6-8ffd1ab30d36 tempest-CreateVolumesFromImageTest-58557174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:18:06 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7ac6c14f-8d23-4f03-98c6-8ffd1ab30d36 tempest-CreateVolumesFromImageTest-58557174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:18:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7ac6c14f-8d23-4f03-98c6-8ffd1ab30d36 tempest-CreateVolumesFromImageTest-58557174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:18:06 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7ac6c14f-8d23-4f03-98c6-8ffd1ab30d36 tempest-CreateVolumesFromImageTest-58557174 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:18:06 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-7ac6c14f-8d23-4f03-98c6-8ffd1ab30d36 tempest-CreateVolumesFromImageTest-58557174 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:18:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7ac6c14f-8d23-4f03-98c6-8ffd1ab30d36 tempest-CreateVolumesFromImageTest-58557174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ceefb9eb-6c7c-495d-bf23-23908560530e 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:06 devstack sudo[113130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ceefb9eb-6c7c-495d-bf23-23908560530e 1073741824 Jun 24 05:18:06 devstack sudo[113130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:06 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b21119a5-cfc5-4585-92c7-009e6ed88d59 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99192473-0e1b-4c8f-a9e2-70ff870f82d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-174a0708-6a7e-4452-ba8c-88099a44b66e', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:06 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b21119a5-cfc5-4585-92c7-009e6ed88d59 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1193c25-cd6d-4b46-82bc-182eb525254a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:06 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-b21119a5-cfc5-4585-92c7-009e6ed88d59 tempest-CreateVolumesFromImageTest-58557174 None] Volume volume-174a0708-6a7e-4452-ba8c-88099a44b66e (174a0708-6a7e-4452-ba8c-88099a44b66e): created successfully Jun 24 05:18:06 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b21119a5-cfc5-4585-92c7-009e6ed88d59 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1193c25-cd6d-4b46-82bc-182eb525254a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:06 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b21119a5-cfc5-4585-92c7-009e6ed88d59 tempest-CreateVolumesFromImageTest-58557174 None] Flow 'volume_create_manager' (dba1b235-cbd0-4a6f-a5da-d2e618b8895a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:18:06 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-b21119a5-cfc5-4585-92c7-009e6ed88d59 tempest-CreateVolumesFromImageTest-58557174 None] Created volume successfully. Jun 24 05:18:07 devstack sudo[113130]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7ac6c14f-8d23-4f03-98c6-8ffd1ab30d36 tempest-CreateVolumesFromImageTest-58557174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ceefb9eb-6c7c-495d-bf23-23908560530e 1073741824" returned: 0 in 0.885s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7ac6c14f-8d23-4f03-98c6-8ffd1ab30d36 tempest-CreateVolumesFromImageTest-58557174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ceefb9eb-6c7c-495d-bf23-23908560530e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:07 devstack sudo[113160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ceefb9eb-6c7c-495d-bf23-23908560530e Jun 24 05:18:07 devstack sudo[113160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:07 devstack sudo[113160]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7ac6c14f-8d23-4f03-98c6-8ffd1ab30d36 tempest-CreateVolumesFromImageTest-58557174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ceefb9eb-6c7c-495d-bf23-23908560530e" returned: 0 in 0.629s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:07 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7ac6c14f-8d23-4f03-98c6-8ffd1ab30d36 tempest-CreateVolumesFromImageTest-58557174 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:18:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7ac6c14f-8d23-4f03-98c6-8ffd1ab30d36 tempest-CreateVolumesFromImageTest-58557174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:18:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e7681b66-7f9c-4df1-a901-0b7242d83f9c tempest-CreateVolumesFromImageTest-58557174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.423s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:18:07 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e7681b66-7f9c-4df1-a901-0b7242d83f9c tempest-CreateVolumesFromImageTest-58557174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-59790668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26482bb4-1c9b-4621-a7cc-de0e04123a4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec7c7ecb3da34b05b804f3dce7e6f2a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:18:03Z,use_quota=True,user_id='283fbe841a9847278274c30af959e0ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:18:07 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-e7681b66-7f9c-4df1-a901-0b7242d83f9c tempest-CreateVolumesFromImageTest-58557174 None] Creating volume 26482bb4-1c9b-4621-a7cc-de0e04123a4d {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:18:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e7681b66-7f9c-4df1-a901-0b7242d83f9c tempest-CreateVolumesFromImageTest-58557174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:18:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e7681b66-7f9c-4df1-a901-0b7242d83f9c tempest-CreateVolumesFromImageTest-58557174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:18:07 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e7681b66-7f9c-4df1-a901-0b7242d83f9c tempest-CreateVolumesFromImageTest-58557174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:18:07 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e7681b66-7f9c-4df1-a901-0b7242d83f9c tempest-CreateVolumesFromImageTest-58557174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:18:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e7681b66-7f9c-4df1-a901-0b7242d83f9c tempest-CreateVolumesFromImageTest-58557174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:18:07 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e7681b66-7f9c-4df1-a901-0b7242d83f9c tempest-CreateVolumesFromImageTest-58557174 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:18:07 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-e7681b66-7f9c-4df1-a901-0b7242d83f9c tempest-CreateVolumesFromImageTest-58557174 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:18:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e7681b66-7f9c-4df1-a901-0b7242d83f9c tempest-CreateVolumesFromImageTest-58557174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-26482bb4-1c9b-4621-a7cc-de0e04123a4d 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7ac6c14f-8d23-4f03-98c6-8ffd1ab30d36 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c57549b5-52d1-4884-90d9-19e0122230b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ceefb9eb-6c7c-495d-bf23-23908560530e', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:07 devstack sudo[113163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-26482bb4-1c9b-4621-a7cc-de0e04123a4d 1073741824 Jun 24 05:18:07 devstack sudo[113163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7ac6c14f-8d23-4f03-98c6-8ffd1ab30d36 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9f76f3d-a85d-4d4f-96c7-9c1aa089bf35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:07 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-7ac6c14f-8d23-4f03-98c6-8ffd1ab30d36 tempest-CreateVolumesFromImageTest-58557174 None] Volume volume-ceefb9eb-6c7c-495d-bf23-23908560530e (ceefb9eb-6c7c-495d-bf23-23908560530e): created successfully Jun 24 05:18:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7ac6c14f-8d23-4f03-98c6-8ffd1ab30d36 tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9f76f3d-a85d-4d4f-96c7-9c1aa089bf35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7ac6c14f-8d23-4f03-98c6-8ffd1ab30d36 tempest-CreateVolumesFromImageTest-58557174 None] Flow 'volume_create_manager' (b96648aa-711a-4933-b03c-fab591871390) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:18:07 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-7ac6c14f-8d23-4f03-98c6-8ffd1ab30d36 tempest-CreateVolumesFromImageTest-58557174 None] Created volume successfully. Jun 24 05:18:08 devstack sudo[113163]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e7681b66-7f9c-4df1-a901-0b7242d83f9c tempest-CreateVolumesFromImageTest-58557174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-26482bb4-1c9b-4621-a7cc-de0e04123a4d 1073741824" returned: 0 in 0.795s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e7681b66-7f9c-4df1-a901-0b7242d83f9c tempest-CreateVolumesFromImageTest-58557174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-26482bb4-1c9b-4621-a7cc-de0e04123a4d {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:08 devstack sudo[113169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-26482bb4-1c9b-4621-a7cc-de0e04123a4d Jun 24 05:18:08 devstack sudo[113169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:09 devstack sudo[113169]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e7681b66-7f9c-4df1-a901-0b7242d83f9c tempest-CreateVolumesFromImageTest-58557174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-26482bb4-1c9b-4621-a7cc-de0e04123a4d" returned: 0 in 0.635s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e7681b66-7f9c-4df1-a901-0b7242d83f9c tempest-CreateVolumesFromImageTest-58557174 None] <== create_volume: return (1467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:18:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e7681b66-7f9c-4df1-a901-0b7242d83f9c tempest-CreateVolumesFromImageTest-58557174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.470s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:18:09 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e7681b66-7f9c-4df1-a901-0b7242d83f9c tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95a9042c-f7f2-4090-977a-90d56ef957a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26482bb4-1c9b-4621-a7cc-de0e04123a4d', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:09 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e7681b66-7f9c-4df1-a901-0b7242d83f9c tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ff50112-f41d-4923-8788-2252711f9021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:09 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-e7681b66-7f9c-4df1-a901-0b7242d83f9c tempest-CreateVolumesFromImageTest-58557174 None] Volume volume-26482bb4-1c9b-4621-a7cc-de0e04123a4d (26482bb4-1c9b-4621-a7cc-de0e04123a4d): created successfully Jun 24 05:18:09 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e7681b66-7f9c-4df1-a901-0b7242d83f9c tempest-CreateVolumesFromImageTest-58557174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ff50112-f41d-4923-8788-2252711f9021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:09 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e7681b66-7f9c-4df1-a901-0b7242d83f9c tempest-CreateVolumesFromImageTest-58557174 None] Flow 'volume_create_manager' (56619d73-182f-4a9e-b4ce-af33d8a73f0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:18:09 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-e7681b66-7f9c-4df1-a901-0b7242d83f9c tempest-CreateVolumesFromImageTest-58557174 None] Created volume successfully. Jun 24 05:18:09 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 05:18:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:18:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:18:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:18:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:18:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:18:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:09 devstack sudo[113172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:18:09 devstack sudo[113172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:09 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-6313c7d2-4d47-45e6-bd6d-9ab94d357d26 tempest-CreateVolumesFromImageTest-58557174 None] Acquiring lock "cinder-26482bb4-1c9b-4621-a7cc-de0e04123a4d-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:18:09 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-6313c7d2-4d47-45e6-bd6d-9ab94d357d26 tempest-CreateVolumesFromImageTest-58557174 None] Lock "cinder-26482bb4-1c9b-4621-a7cc-de0e04123a4d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:18:09 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-6313c7d2-4d47-45e6-bd6d-9ab94d357d26 tempest-CreateVolumesFromImageTest-58557174 None] Acquiring lock "cinder-quobyte-26482bb4-1c9b-4621-a7cc-de0e04123a4d" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:18:09 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-6313c7d2-4d47-45e6-bd6d-9ab94d357d26 tempest-CreateVolumesFromImageTest-58557174 None] Lock "cinder-quobyte-26482bb4-1c9b-4621-a7cc-de0e04123a4d" acquired by "delete_volume" :: waited 0.017s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:18:09 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1b3ea6-f7d7-4bd6-b87e-a3913fb44f26]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:18:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6313c7d2-4d47-45e6-bd6d-9ab94d357d26 tempest-CreateVolumesFromImageTest-58557174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-26482bb4-1c9b-4621-a7cc-de0e04123a4d {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:10 devstack sudo[113174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-26482bb4-1c9b-4621-a7cc-de0e04123a4d Jun 24 05:18:10 devstack sudo[113174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:10 devstack sudo[113172]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.652s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:10 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:18:10 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager._thread_info {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 05:18:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread count: 29 {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 05:18:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread info: [<_MainThread(MainThread, started 130211312517248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 05:18:10 devstack sudo[113174]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6313c7d2-4d47-45e6-bd6d-9ab94d357d26 tempest-CreateVolumesFromImageTest-58557174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-26482bb4-1c9b-4621-a7cc-de0e04123a4d" returned: 0 in 0.792s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6313c7d2-4d47-45e6-bd6d-9ab94d357d26 tempest-CreateVolumesFromImageTest-58557174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-26482bb4-1c9b-4621-a7cc-de0e04123a4d {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:10 devstack sudo[113181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-26482bb4-1c9b-4621-a7cc-de0e04123a4d Jun 24 05:18:10 devstack sudo[113181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:11 devstack sudo[113181]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6313c7d2-4d47-45e6-bd6d-9ab94d357d26 tempest-CreateVolumesFromImageTest-58557174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-26482bb4-1c9b-4621-a7cc-de0e04123a4d" returned: 0 in 0.636s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:11 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-6313c7d2-4d47-45e6-bd6d-9ab94d357d26 tempest-CreateVolumesFromImageTest-58557174 None] Lock "cinder-quobyte-26482bb4-1c9b-4621-a7cc-de0e04123a4d" released by "delete_volume" :: held 1.467s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:18:11 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-6313c7d2-4d47-45e6-bd6d-9ab94d357d26 tempest-CreateVolumesFromImageTest-58557174 None] Created reservations ['c88976df-5e1a-4de6-b089-7f7606cdc7de', '99d9b029-cddc-494c-9a3e-9a6765d47d99', 'e932e5ee-d74e-4d31-b665-e9b62c58bd6d', '5d02c97f-e909-4e81-9270-5c7d67558689'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:18:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-6313c7d2-4d47-45e6-bd6d-9ab94d357d26 tempest-CreateVolumesFromImageTest-58557174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:18:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-6313c7d2-4d47-45e6-bd6d-9ab94d357d26 tempest-CreateVolumesFromImageTest-58557174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:18:11 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-6313c7d2-4d47-45e6-bd6d-9ab94d357d26 tempest-CreateVolumesFromImageTest-58557174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:18:11 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-6313c7d2-4d47-45e6-bd6d-9ab94d357d26 tempest-CreateVolumesFromImageTest-58557174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:18:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-6313c7d2-4d47-45e6-bd6d-9ab94d357d26 tempest-CreateVolumesFromImageTest-58557174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:18:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6313c7d2-4d47-45e6-bd6d-9ab94d357d26 tempest-CreateVolumesFromImageTest-58557174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:11 devstack sudo[113184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:18:11 devstack sudo[113184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:12 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f3a0120e-e621-499a-b6a7-1a7db2eafc4d tempest-CreateVolumesFromImageTest-58557174 None] Acquiring lock "cinder-ceefb9eb-6c7c-495d-bf23-23908560530e-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:18:12 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f3a0120e-e621-499a-b6a7-1a7db2eafc4d tempest-CreateVolumesFromImageTest-58557174 None] Lock "cinder-ceefb9eb-6c7c-495d-bf23-23908560530e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:18:12 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f3a0120e-e621-499a-b6a7-1a7db2eafc4d tempest-CreateVolumesFromImageTest-58557174 None] Acquiring lock "cinder-quobyte-ceefb9eb-6c7c-495d-bf23-23908560530e" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:18:12 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f3a0120e-e621-499a-b6a7-1a7db2eafc4d tempest-CreateVolumesFromImageTest-58557174 None] Lock "cinder-quobyte-ceefb9eb-6c7c-495d-bf23-23908560530e" acquired by "delete_volume" :: waited 0.015s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:18:12 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0ed0dc-212f-4003-ae47-aae22a46385d]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:18:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f3a0120e-e621-499a-b6a7-1a7db2eafc4d tempest-CreateVolumesFromImageTest-58557174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ceefb9eb-6c7c-495d-bf23-23908560530e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:12 devstack sudo[113184]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6313c7d2-4d47-45e6-bd6d-9ab94d357d26 tempest-CreateVolumesFromImageTest-58557174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.689s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:12 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-6313c7d2-4d47-45e6-bd6d-9ab94d357d26 tempest-CreateVolumesFromImageTest-58557174 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:18:12 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-6313c7d2-4d47-45e6-bd6d-9ab94d357d26 tempest-CreateVolumesFromImageTest-58557174 None] Deleted volume successfully. Jun 24 05:18:12 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-6313c7d2-4d47-45e6-bd6d-9ab94d357d26 tempest-CreateVolumesFromImageTest-58557174 None] Lock "cinder-26482bb4-1c9b-4621-a7cc-de0e04123a4d-delete_volume" released by "delete_volume" :: held 2.373s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:18:12 devstack sudo[113187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ceefb9eb-6c7c-495d-bf23-23908560530e Jun 24 05:18:12 devstack sudo[113187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:12 devstack sudo[113187]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f3a0120e-e621-499a-b6a7-1a7db2eafc4d tempest-CreateVolumesFromImageTest-58557174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ceefb9eb-6c7c-495d-bf23-23908560530e" returned: 0 in 0.739s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f3a0120e-e621-499a-b6a7-1a7db2eafc4d tempest-CreateVolumesFromImageTest-58557174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ceefb9eb-6c7c-495d-bf23-23908560530e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:12 devstack sudo[113192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ceefb9eb-6c7c-495d-bf23-23908560530e Jun 24 05:18:12 devstack sudo[113192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:13 devstack sudo[113192]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f3a0120e-e621-499a-b6a7-1a7db2eafc4d tempest-CreateVolumesFromImageTest-58557174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ceefb9eb-6c7c-495d-bf23-23908560530e" returned: 0 in 0.679s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:13 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f3a0120e-e621-499a-b6a7-1a7db2eafc4d tempest-CreateVolumesFromImageTest-58557174 None] Lock "cinder-quobyte-ceefb9eb-6c7c-495d-bf23-23908560530e" released by "delete_volume" :: held 1.464s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:18:13 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-f3a0120e-e621-499a-b6a7-1a7db2eafc4d tempest-CreateVolumesFromImageTest-58557174 None] Created reservations ['c95daea7-1d93-4296-bf4e-b7d314e421f8', '4007689d-8039-4e03-9eae-6d611354837c', 'e3083e63-d896-436a-85d1-bcad0fd36b7a', '49f1d746-13ed-488f-a8fd-e92899a702a2'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:18:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f3a0120e-e621-499a-b6a7-1a7db2eafc4d tempest-CreateVolumesFromImageTest-58557174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:18:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f3a0120e-e621-499a-b6a7-1a7db2eafc4d tempest-CreateVolumesFromImageTest-58557174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:18:13 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f3a0120e-e621-499a-b6a7-1a7db2eafc4d tempest-CreateVolumesFromImageTest-58557174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:18:13 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f3a0120e-e621-499a-b6a7-1a7db2eafc4d tempest-CreateVolumesFromImageTest-58557174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:18:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f3a0120e-e621-499a-b6a7-1a7db2eafc4d tempest-CreateVolumesFromImageTest-58557174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:18:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f3a0120e-e621-499a-b6a7-1a7db2eafc4d tempest-CreateVolumesFromImageTest-58557174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:13 devstack sudo[113195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:18:13 devstack sudo[113195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:14 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-cfe62333-0476-4043-9291-5a37575fc79f tempest-CreateVolumesFromImageTest-58557174 None] Acquiring lock "cinder-174a0708-6a7e-4452-ba8c-88099a44b66e-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:18:14 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-cfe62333-0476-4043-9291-5a37575fc79f tempest-CreateVolumesFromImageTest-58557174 None] Lock "cinder-174a0708-6a7e-4452-ba8c-88099a44b66e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:18:14 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-cfe62333-0476-4043-9291-5a37575fc79f tempest-CreateVolumesFromImageTest-58557174 None] Acquiring lock "cinder-quobyte-174a0708-6a7e-4452-ba8c-88099a44b66e" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:18:14 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-cfe62333-0476-4043-9291-5a37575fc79f tempest-CreateVolumesFromImageTest-58557174 None] Lock "cinder-quobyte-174a0708-6a7e-4452-ba8c-88099a44b66e" acquired by "delete_volume" :: waited 0.023s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:18:14 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[956d98b2-5fdb-4286-85e0-982905dddbaf]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:18:14 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-cfe62333-0476-4043-9291-5a37575fc79f tempest-CreateVolumesFromImageTest-58557174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-174a0708-6a7e-4452-ba8c-88099a44b66e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:14 devstack sudo[113195]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:14 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f3a0120e-e621-499a-b6a7-1a7db2eafc4d tempest-CreateVolumesFromImageTest-58557174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.750s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:14 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-f3a0120e-e621-499a-b6a7-1a7db2eafc4d tempest-CreateVolumesFromImageTest-58557174 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:18:14 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-f3a0120e-e621-499a-b6a7-1a7db2eafc4d tempest-CreateVolumesFromImageTest-58557174 None] Deleted volume successfully. Jun 24 05:18:14 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f3a0120e-e621-499a-b6a7-1a7db2eafc4d tempest-CreateVolumesFromImageTest-58557174 None] Lock "cinder-ceefb9eb-6c7c-495d-bf23-23908560530e-delete_volume" released by "delete_volume" :: held 2.432s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:18:14 devstack sudo[113198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-174a0708-6a7e-4452-ba8c-88099a44b66e Jun 24 05:18:14 devstack sudo[113198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:15 devstack sudo[113198]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-cfe62333-0476-4043-9291-5a37575fc79f tempest-CreateVolumesFromImageTest-58557174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-174a0708-6a7e-4452-ba8c-88099a44b66e" returned: 0 in 0.804s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-cfe62333-0476-4043-9291-5a37575fc79f tempest-CreateVolumesFromImageTest-58557174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-174a0708-6a7e-4452-ba8c-88099a44b66e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:15 devstack sudo[113203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-174a0708-6a7e-4452-ba8c-88099a44b66e Jun 24 05:18:15 devstack sudo[113203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:15 devstack sudo[113203]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-cfe62333-0476-4043-9291-5a37575fc79f tempest-CreateVolumesFromImageTest-58557174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-174a0708-6a7e-4452-ba8c-88099a44b66e" returned: 0 in 0.682s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:15 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-cfe62333-0476-4043-9291-5a37575fc79f tempest-CreateVolumesFromImageTest-58557174 None] Lock "cinder-quobyte-174a0708-6a7e-4452-ba8c-88099a44b66e" released by "delete_volume" :: held 1.523s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:18:15 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-cfe62333-0476-4043-9291-5a37575fc79f tempest-CreateVolumesFromImageTest-58557174 None] Created reservations ['e4a92b92-d6fc-4de3-a140-a39a6f934ded', 'e63f538f-68fc-484a-bb93-272aeb4ec3f5', '14277e6b-d413-4b53-8d70-7e6e346975fd', '423a51de-a351-4dd4-b49f-76d3a49e4c7f'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:18:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-cfe62333-0476-4043-9291-5a37575fc79f tempest-CreateVolumesFromImageTest-58557174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:18:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-cfe62333-0476-4043-9291-5a37575fc79f tempest-CreateVolumesFromImageTest-58557174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:18:16 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-cfe62333-0476-4043-9291-5a37575fc79f tempest-CreateVolumesFromImageTest-58557174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:18:16 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-cfe62333-0476-4043-9291-5a37575fc79f tempest-CreateVolumesFromImageTest-58557174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:18:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-cfe62333-0476-4043-9291-5a37575fc79f tempest-CreateVolumesFromImageTest-58557174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:18:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-cfe62333-0476-4043-9291-5a37575fc79f tempest-CreateVolumesFromImageTest-58557174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:16 devstack sudo[113210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:18:16 devstack sudo[113210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:16 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-babbb3c5-5d99-4ee5-91ba-99fc4917b2e8 tempest-CreateVolumesFromImageTest-58557174 None] Acquiring lock "cinder-7261056e-1fe4-4594-9eec-d65e043a4912-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:18:16 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-babbb3c5-5d99-4ee5-91ba-99fc4917b2e8 tempest-CreateVolumesFromImageTest-58557174 None] Lock "cinder-7261056e-1fe4-4594-9eec-d65e043a4912-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:18:16 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-babbb3c5-5d99-4ee5-91ba-99fc4917b2e8 tempest-CreateVolumesFromImageTest-58557174 None] Acquiring lock "cinder-quobyte-7261056e-1fe4-4594-9eec-d65e043a4912" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:18:16 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-babbb3c5-5d99-4ee5-91ba-99fc4917b2e8 tempest-CreateVolumesFromImageTest-58557174 None] Lock "cinder-quobyte-7261056e-1fe4-4594-9eec-d65e043a4912" acquired by "delete_volume" :: waited 0.019s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:18:16 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[d502e81f-2588-41da-a10f-cdece83f543c]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:18:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-babbb3c5-5d99-4ee5-91ba-99fc4917b2e8 tempest-CreateVolumesFromImageTest-58557174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7261056e-1fe4-4594-9eec-d65e043a4912 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:16 devstack sudo[113210]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-cfe62333-0476-4043-9291-5a37575fc79f tempest-CreateVolumesFromImageTest-58557174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.721s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:16 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-cfe62333-0476-4043-9291-5a37575fc79f tempest-CreateVolumesFromImageTest-58557174 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:18:16 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-cfe62333-0476-4043-9291-5a37575fc79f tempest-CreateVolumesFromImageTest-58557174 None] Deleted volume successfully. Jun 24 05:18:16 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-cfe62333-0476-4043-9291-5a37575fc79f tempest-CreateVolumesFromImageTest-58557174 None] Lock "cinder-174a0708-6a7e-4452-ba8c-88099a44b66e-delete_volume" released by "delete_volume" :: held 2.471s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:18:16 devstack sudo[113215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7261056e-1fe4-4594-9eec-d65e043a4912 Jun 24 05:18:16 devstack sudo[113215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:17 devstack sudo[113215]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-babbb3c5-5d99-4ee5-91ba-99fc4917b2e8 tempest-CreateVolumesFromImageTest-58557174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7261056e-1fe4-4594-9eec-d65e043a4912" returned: 0 in 0.756s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-babbb3c5-5d99-4ee5-91ba-99fc4917b2e8 tempest-CreateVolumesFromImageTest-58557174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7261056e-1fe4-4594-9eec-d65e043a4912 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:17 devstack sudo[113220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7261056e-1fe4-4594-9eec-d65e043a4912 Jun 24 05:18:17 devstack sudo[113220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:18 devstack sudo[113220]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-babbb3c5-5d99-4ee5-91ba-99fc4917b2e8 tempest-CreateVolumesFromImageTest-58557174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7261056e-1fe4-4594-9eec-d65e043a4912" returned: 0 in 0.783s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:18 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-babbb3c5-5d99-4ee5-91ba-99fc4917b2e8 tempest-CreateVolumesFromImageTest-58557174 None] Lock "cinder-quobyte-7261056e-1fe4-4594-9eec-d65e043a4912" released by "delete_volume" :: held 1.604s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:18:18 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-babbb3c5-5d99-4ee5-91ba-99fc4917b2e8 tempest-CreateVolumesFromImageTest-58557174 None] Created reservations ['c5e06ded-3f1a-4404-8d7e-71ad7603233d', '068e7451-ada8-478b-b737-5c819976e6d2', '913da72e-0410-4f5e-ba3a-87b8870e2fb0', 'd323eba5-cabc-4b38-af04-4a52a5fd44fb'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:18:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-babbb3c5-5d99-4ee5-91ba-99fc4917b2e8 tempest-CreateVolumesFromImageTest-58557174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:18:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-babbb3c5-5d99-4ee5-91ba-99fc4917b2e8 tempest-CreateVolumesFromImageTest-58557174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:18:18 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-babbb3c5-5d99-4ee5-91ba-99fc4917b2e8 tempest-CreateVolumesFromImageTest-58557174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:18:18 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-babbb3c5-5d99-4ee5-91ba-99fc4917b2e8 tempest-CreateVolumesFromImageTest-58557174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:18:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-babbb3c5-5d99-4ee5-91ba-99fc4917b2e8 tempest-CreateVolumesFromImageTest-58557174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:18:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-babbb3c5-5d99-4ee5-91ba-99fc4917b2e8 tempest-CreateVolumesFromImageTest-58557174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:18 devstack sudo[113262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:18:18 devstack sudo[113262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:18 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-cf485608-ff61-472d-9c9c-7695f45380ed tempest-CreateVolumesFromImageTest-58557174 None] Acquiring lock "cinder-28f57a8c-c99a-4f0a-9921-146a15b6e71e-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:18:18 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-cf485608-ff61-472d-9c9c-7695f45380ed tempest-CreateVolumesFromImageTest-58557174 None] Lock "cinder-28f57a8c-c99a-4f0a-9921-146a15b6e71e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:18:18 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-cf485608-ff61-472d-9c9c-7695f45380ed tempest-CreateVolumesFromImageTest-58557174 None] Acquiring lock "cinder-quobyte-28f57a8c-c99a-4f0a-9921-146a15b6e71e" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:18:18 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-cf485608-ff61-472d-9c9c-7695f45380ed tempest-CreateVolumesFromImageTest-58557174 None] Lock "cinder-quobyte-28f57a8c-c99a-4f0a-9921-146a15b6e71e" acquired by "delete_volume" :: waited 0.022s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:18:18 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08cc43a-2d9d-495c-b277-92ce617b70e2]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:18:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-cf485608-ff61-472d-9c9c-7695f45380ed tempest-CreateVolumesFromImageTest-58557174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-28f57a8c-c99a-4f0a-9921-146a15b6e71e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:18 devstack sudo[113265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-28f57a8c-c99a-4f0a-9921-146a15b6e71e Jun 24 05:18:18 devstack sudo[113265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:19 devstack sudo[113262]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-babbb3c5-5d99-4ee5-91ba-99fc4917b2e8 tempest-CreateVolumesFromImageTest-58557174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.718s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:19 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-babbb3c5-5d99-4ee5-91ba-99fc4917b2e8 tempest-CreateVolumesFromImageTest-58557174 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:18:19 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-babbb3c5-5d99-4ee5-91ba-99fc4917b2e8 tempest-CreateVolumesFromImageTest-58557174 None] Deleted volume successfully. Jun 24 05:18:19 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-babbb3c5-5d99-4ee5-91ba-99fc4917b2e8 tempest-CreateVolumesFromImageTest-58557174 None] Lock "cinder-7261056e-1fe4-4594-9eec-d65e043a4912-delete_volume" released by "delete_volume" :: held 2.604s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:18:19 devstack sudo[113265]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-cf485608-ff61-472d-9c9c-7695f45380ed tempest-CreateVolumesFromImageTest-58557174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-28f57a8c-c99a-4f0a-9921-146a15b6e71e" returned: 0 in 0.797s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-cf485608-ff61-472d-9c9c-7695f45380ed tempest-CreateVolumesFromImageTest-58557174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-28f57a8c-c99a-4f0a-9921-146a15b6e71e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:19 devstack sudo[113271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-28f57a8c-c99a-4f0a-9921-146a15b6e71e Jun 24 05:18:19 devstack sudo[113271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:20 devstack sudo[113271]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-cf485608-ff61-472d-9c9c-7695f45380ed tempest-CreateVolumesFromImageTest-58557174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-28f57a8c-c99a-4f0a-9921-146a15b6e71e" returned: 0 in 0.672s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:20 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-cf485608-ff61-472d-9c9c-7695f45380ed tempest-CreateVolumesFromImageTest-58557174 None] Lock "cinder-quobyte-28f57a8c-c99a-4f0a-9921-146a15b6e71e" released by "delete_volume" :: held 1.512s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:18:20 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-cf485608-ff61-472d-9c9c-7695f45380ed tempest-CreateVolumesFromImageTest-58557174 None] Created reservations ['8b24f5fd-4661-4e03-9e06-2b1ea70b8f7e', 'aeba0428-49c2-433b-981b-2d7ef1125683', 'efa9cba9-5091-4664-a1a3-614aa8028768', '156b3b96-d152-49d9-9892-cc927007e977'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:18:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-cf485608-ff61-472d-9c9c-7695f45380ed tempest-CreateVolumesFromImageTest-58557174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:18:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-cf485608-ff61-472d-9c9c-7695f45380ed tempest-CreateVolumesFromImageTest-58557174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:18:20 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-cf485608-ff61-472d-9c9c-7695f45380ed tempest-CreateVolumesFromImageTest-58557174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:18:20 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-cf485608-ff61-472d-9c9c-7695f45380ed tempest-CreateVolumesFromImageTest-58557174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:18:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-cf485608-ff61-472d-9c9c-7695f45380ed tempest-CreateVolumesFromImageTest-58557174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:18:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-cf485608-ff61-472d-9c9c-7695f45380ed tempest-CreateVolumesFromImageTest-58557174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:20 devstack sudo[113274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:18:20 devstack sudo[113274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:21 devstack sudo[113274]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-cf485608-ff61-472d-9c9c-7695f45380ed tempest-CreateVolumesFromImageTest-58557174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.696s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:21 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-cf485608-ff61-472d-9c9c-7695f45380ed tempest-CreateVolumesFromImageTest-58557174 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:18:21 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-cf485608-ff61-472d-9c9c-7695f45380ed tempest-CreateVolumesFromImageTest-58557174 None] Deleted volume successfully. Jun 24 05:18:21 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-cf485608-ff61-472d-9c9c-7695f45380ed tempest-CreateVolumesFromImageTest-58557174 None] Lock "cinder-28f57a8c-c99a-4f0a-9921-146a15b6e71e-delete_volume" released by "delete_volume" :: held 2.448s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:18:22 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-3706ca8f-9012-40cd-aff7-97d148e1882e req-85e25f1d-6324-4a63-89f3-73d52217a44a tempest-TestShelveInstance-413355169 None] Terminate volume connection completed successfully. Jun 24 05:18:22 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-3706ca8f-9012-40cd-aff7-97d148e1882e req-85e25f1d-6324-4a63-89f3-73d52217a44a tempest-TestShelveInstance-413355169 None] Deleting attachment 24a36804-62e6-4387-ba96-e9e8786250dd. {{(pid=93830) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 05:18:23 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b744d4f-f78f-4fc2-ba7b-9f60b2c94615 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:18:23 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1b744d4f-f78f-4fc2-ba7b-9f60b2c94615 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Flow 'volume_create_manager' (cf1e8b62-4822-4274-b9f0-fccffbb1f9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:18:23 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1b744d4f-f78f-4fc2-ba7b-9f60b2c94615 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fef8d3de-41d6-44d2-8583-fb41247a58d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:23 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1b744d4f-f78f-4fc2-ba7b-9f60b2c94615 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fef8d3de-41d6-44d2-8583-fb41247a58d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-990293135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=756406d8-fb1d-4312-971f-577baf729589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9136d2ac08804847b692da4fe94ec7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:18:24Z,use_quota=True,user_id='1765f4280d4e4fb6bfd062fe7a785196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1b744d4f-f78f-4fc2-ba7b-9f60b2c94615 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (463830d2-56d0-4bd0-b53a-974d7719c93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1b744d4f-f78f-4fc2-ba7b-9f60b2c94615 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (463830d2-56d0-4bd0-b53a-974d7719c93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1b744d4f-f78f-4fc2-ba7b-9f60b2c94615 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1153e691-8c6b-4b24-97bf-44b9b31b9865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1b744d4f-f78f-4fc2-ba7b-9f60b2c94615 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1153e691-8c6b-4b24-97bf-44b9b31b9865) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '756406d8-fb1d-4312-971f-577baf729589', 'volume_name': 'volume-756406d8-fb1d-4312-971f-577baf729589', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1b744d4f-f78f-4fc2-ba7b-9f60b2c94615 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f55bfa39-78bb-4b01-821e-6a5d676e765c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1b744d4f-f78f-4fc2-ba7b-9f60b2c94615 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f55bfa39-78bb-4b01-821e-6a5d676e765c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1b744d4f-f78f-4fc2-ba7b-9f60b2c94615 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91cb455a-c964-4cb7-a83d-0c1e9ca920ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:24 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-1b744d4f-f78f-4fc2-ba7b-9f60b2c94615 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Volume 756406d8-fb1d-4312-971f-577baf729589: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-756406d8-fb1d-4312-971f-577baf729589', 'volume_size': 1} Jun 24 05:18:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1b744d4f-f78f-4fc2-ba7b-9f60b2c94615 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:18:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1b744d4f-f78f-4fc2-ba7b-9f60b2c94615 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:18:24 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-1b744d4f-f78f-4fc2-ba7b-9f60b2c94615 tempest-CreateVolumesFromSnapshotTest-1660672491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-990293135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=756406d8-fb1d-4312-971f-577baf729589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9136d2ac08804847b692da4fe94ec7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:18:24Z,use_quota=True,user_id='1765f4280d4e4fb6bfd062fe7a785196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:18:24 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-1b744d4f-f78f-4fc2-ba7b-9f60b2c94615 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Creating volume 756406d8-fb1d-4312-971f-577baf729589 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:18:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1b744d4f-f78f-4fc2-ba7b-9f60b2c94615 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:18:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1b744d4f-f78f-4fc2-ba7b-9f60b2c94615 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:18:24 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-1b744d4f-f78f-4fc2-ba7b-9f60b2c94615 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:18:24 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-1b744d4f-f78f-4fc2-ba7b-9f60b2c94615 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:18:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1b744d4f-f78f-4fc2-ba7b-9f60b2c94615 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:18:24 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-1b744d4f-f78f-4fc2-ba7b-9f60b2c94615 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:18:24 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-1b744d4f-f78f-4fc2-ba7b-9f60b2c94615 tempest-CreateVolumesFromSnapshotTest-1660672491 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:18:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1b744d4f-f78f-4fc2-ba7b-9f60b2c94615 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:24 devstack sudo[113283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589 1073741824 Jun 24 05:18:24 devstack sudo[113283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:24 devstack sudo[113283]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1b744d4f-f78f-4fc2-ba7b-9f60b2c94615 tempest-CreateVolumesFromSnapshotTest-1660672491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589 1073741824" returned: 0 in 0.903s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1b744d4f-f78f-4fc2-ba7b-9f60b2c94615 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:25 devstack sudo[113290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589 Jun 24 05:18:25 devstack sudo[113290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:25 devstack sudo[113290]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-1b744d4f-f78f-4fc2-ba7b-9f60b2c94615 tempest-CreateVolumesFromSnapshotTest-1660672491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589" returned: 0 in 0.692s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:25 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-1b744d4f-f78f-4fc2-ba7b-9f60b2c94615 tempest-CreateVolumesFromSnapshotTest-1660672491 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:18:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-1b744d4f-f78f-4fc2-ba7b-9f60b2c94615 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.640s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:18:25 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1b744d4f-f78f-4fc2-ba7b-9f60b2c94615 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91cb455a-c964-4cb7-a83d-0c1e9ca920ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-756406d8-fb1d-4312-971f-577baf729589', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:25 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1b744d4f-f78f-4fc2-ba7b-9f60b2c94615 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (033bb996-6bbf-43df-a9b5-962db82ba094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:25 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-1b744d4f-f78f-4fc2-ba7b-9f60b2c94615 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Volume volume-756406d8-fb1d-4312-971f-577baf729589 (756406d8-fb1d-4312-971f-577baf729589): created successfully Jun 24 05:18:25 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1b744d4f-f78f-4fc2-ba7b-9f60b2c94615 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (033bb996-6bbf-43df-a9b5-962db82ba094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:25 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-1b744d4f-f78f-4fc2-ba7b-9f60b2c94615 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Flow 'volume_create_manager' (cf1e8b62-4822-4274-b9f0-fccffbb1f9d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:18:25 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-1b744d4f-f78f-4fc2-ba7b-9f60b2c94615 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Created volume successfully. Jun 24 05:18:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-0b8e33c0-e21d-4cab-98b0-0116562e8990 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:18:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-0b8e33c0-e21d-4cab-98b0-0116562e8990 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:18:26 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-0b8e33c0-e21d-4cab-98b0-0116562e8990 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Creating offline snapshot f8b24591-9cb0-4736-92ec-04ffae183294 of volume 756406d8-fb1d-4312-971f-577baf729589 {{(pid=93830) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 05:18:26 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[f645f663-11c5-4601-ba52-ac5e51cce268]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:18:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0b8e33c0-e21d-4cab-98b0-0116562e8990 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:26 devstack sudo[113297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589 Jun 24 05:18:26 devstack sudo[113297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:27 devstack sudo[113297]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0b8e33c0-e21d-4cab-98b0-0116562e8990 tempest-CreateVolumesFromSnapshotTest-1660672491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589" returned: 0 in 0.742s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0b8e33c0-e21d-4cab-98b0-0116562e8990 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589.f8b24591-9cb0-4736-92ec-04ffae183294 1G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:27 devstack sudo[113302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589.f8b24591-9cb0-4736-92ec-04ffae183294 1G Jun 24 05:18:27 devstack sudo[113302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:27 devstack sudo[113302]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0b8e33c0-e21d-4cab-98b0-0116562e8990 tempest-CreateVolumesFromSnapshotTest-1660672491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589.f8b24591-9cb0-4736-92ec-04ffae183294 1G" returned: 0 in 0.840s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0b8e33c0-e21d-4cab-98b0-0116562e8990 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-756406d8-fb1d-4312-971f-577baf729589 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589.f8b24591-9cb0-4736-92ec-04ffae183294 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:27 devstack sudo[113316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-756406d8-fb1d-4312-971f-577baf729589 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589.f8b24591-9cb0-4736-92ec-04ffae183294 Jun 24 05:18:27 devstack sudo[113316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-2d8f3fec-fcd6-4b21-9ad0-11aa63338059 req-749d2316-ef9f-46a2-9ad4-a8380b7f9593 tempest-TestShelveInstance-413355169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:18:28 devstack sudo[113316]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0b8e33c0-e21d-4cab-98b0-0116562e8990 tempest-CreateVolumesFromSnapshotTest-1660672491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-756406d8-fb1d-4312-971f-577baf729589 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589.f8b24591-9cb0-4736-92ec-04ffae183294" returned: 0 in 0.703s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:28 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-0b8e33c0-e21d-4cab-98b0-0116562e8990 tempest-CreateVolumesFromSnapshotTest-1660672491 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589.f8b24591-9cb0-4736-92ec-04ffae183294 is being set with open permissions: ugo+rw Jun 24 05:18:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0b8e33c0-e21d-4cab-98b0-0116562e8990 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589.f8b24591-9cb0-4736-92ec-04ffae183294 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:28 devstack sudo[113321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589.f8b24591-9cb0-4736-92ec-04ffae183294 Jun 24 05:18:28 devstack sudo[113321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:29 devstack sudo[113321]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0b8e33c0-e21d-4cab-98b0-0116562e8990 tempest-CreateVolumesFromSnapshotTest-1660672491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589.f8b24591-9cb0-4736-92ec-04ffae183294" returned: 0 in 0.632s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0b8e33c0-e21d-4cab-98b0-0116562e8990 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:29 devstack sudo[113324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589.info Jun 24 05:18:29 devstack sudo[113324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:29 devstack sudo[113324]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0b8e33c0-e21d-4cab-98b0-0116562e8990 tempest-CreateVolumesFromSnapshotTest-1660672491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589.info" returned: 0 in 0.630s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:29 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-0b8e33c0-e21d-4cab-98b0-0116562e8990 tempest-CreateVolumesFromSnapshotTest-1660672491 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589.info is being set with open permissions: ugo+rw Jun 24 05:18:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0b8e33c0-e21d-4cab-98b0-0116562e8990 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:29 devstack sudo[113327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589.info Jun 24 05:18:29 devstack sudo[113327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:30 devstack sudo[113327]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0b8e33c0-e21d-4cab-98b0-0116562e8990 tempest-CreateVolumesFromSnapshotTest-1660672491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589.info" returned: 0 in 0.617s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-0b8e33c0-e21d-4cab-98b0-0116562e8990 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.249s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:18:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-2d8f3fec-fcd6-4b21-9ad0-11aa63338059 req-749d2316-ef9f-46a2-9ad4-a8380b7f9593 tempest-TestShelveInstance-413355169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.369s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:18:30 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-0b8e33c0-e21d-4cab-98b0-0116562e8990 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Create snapshot completed successfully Jun 24 05:18:30 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[92834b57-745c-496e-8447-85766de5d49b]: (4, 'raw') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:18:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-2d8f3fec-fcd6-4b21-9ad0-11aa63338059 req-749d2316-ef9f-46a2-9ad4-a8380b7f9593 tempest-TestShelveInstance-413355169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6536f660-fe0e-4e47-be61-f45478126152 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:30 devstack sudo[113330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6536f660-fe0e-4e47-be61-f45478126152 Jun 24 05:18:30 devstack sudo[113330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:31 devstack sudo[113330]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-2d8f3fec-fcd6-4b21-9ad0-11aa63338059 req-749d2316-ef9f-46a2-9ad4-a8380b7f9593 tempest-TestShelveInstance-413355169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6536f660-fe0e-4e47-be61-f45478126152" returned: 0 in 0.760s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-2d8f3fec-fcd6-4b21-9ad0-11aa63338059 req-749d2316-ef9f-46a2-9ad4-a8380b7f9593 tempest-TestShelveInstance-413355169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6536f660-fe0e-4e47-be61-f45478126152 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:31 devstack sudo[113335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6536f660-fe0e-4e47-be61-f45478126152 Jun 24 05:18:31 devstack sudo[113335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:31 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-69e5c206-0362-4549-9ed3-534d6437baf1 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:18:31 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-69e5c206-0362-4549-9ed3-534d6437baf1 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Flow 'volume_create_manager' (3ae253a3-c1ae-46a1-8e2c-600c6261fad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:18:31 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-69e5c206-0362-4549-9ed3-534d6437baf1 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cddc7c0-75d3-4507-bf85-f961ed1580e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:31 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-69e5c206-0362-4549-9ed3-534d6437baf1 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cddc7c0-75d3-4507-bf85-f961ed1580e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-348951028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0977641-a965-4449-ba30-ac099777be6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9136d2ac08804847b692da4fe94ec7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:18:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:18:32Z,use_quota=True,user_id='1765f4280d4e4fb6bfd062fe7a785196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:31 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-69e5c206-0362-4549-9ed3-534d6437baf1 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be3a6053-f4f5-4988-8bd9-4df3c17dd3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:31 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-69e5c206-0362-4549-9ed3-534d6437baf1 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be3a6053-f4f5-4988-8bd9-4df3c17dd3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:32 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-69e5c206-0362-4549-9ed3-534d6437baf1 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88d4ae02-968d-4421-8d54-12b203543ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:32 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-69e5c206-0362-4549-9ed3-534d6437baf1 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88d4ae02-968d-4421-8d54-12b203543ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0977641-a965-4449-ba30-ac099777be6f', 'volume_name': 'volume-f0977641-a965-4449-ba30-ac099777be6f', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:32 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-69e5c206-0362-4549-9ed3-534d6437baf1 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (695d7095-1b8f-4ddb-a3d2-d07cd139efd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:32 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-69e5c206-0362-4549-9ed3-534d6437baf1 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (695d7095-1b8f-4ddb-a3d2-d07cd139efd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:32 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-69e5c206-0362-4549-9ed3-534d6437baf1 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ca446d9-614d-439a-937d-7f986d496601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:32 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-69e5c206-0362-4549-9ed3-534d6437baf1 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Volume f0977641-a965-4449-ba30-ac099777be6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0977641-a965-4449-ba30-ac099777be6f', 'volume_size': 1} Jun 24 05:18:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-69e5c206-0362-4549-9ed3-534d6437baf1 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:18:32 devstack sudo[113335]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-2d8f3fec-fcd6-4b21-9ad0-11aa63338059 req-749d2316-ef9f-46a2-9ad4-a8380b7f9593 tempest-TestShelveInstance-413355169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6536f660-fe0e-4e47-be61-f45478126152" returned: 1 in 0.785s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-2d8f3fec-fcd6-4b21-9ad0-11aa63338059 req-749d2316-ef9f-46a2-9ad4-a8380b7f9593 tempest-TestShelveInstance-413355169 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6536f660-fe0e-4e47-be61-f45478126152' failed. Not Retrying. {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 05:18:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-2d8f3fec-fcd6-4b21-9ad0-11aa63338059 req-749d2316-ef9f-46a2-9ad4-a8380b7f9593 tempest-TestShelveInstance-413355169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.583s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:18:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-69e5c206-0362-4549-9ed3-534d6437baf1 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.068s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:18:32 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-69e5c206-0362-4549-9ed3-534d6437baf1 tempest-CreateVolumesFromSnapshotTest-1660672491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-348951028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0977641-a965-4449-ba30-ac099777be6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9136d2ac08804847b692da4fe94ec7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:18:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:18:32Z,use_quota=True,user_id='1765f4280d4e4fb6bfd062fe7a785196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:18:32 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-69e5c206-0362-4549-9ed3-534d6437baf1 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Creating volume f0977641-a965-4449-ba30-ac099777be6f {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:18:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-69e5c206-0362-4549-9ed3-534d6437baf1 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:18:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-69e5c206-0362-4549-9ed3-534d6437baf1 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:18:32 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-69e5c206-0362-4549-9ed3-534d6437baf1 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:18:32 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-69e5c206-0362-4549-9ed3-534d6437baf1 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:18:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-69e5c206-0362-4549-9ed3-534d6437baf1 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:18:32 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-69e5c206-0362-4549-9ed3-534d6437baf1 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:18:32 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-69e5c206-0362-4549-9ed3-534d6437baf1 tempest-CreateVolumesFromSnapshotTest-1660672491 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:18:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-69e5c206-0362-4549-9ed3-534d6437baf1 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f0977641-a965-4449-ba30-ac099777be6f 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:32 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-2d8f3fec-fcd6-4b21-9ad0-11aa63338059 req-749d2316-ef9f-46a2-9ad4-a8380b7f9593 tempest-TestShelveInstance-413355169 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05', 'name': 'volume-6536f660-fe0e-4e47-be61-f45478126152', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0c88220f-dab4-4815-b320-4cdea858ff18', 'enforce_multipath': True} {{(pid=93830) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 05:18:32 devstack sudo[113340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f0977641-a965-4449-ba30-ac099777be6f 1073741824 Jun 24 05:18:32 devstack sudo[113340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:32 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-2d8f3fec-fcd6-4b21-9ad0-11aa63338059 req-749d2316-ef9f-46a2-9ad4-a8380b7f9593 tempest-TestShelveInstance-413355169 None] attachment_update completed successfully. Jun 24 05:18:32 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d86c814-330b-4e6e-8143-6916cdc3107b tempest-CreateVolumesFromSnapshotTest-1660672491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:18:32 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4d86c814-330b-4e6e-8143-6916cdc3107b tempest-CreateVolumesFromSnapshotTest-1660672491 None] Flow 'volume_create_manager' (0770b681-5fe0-4248-bace-9168afef0380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:18:32 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4d86c814-330b-4e6e-8143-6916cdc3107b tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b279db18-57b5-4942-9d2e-59e85113e3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:32 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4d86c814-330b-4e6e-8143-6916cdc3107b tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b279db18-57b5-4942-9d2e-59e85113e3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1898435401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79d9414c-aea5-4b75-b713-0b8528d27023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9136d2ac08804847b692da4fe94ec7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:18:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:18:32Z,use_quota=True,user_id='1765f4280d4e4fb6bfd062fe7a785196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:32 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4d86c814-330b-4e6e-8143-6916cdc3107b tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1a8a404-7289-46f0-a99f-c5d2bfdb8c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:32 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4d86c814-330b-4e6e-8143-6916cdc3107b tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1a8a404-7289-46f0-a99f-c5d2bfdb8c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:32 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4d86c814-330b-4e6e-8143-6916cdc3107b tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a93037eb-116d-4a77-a035-b5e8b86402d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:32 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4d86c814-330b-4e6e-8143-6916cdc3107b tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a93037eb-116d-4a77-a035-b5e8b86402d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79d9414c-aea5-4b75-b713-0b8528d27023', 'volume_name': 'volume-79d9414c-aea5-4b75-b713-0b8528d27023', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:32 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4d86c814-330b-4e6e-8143-6916cdc3107b tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11bf2bc1-e164-4f35-a36b-de3feeb1a98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:32 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4d86c814-330b-4e6e-8143-6916cdc3107b tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11bf2bc1-e164-4f35-a36b-de3feeb1a98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:32 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4d86c814-330b-4e6e-8143-6916cdc3107b tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2edd071f-d10e-4c2f-9231-eca20495cfcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:32 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-4d86c814-330b-4e6e-8143-6916cdc3107b tempest-CreateVolumesFromSnapshotTest-1660672491 None] Volume 79d9414c-aea5-4b75-b713-0b8528d27023: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79d9414c-aea5-4b75-b713-0b8528d27023', 'volume_size': 1} Jun 24 05:18:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4d86c814-330b-4e6e-8143-6916cdc3107b tempest-CreateVolumesFromSnapshotTest-1660672491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:18:32 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1181a65-9362-46f1-955b-09ec1394dc26 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:18:32 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e1181a65-9362-46f1-955b-09ec1394dc26 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Flow 'volume_create_manager' (6b55970d-e57c-49f4-a9af-1d07902586bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:18:32 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e1181a65-9362-46f1-955b-09ec1394dc26 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (020e9dd2-ab8f-4f57-a28b-6dc47ca28d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:32 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e1181a65-9362-46f1-955b-09ec1394dc26 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (020e9dd2-ab8f-4f57-a28b-6dc47ca28d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1417960519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d6f0ced-cd5d-41d3-9fec-c4c4af684305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9136d2ac08804847b692da4fe94ec7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:18:33Z,use_quota=True,user_id='1765f4280d4e4fb6bfd062fe7a785196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:32 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e1181a65-9362-46f1-955b-09ec1394dc26 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81a7c623-afea-45ba-8265-08b9c50cba06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:32 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e1181a65-9362-46f1-955b-09ec1394dc26 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81a7c623-afea-45ba-8265-08b9c50cba06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:32 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e1181a65-9362-46f1-955b-09ec1394dc26 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ada426af-05ad-4832-b252-d1e2bd0e3e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:32 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e1181a65-9362-46f1-955b-09ec1394dc26 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ada426af-05ad-4832-b252-d1e2bd0e3e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d6f0ced-cd5d-41d3-9fec-c4c4af684305', 'volume_name': 'volume-3d6f0ced-cd5d-41d3-9fec-c4c4af684305', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:32 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e1181a65-9362-46f1-955b-09ec1394dc26 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (573ae272-fb86-4840-bfb0-57093ad8cfb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:32 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e1181a65-9362-46f1-955b-09ec1394dc26 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (573ae272-fb86-4840-bfb0-57093ad8cfb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:32 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e1181a65-9362-46f1-955b-09ec1394dc26 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e90aa931-c4c7-432b-b260-7f6be163e82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:32 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-e1181a65-9362-46f1-955b-09ec1394dc26 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Volume 3d6f0ced-cd5d-41d3-9fec-c4c4af684305: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d6f0ced-cd5d-41d3-9fec-c4c4af684305', 'volume_size': 1} Jun 24 05:18:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e1181a65-9362-46f1-955b-09ec1394dc26 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:18:33 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-31b5e008-d133-4642-bf5c-2ef5e97e3e4f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:18:33 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-31b5e008-d133-4642-bf5c-2ef5e97e3e4f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Flow 'volume_create_manager' (1cfd1dc8-cb86-44cf-b594-11aa8280fce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:18:33 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-31b5e008-d133-4642-bf5c-2ef5e97e3e4f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b017c44e-b36b-4c11-89c7-35e0b0428036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:33 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-31b5e008-d133-4642-bf5c-2ef5e97e3e4f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b017c44e-b36b-4c11-89c7-35e0b0428036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-886405093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0f64bea-c10f-428f-9006-b82d717d1235,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9136d2ac08804847b692da4fe94ec7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:18:33Z,use_quota=True,user_id='1765f4280d4e4fb6bfd062fe7a785196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:33 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-31b5e008-d133-4642-bf5c-2ef5e97e3e4f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e1fb774-6769-4d1f-b1a8-16ff022c9f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:33 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-31b5e008-d133-4642-bf5c-2ef5e97e3e4f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e1fb774-6769-4d1f-b1a8-16ff022c9f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:33 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-31b5e008-d133-4642-bf5c-2ef5e97e3e4f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f243af-5a1b-4526-927f-4ec1a4e5ee47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:33 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-31b5e008-d133-4642-bf5c-2ef5e97e3e4f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f243af-5a1b-4526-927f-4ec1a4e5ee47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0f64bea-c10f-428f-9006-b82d717d1235', 'volume_name': 'volume-d0f64bea-c10f-428f-9006-b82d717d1235', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:33 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-31b5e008-d133-4642-bf5c-2ef5e97e3e4f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (016a813c-01cf-4848-b9e9-3b1c9d6a0e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:33 devstack sudo[113340]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:33 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-31b5e008-d133-4642-bf5c-2ef5e97e3e4f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (016a813c-01cf-4848-b9e9-3b1c9d6a0e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:33 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-31b5e008-d133-4642-bf5c-2ef5e97e3e4f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8009f26f-d2d9-41e3-afc5-3289f3b769b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:33 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-31b5e008-d133-4642-bf5c-2ef5e97e3e4f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Volume d0f64bea-c10f-428f-9006-b82d717d1235: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0f64bea-c10f-428f-9006-b82d717d1235', 'volume_size': 1} Jun 24 05:18:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-31b5e008-d133-4642-bf5c-2ef5e97e3e4f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:18:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-69e5c206-0362-4549-9ed3-534d6437baf1 tempest-CreateVolumesFromSnapshotTest-1660672491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f0977641-a965-4449-ba30-ac099777be6f 1073741824" returned: 0 in 1.077s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-69e5c206-0362-4549-9ed3-534d6437baf1 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f0977641-a965-4449-ba30-ac099777be6f {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:33 devstack sudo[113346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f0977641-a965-4449-ba30-ac099777be6f Jun 24 05:18:33 devstack sudo[113346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:33 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6a27ff1-9431-4937-8280-2809d7d15dd5 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:18:33 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f6a27ff1-9431-4937-8280-2809d7d15dd5 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Flow 'volume_create_manager' (80b7dd85-857d-4867-92ab-a4e3a8ca2eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:18:33 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f6a27ff1-9431-4937-8280-2809d7d15dd5 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80dc0f97-0c04-470e-94a8-52a49eca5cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:33 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f6a27ff1-9431-4937-8280-2809d7d15dd5 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80dc0f97-0c04-470e-94a8-52a49eca5cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-263621453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b9b98a4-0ed8-4684-a9d9-1dd7fdafac52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9136d2ac08804847b692da4fe94ec7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:18:33Z,use_quota=True,user_id='1765f4280d4e4fb6bfd062fe7a785196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:33 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f6a27ff1-9431-4937-8280-2809d7d15dd5 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c5a408d-6ed8-48d0-a557-198b5f16d1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:33 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f6a27ff1-9431-4937-8280-2809d7d15dd5 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c5a408d-6ed8-48d0-a557-198b5f16d1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:33 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f6a27ff1-9431-4937-8280-2809d7d15dd5 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ea318eb-6c5a-4602-9540-51c39b331f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:33 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f6a27ff1-9431-4937-8280-2809d7d15dd5 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ea318eb-6c5a-4602-9540-51c39b331f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b9b98a4-0ed8-4684-a9d9-1dd7fdafac52', 'volume_name': 'volume-6b9b98a4-0ed8-4684-a9d9-1dd7fdafac52', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:33 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f6a27ff1-9431-4937-8280-2809d7d15dd5 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c40a780-5032-41b1-b0fc-68fb368ad482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:33 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f6a27ff1-9431-4937-8280-2809d7d15dd5 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c40a780-5032-41b1-b0fc-68fb368ad482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:33 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f6a27ff1-9431-4937-8280-2809d7d15dd5 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2ff5d9c-3af8-4e4a-8e3b-869b433b6b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:33 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-f6a27ff1-9431-4937-8280-2809d7d15dd5 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Volume 6b9b98a4-0ed8-4684-a9d9-1dd7fdafac52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b9b98a4-0ed8-4684-a9d9-1dd7fdafac52', 'volume_size': 1} Jun 24 05:18:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f6a27ff1-9431-4937-8280-2809d7d15dd5 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:18:33 devstack sudo[113346]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-69e5c206-0362-4549-9ed3-534d6437baf1 tempest-CreateVolumesFromSnapshotTest-1660672491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f0977641-a965-4449-ba30-ac099777be6f" returned: 0 in 0.684s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:33 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-69e5c206-0362-4549-9ed3-534d6437baf1 tempest-CreateVolumesFromSnapshotTest-1660672491 None] <== create_volume: return (1814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:18:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-69e5c206-0362-4549-9ed3-534d6437baf1 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.829s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:18:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4d86c814-330b-4e6e-8143-6916cdc3107b tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.490s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:18:33 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-4d86c814-330b-4e6e-8143-6916cdc3107b tempest-CreateVolumesFromSnapshotTest-1660672491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1898435401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79d9414c-aea5-4b75-b713-0b8528d27023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9136d2ac08804847b692da4fe94ec7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:18:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:18:32Z,use_quota=True,user_id='1765f4280d4e4fb6bfd062fe7a785196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:18:33 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-4d86c814-330b-4e6e-8143-6916cdc3107b tempest-CreateVolumesFromSnapshotTest-1660672491 None] Creating volume 79d9414c-aea5-4b75-b713-0b8528d27023 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:18:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4d86c814-330b-4e6e-8143-6916cdc3107b tempest-CreateVolumesFromSnapshotTest-1660672491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:18:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4d86c814-330b-4e6e-8143-6916cdc3107b tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:18:33 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-4d86c814-330b-4e6e-8143-6916cdc3107b tempest-CreateVolumesFromSnapshotTest-1660672491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:18:33 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-4d86c814-330b-4e6e-8143-6916cdc3107b tempest-CreateVolumesFromSnapshotTest-1660672491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:18:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4d86c814-330b-4e6e-8143-6916cdc3107b tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:18:33 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-4d86c814-330b-4e6e-8143-6916cdc3107b tempest-CreateVolumesFromSnapshotTest-1660672491 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:18:33 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-4d86c814-330b-4e6e-8143-6916cdc3107b tempest-CreateVolumesFromSnapshotTest-1660672491 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:18:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4d86c814-330b-4e6e-8143-6916cdc3107b tempest-CreateVolumesFromSnapshotTest-1660672491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-79d9414c-aea5-4b75-b713-0b8528d27023 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:33 devstack sudo[113349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-79d9414c-aea5-4b75-b713-0b8528d27023 1073741824 Jun 24 05:18:33 devstack sudo[113349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:33 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-69e5c206-0362-4549-9ed3-534d6437baf1 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ca446d9-614d-439a-937d-7f986d496601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0977641-a965-4449-ba30-ac099777be6f', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:33 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-69e5c206-0362-4549-9ed3-534d6437baf1 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88f98bcd-37ac-43c7-bf67-102a610beab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:33 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-69e5c206-0362-4549-9ed3-534d6437baf1 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Volume volume-f0977641-a965-4449-ba30-ac099777be6f (f0977641-a965-4449-ba30-ac099777be6f): created successfully Jun 24 05:18:33 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-69e5c206-0362-4549-9ed3-534d6437baf1 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88f98bcd-37ac-43c7-bf67-102a610beab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:33 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-69e5c206-0362-4549-9ed3-534d6437baf1 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Flow 'volume_create_manager' (3ae253a3-c1ae-46a1-8e2c-600c6261fad2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:18:34 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-69e5c206-0362-4549-9ed3-534d6437baf1 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Created volume successfully. Jun 24 05:18:34 devstack sudo[113349]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4d86c814-330b-4e6e-8143-6916cdc3107b tempest-CreateVolumesFromSnapshotTest-1660672491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-79d9414c-aea5-4b75-b713-0b8528d27023 1073741824" returned: 0 in 0.810s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4d86c814-330b-4e6e-8143-6916cdc3107b tempest-CreateVolumesFromSnapshotTest-1660672491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-79d9414c-aea5-4b75-b713-0b8528d27023 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:34 devstack sudo[113354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-79d9414c-aea5-4b75-b713-0b8528d27023 Jun 24 05:18:34 devstack sudo[113354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:35 devstack sudo[113354]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4d86c814-330b-4e6e-8143-6916cdc3107b tempest-CreateVolumesFromSnapshotTest-1660672491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-79d9414c-aea5-4b75-b713-0b8528d27023" returned: 0 in 0.653s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:35 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-4d86c814-330b-4e6e-8143-6916cdc3107b tempest-CreateVolumesFromSnapshotTest-1660672491 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:18:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4d86c814-330b-4e6e-8143-6916cdc3107b tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.512s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:18:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e1181a65-9362-46f1-955b-09ec1394dc26 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.617s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:18:35 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e1181a65-9362-46f1-955b-09ec1394dc26 tempest-CreateVolumesFromSnapshotTest-1660672491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1417960519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d6f0ced-cd5d-41d3-9fec-c4c4af684305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9136d2ac08804847b692da4fe94ec7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:18:33Z,use_quota=True,user_id='1765f4280d4e4fb6bfd062fe7a785196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:18:35 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-e1181a65-9362-46f1-955b-09ec1394dc26 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Creating volume 3d6f0ced-cd5d-41d3-9fec-c4c4af684305 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:18:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e1181a65-9362-46f1-955b-09ec1394dc26 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:18:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e1181a65-9362-46f1-955b-09ec1394dc26 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:18:35 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e1181a65-9362-46f1-955b-09ec1394dc26 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:18:35 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e1181a65-9362-46f1-955b-09ec1394dc26 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:18:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e1181a65-9362-46f1-955b-09ec1394dc26 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:18:35 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e1181a65-9362-46f1-955b-09ec1394dc26 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:18:35 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-e1181a65-9362-46f1-955b-09ec1394dc26 tempest-CreateVolumesFromSnapshotTest-1660672491 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:18:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e1181a65-9362-46f1-955b-09ec1394dc26 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-3d6f0ced-cd5d-41d3-9fec-c4c4af684305 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:35 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4d86c814-330b-4e6e-8143-6916cdc3107b tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2edd071f-d10e-4c2f-9231-eca20495cfcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79d9414c-aea5-4b75-b713-0b8528d27023', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:35 devstack sudo[113357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-3d6f0ced-cd5d-41d3-9fec-c4c4af684305 1073741824 Jun 24 05:18:35 devstack sudo[113357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:35 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4d86c814-330b-4e6e-8143-6916cdc3107b tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5253ca83-b96a-41cf-89b5-7a808e606386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:35 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-4d86c814-330b-4e6e-8143-6916cdc3107b tempest-CreateVolumesFromSnapshotTest-1660672491 None] Volume volume-79d9414c-aea5-4b75-b713-0b8528d27023 (79d9414c-aea5-4b75-b713-0b8528d27023): created successfully Jun 24 05:18:35 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4d86c814-330b-4e6e-8143-6916cdc3107b tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5253ca83-b96a-41cf-89b5-7a808e606386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:35 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-4d86c814-330b-4e6e-8143-6916cdc3107b tempest-CreateVolumesFromSnapshotTest-1660672491 None] Flow 'volume_create_manager' (0770b681-5fe0-4248-bace-9168afef0380) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:18:35 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-4d86c814-330b-4e6e-8143-6916cdc3107b tempest-CreateVolumesFromSnapshotTest-1660672491 None] Created volume successfully. Jun 24 05:18:36 devstack sudo[113357]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e1181a65-9362-46f1-955b-09ec1394dc26 tempest-CreateVolumesFromSnapshotTest-1660672491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-3d6f0ced-cd5d-41d3-9fec-c4c4af684305 1073741824" returned: 0 in 0.830s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e1181a65-9362-46f1-955b-09ec1394dc26 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-3d6f0ced-cd5d-41d3-9fec-c4c4af684305 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:36 devstack sudo[113364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-3d6f0ced-cd5d-41d3-9fec-c4c4af684305 Jun 24 05:18:36 devstack sudo[113364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:36 devstack sudo[113364]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e1181a65-9362-46f1-955b-09ec1394dc26 tempest-CreateVolumesFromSnapshotTest-1660672491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-3d6f0ced-cd5d-41d3-9fec-c4c4af684305" returned: 0 in 0.650s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:36 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e1181a65-9362-46f1-955b-09ec1394dc26 tempest-CreateVolumesFromSnapshotTest-1660672491 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:18:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e1181a65-9362-46f1-955b-09ec1394dc26 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:18:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-31b5e008-d133-4642-bf5c-2ef5e97e3e4f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.778s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:18:36 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-31b5e008-d133-4642-bf5c-2ef5e97e3e4f tempest-CreateVolumesFromSnapshotTest-1660672491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-886405093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0f64bea-c10f-428f-9006-b82d717d1235,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9136d2ac08804847b692da4fe94ec7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:18:33Z,use_quota=True,user_id='1765f4280d4e4fb6bfd062fe7a785196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:18:36 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-31b5e008-d133-4642-bf5c-2ef5e97e3e4f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Creating volume d0f64bea-c10f-428f-9006-b82d717d1235 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:18:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-31b5e008-d133-4642-bf5c-2ef5e97e3e4f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:18:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-31b5e008-d133-4642-bf5c-2ef5e97e3e4f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:18:36 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-31b5e008-d133-4642-bf5c-2ef5e97e3e4f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:18:36 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-31b5e008-d133-4642-bf5c-2ef5e97e3e4f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:18:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-31b5e008-d133-4642-bf5c-2ef5e97e3e4f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:18:36 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-31b5e008-d133-4642-bf5c-2ef5e97e3e4f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:18:36 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-31b5e008-d133-4642-bf5c-2ef5e97e3e4f tempest-CreateVolumesFromSnapshotTest-1660672491 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:18:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-31b5e008-d133-4642-bf5c-2ef5e97e3e4f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d0f64bea-c10f-428f-9006-b82d717d1235 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:37 devstack sudo[113367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d0f64bea-c10f-428f-9006-b82d717d1235 1073741824 Jun 24 05:18:37 devstack sudo[113367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:37 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e1181a65-9362-46f1-955b-09ec1394dc26 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e90aa931-c4c7-432b-b260-7f6be163e82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d6f0ced-cd5d-41d3-9fec-c4c4af684305', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:37 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e1181a65-9362-46f1-955b-09ec1394dc26 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eb28fa2-e210-48c9-8dc6-9fee6ce7d6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:37 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-e1181a65-9362-46f1-955b-09ec1394dc26 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Volume volume-3d6f0ced-cd5d-41d3-9fec-c4c4af684305 (3d6f0ced-cd5d-41d3-9fec-c4c4af684305): created successfully Jun 24 05:18:37 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e1181a65-9362-46f1-955b-09ec1394dc26 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eb28fa2-e210-48c9-8dc6-9fee6ce7d6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:37 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e1181a65-9362-46f1-955b-09ec1394dc26 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Flow 'volume_create_manager' (6b55970d-e57c-49f4-a9af-1d07902586bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:18:37 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-e1181a65-9362-46f1-955b-09ec1394dc26 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Created volume successfully. Jun 24 05:18:37 devstack sudo[113367]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-31b5e008-d133-4642-bf5c-2ef5e97e3e4f tempest-CreateVolumesFromSnapshotTest-1660672491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d0f64bea-c10f-428f-9006-b82d717d1235 1073741824" returned: 0 in 0.952s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-31b5e008-d133-4642-bf5c-2ef5e97e3e4f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d0f64bea-c10f-428f-9006-b82d717d1235 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:37 devstack sudo[113410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d0f64bea-c10f-428f-9006-b82d717d1235 Jun 24 05:18:37 devstack sudo[113410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:38 devstack sudo[113410]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-31b5e008-d133-4642-bf5c-2ef5e97e3e4f tempest-CreateVolumesFromSnapshotTest-1660672491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d0f64bea-c10f-428f-9006-b82d717d1235" returned: 0 in 0.703s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:38 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-31b5e008-d133-4642-bf5c-2ef5e97e3e4f tempest-CreateVolumesFromSnapshotTest-1660672491 None] <== create_volume: return (1695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:18:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-31b5e008-d133-4642-bf5c-2ef5e97e3e4f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.699s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:18:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f6a27ff1-9431-4937-8280-2809d7d15dd5 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.051s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:18:38 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f6a27ff1-9431-4937-8280-2809d7d15dd5 tempest-CreateVolumesFromSnapshotTest-1660672491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-263621453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b9b98a4-0ed8-4684-a9d9-1dd7fdafac52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9136d2ac08804847b692da4fe94ec7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:18:33Z,use_quota=True,user_id='1765f4280d4e4fb6bfd062fe7a785196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:18:38 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-f6a27ff1-9431-4937-8280-2809d7d15dd5 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Creating volume 6b9b98a4-0ed8-4684-a9d9-1dd7fdafac52 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:18:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f6a27ff1-9431-4937-8280-2809d7d15dd5 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:18:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f6a27ff1-9431-4937-8280-2809d7d15dd5 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:18:38 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f6a27ff1-9431-4937-8280-2809d7d15dd5 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:18:38 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f6a27ff1-9431-4937-8280-2809d7d15dd5 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:18:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f6a27ff1-9431-4937-8280-2809d7d15dd5 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:18:38 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f6a27ff1-9431-4937-8280-2809d7d15dd5 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:18:38 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-f6a27ff1-9431-4937-8280-2809d7d15dd5 tempest-CreateVolumesFromSnapshotTest-1660672491 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:18:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f6a27ff1-9431-4937-8280-2809d7d15dd5 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6b9b98a4-0ed8-4684-a9d9-1dd7fdafac52 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:38 devstack sudo[113416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6b9b98a4-0ed8-4684-a9d9-1dd7fdafac52 1073741824 Jun 24 05:18:38 devstack sudo[113416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:38 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-31b5e008-d133-4642-bf5c-2ef5e97e3e4f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8009f26f-d2d9-41e3-afc5-3289f3b769b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0f64bea-c10f-428f-9006-b82d717d1235', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:38 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-31b5e008-d133-4642-bf5c-2ef5e97e3e4f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdd8726f-4afb-4d35-adf1-6fff0779fa2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:38 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-31b5e008-d133-4642-bf5c-2ef5e97e3e4f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Volume volume-d0f64bea-c10f-428f-9006-b82d717d1235 (d0f64bea-c10f-428f-9006-b82d717d1235): created successfully Jun 24 05:18:38 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-31b5e008-d133-4642-bf5c-2ef5e97e3e4f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdd8726f-4afb-4d35-adf1-6fff0779fa2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:38 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-31b5e008-d133-4642-bf5c-2ef5e97e3e4f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Flow 'volume_create_manager' (1cfd1dc8-cb86-44cf-b594-11aa8280fce9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:18:38 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-31b5e008-d133-4642-bf5c-2ef5e97e3e4f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Created volume successfully. Jun 24 05:18:39 devstack sudo[113416]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f6a27ff1-9431-4937-8280-2809d7d15dd5 tempest-CreateVolumesFromSnapshotTest-1660672491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6b9b98a4-0ed8-4684-a9d9-1dd7fdafac52 1073741824" returned: 0 in 0.861s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f6a27ff1-9431-4937-8280-2809d7d15dd5 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6b9b98a4-0ed8-4684-a9d9-1dd7fdafac52 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:39 devstack sudo[113422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6b9b98a4-0ed8-4684-a9d9-1dd7fdafac52 Jun 24 05:18:39 devstack sudo[113422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:40 devstack sudo[113422]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f6a27ff1-9431-4937-8280-2809d7d15dd5 tempest-CreateVolumesFromSnapshotTest-1660672491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6b9b98a4-0ed8-4684-a9d9-1dd7fdafac52" returned: 0 in 0.659s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:40 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f6a27ff1-9431-4937-8280-2809d7d15dd5 tempest-CreateVolumesFromSnapshotTest-1660672491 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:18:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f6a27ff1-9431-4937-8280-2809d7d15dd5 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:18:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f6a27ff1-9431-4937-8280-2809d7d15dd5 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2ff5d9c-3af8-4e4a-8e3b-869b433b6b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b9b98a4-0ed8-4684-a9d9-1dd7fdafac52', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f6a27ff1-9431-4937-8280-2809d7d15dd5 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (341e9f04-3c42-451a-bb94-4304628d5cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:18:40 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-f6a27ff1-9431-4937-8280-2809d7d15dd5 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Volume volume-6b9b98a4-0ed8-4684-a9d9-1dd7fdafac52 (6b9b98a4-0ed8-4684-a9d9-1dd7fdafac52): created successfully Jun 24 05:18:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f6a27ff1-9431-4937-8280-2809d7d15dd5 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (341e9f04-3c42-451a-bb94-4304628d5cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:18:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f6a27ff1-9431-4937-8280-2809d7d15dd5 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Flow 'volume_create_manager' (80b7dd85-857d-4867-92ab-a4e3a8ca2eba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:18:40 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-f6a27ff1-9431-4937-8280-2809d7d15dd5 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Created volume successfully. Jun 24 05:18:41 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-00db1913-277d-41ed-9e5c-e8537a7766ee tempest-CreateVolumesFromSnapshotTest-1660672491 None] Acquiring lock "cinder-6b9b98a4-0ed8-4684-a9d9-1dd7fdafac52-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:18:41 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-00db1913-277d-41ed-9e5c-e8537a7766ee tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "cinder-6b9b98a4-0ed8-4684-a9d9-1dd7fdafac52-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:18:41 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-00db1913-277d-41ed-9e5c-e8537a7766ee tempest-CreateVolumesFromSnapshotTest-1660672491 None] Acquiring lock "cinder-quobyte-6b9b98a4-0ed8-4684-a9d9-1dd7fdafac52" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:18:41 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-00db1913-277d-41ed-9e5c-e8537a7766ee tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "cinder-quobyte-6b9b98a4-0ed8-4684-a9d9-1dd7fdafac52" acquired by "delete_volume" :: waited 0.024s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:18:41 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03d5731-61e8-4a09-be06-dbec3326b3fe]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:18:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-00db1913-277d-41ed-9e5c-e8537a7766ee tempest-CreateVolumesFromSnapshotTest-1660672491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6b9b98a4-0ed8-4684-a9d9-1dd7fdafac52 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:41 devstack sudo[113493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6b9b98a4-0ed8-4684-a9d9-1dd7fdafac52 Jun 24 05:18:41 devstack sudo[113493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:42 devstack sudo[113493]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-00db1913-277d-41ed-9e5c-e8537a7766ee tempest-CreateVolumesFromSnapshotTest-1660672491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6b9b98a4-0ed8-4684-a9d9-1dd7fdafac52" returned: 0 in 0.772s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-00db1913-277d-41ed-9e5c-e8537a7766ee tempest-CreateVolumesFromSnapshotTest-1660672491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6b9b98a4-0ed8-4684-a9d9-1dd7fdafac52 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:42 devstack sudo[113501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6b9b98a4-0ed8-4684-a9d9-1dd7fdafac52 Jun 24 05:18:42 devstack sudo[113501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:42 devstack sudo[113501]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-00db1913-277d-41ed-9e5c-e8537a7766ee tempest-CreateVolumesFromSnapshotTest-1660672491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6b9b98a4-0ed8-4684-a9d9-1dd7fdafac52" returned: 0 in 0.646s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:42 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-00db1913-277d-41ed-9e5c-e8537a7766ee tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "cinder-quobyte-6b9b98a4-0ed8-4684-a9d9-1dd7fdafac52" released by "delete_volume" :: held 1.458s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:18:42 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:UPDATE=109,cinder:DELETE=14,cinder:SELECT=84,cinder:INSERT=27 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:18:42 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:SELECT=85,cinder:UPDATE=108,cinder:INSERT=21,cinder:DELETE=7 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:18:42 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-00db1913-277d-41ed-9e5c-e8537a7766ee tempest-CreateVolumesFromSnapshotTest-1660672491 None] Created reservations ['237c402d-857c-4809-82ac-b771e989420e', '755cad22-91da-4646-93aa-410ec108f9bc', '8c8063f8-aa14-4497-b31c-a2d63738027d', '6184b1ab-9c90-4f10-b319-df804273d374'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:18:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-00db1913-277d-41ed-9e5c-e8537a7766ee tempest-CreateVolumesFromSnapshotTest-1660672491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:18:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-00db1913-277d-41ed-9e5c-e8537a7766ee tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:18:42 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-00db1913-277d-41ed-9e5c-e8537a7766ee tempest-CreateVolumesFromSnapshotTest-1660672491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:18:42 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-00db1913-277d-41ed-9e5c-e8537a7766ee tempest-CreateVolumesFromSnapshotTest-1660672491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:18:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-00db1913-277d-41ed-9e5c-e8537a7766ee tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:18:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-00db1913-277d-41ed-9e5c-e8537a7766ee tempest-CreateVolumesFromSnapshotTest-1660672491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:42 devstack sudo[113504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:18:42 devstack sudo[113504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:43 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-5b679033-be32-4f81-a7e2-885719fd9e9f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Acquiring lock "cinder-d0f64bea-c10f-428f-9006-b82d717d1235-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:18:43 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-5b679033-be32-4f81-a7e2-885719fd9e9f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "cinder-d0f64bea-c10f-428f-9006-b82d717d1235-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:18:43 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-5b679033-be32-4f81-a7e2-885719fd9e9f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Acquiring lock "cinder-quobyte-d0f64bea-c10f-428f-9006-b82d717d1235" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:18:43 devstack sudo[113504]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-00db1913-277d-41ed-9e5c-e8537a7766ee tempest-CreateVolumesFromSnapshotTest-1660672491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.714s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:43 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-00db1913-277d-41ed-9e5c-e8537a7766ee tempest-CreateVolumesFromSnapshotTest-1660672491 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:18:43 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-5b679033-be32-4f81-a7e2-885719fd9e9f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "cinder-quobyte-d0f64bea-c10f-428f-9006-b82d717d1235" acquired by "delete_volume" :: waited 0.026s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:18:43 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-00db1913-277d-41ed-9e5c-e8537a7766ee tempest-CreateVolumesFromSnapshotTest-1660672491 None] Deleted volume successfully. Jun 24 05:18:43 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6609fb-28d2-4b8d-9397-895aa95fafbb]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:18:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5b679033-be32-4f81-a7e2-885719fd9e9f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d0f64bea-c10f-428f-9006-b82d717d1235 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:43 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-00db1913-277d-41ed-9e5c-e8537a7766ee tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "cinder-6b9b98a4-0ed8-4684-a9d9-1dd7fdafac52-delete_volume" released by "delete_volume" :: held 2.411s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:18:43 devstack sudo[113834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d0f64bea-c10f-428f-9006-b82d717d1235 Jun 24 05:18:43 devstack sudo[113834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:44 devstack sudo[113834]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5b679033-be32-4f81-a7e2-885719fd9e9f tempest-CreateVolumesFromSnapshotTest-1660672491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d0f64bea-c10f-428f-9006-b82d717d1235" returned: 0 in 1.116s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5b679033-be32-4f81-a7e2-885719fd9e9f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d0f64bea-c10f-428f-9006-b82d717d1235 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:44 devstack sudo[113903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d0f64bea-c10f-428f-9006-b82d717d1235 Jun 24 05:18:44 devstack sudo[113903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:45 devstack sudo[113903]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5b679033-be32-4f81-a7e2-885719fd9e9f tempest-CreateVolumesFromSnapshotTest-1660672491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d0f64bea-c10f-428f-9006-b82d717d1235" returned: 0 in 0.695s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:45 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-5b679033-be32-4f81-a7e2-885719fd9e9f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "cinder-quobyte-d0f64bea-c10f-428f-9006-b82d717d1235" released by "delete_volume" :: held 1.872s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:18:45 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-5b679033-be32-4f81-a7e2-885719fd9e9f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Created reservations ['0b5a925d-a37e-41f5-b0bf-42d80a789458', '69fe8631-49f8-4759-b8be-0523c64c7b6f', 'b7715fc8-b87e-445f-964f-31599b6b2aec', 'e4c122e5-2927-43ed-abe5-a38271e5ca24'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:18:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5b679033-be32-4f81-a7e2-885719fd9e9f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:18:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5b679033-be32-4f81-a7e2-885719fd9e9f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:18:45 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-5b679033-be32-4f81-a7e2-885719fd9e9f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:18:45 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-5b679033-be32-4f81-a7e2-885719fd9e9f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:18:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5b679033-be32-4f81-a7e2-885719fd9e9f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:18:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5b679033-be32-4f81-a7e2-885719fd9e9f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:45 devstack sudo[113908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:18:45 devstack sudo[113908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:45 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-fe84db65-f511-4ca1-87c8-362530314618 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Acquiring lock "cinder-3d6f0ced-cd5d-41d3-9fec-c4c4af684305-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:18:45 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-fe84db65-f511-4ca1-87c8-362530314618 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "cinder-3d6f0ced-cd5d-41d3-9fec-c4c4af684305-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:18:45 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-fe84db65-f511-4ca1-87c8-362530314618 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Acquiring lock "cinder-quobyte-3d6f0ced-cd5d-41d3-9fec-c4c4af684305" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:18:45 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-fe84db65-f511-4ca1-87c8-362530314618 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "cinder-quobyte-3d6f0ced-cd5d-41d3-9fec-c4c4af684305" acquired by "delete_volume" :: waited 0.017s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:18:45 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[17df4725-f4a7-4497-a600-c88bbff7dc74]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:18:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fe84db65-f511-4ca1-87c8-362530314618 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-3d6f0ced-cd5d-41d3-9fec-c4c4af684305 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:46 devstack sudo[113910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-3d6f0ced-cd5d-41d3-9fec-c4c4af684305 Jun 24 05:18:46 devstack sudo[113910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:46 devstack sudo[113908]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5b679033-be32-4f81-a7e2-885719fd9e9f tempest-CreateVolumesFromSnapshotTest-1660672491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.876s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:46 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-5b679033-be32-4f81-a7e2-885719fd9e9f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:18:46 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-5b679033-be32-4f81-a7e2-885719fd9e9f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Deleted volume successfully. Jun 24 05:18:46 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-5b679033-be32-4f81-a7e2-885719fd9e9f tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "cinder-d0f64bea-c10f-428f-9006-b82d717d1235-delete_volume" released by "delete_volume" :: held 2.995s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:18:46 devstack sudo[113910]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fe84db65-f511-4ca1-87c8-362530314618 tempest-CreateVolumesFromSnapshotTest-1660672491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-3d6f0ced-cd5d-41d3-9fec-c4c4af684305" returned: 0 in 0.919s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fe84db65-f511-4ca1-87c8-362530314618 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-3d6f0ced-cd5d-41d3-9fec-c4c4af684305 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:46 devstack sudo[113916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-3d6f0ced-cd5d-41d3-9fec-c4c4af684305 Jun 24 05:18:46 devstack sudo[113916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:47 devstack sudo[113916]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fe84db65-f511-4ca1-87c8-362530314618 tempest-CreateVolumesFromSnapshotTest-1660672491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-3d6f0ced-cd5d-41d3-9fec-c4c4af684305" returned: 0 in 0.710s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:47 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-fe84db65-f511-4ca1-87c8-362530314618 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "cinder-quobyte-3d6f0ced-cd5d-41d3-9fec-c4c4af684305" released by "delete_volume" :: held 1.675s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:18:47 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-fe84db65-f511-4ca1-87c8-362530314618 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Created reservations ['01997c02-f358-49e0-a53f-e86849a1f34d', 'f4ba2e24-1c34-46be-8352-d456a23cd875', 'fd44119e-6905-44c1-84a0-ace542af306c', 'eb49dce6-ec53-4ec1-8321-cbb7db53280e'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:18:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fe84db65-f511-4ca1-87c8-362530314618 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:18:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fe84db65-f511-4ca1-87c8-362530314618 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:18:47 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-fe84db65-f511-4ca1-87c8-362530314618 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:18:47 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-fe84db65-f511-4ca1-87c8-362530314618 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:18:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fe84db65-f511-4ca1-87c8-362530314618 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:18:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fe84db65-f511-4ca1-87c8-362530314618 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:47 devstack sudo[113919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:18:47 devstack sudo[113919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:48 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-5d98e90e-d3a4-4896-af84-bd070e40fc1c tempest-CreateVolumesFromSnapshotTest-1660672491 None] Acquiring lock "cinder-79d9414c-aea5-4b75-b713-0b8528d27023-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:18:48 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-5d98e90e-d3a4-4896-af84-bd070e40fc1c tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "cinder-79d9414c-aea5-4b75-b713-0b8528d27023-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:18:48 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-5d98e90e-d3a4-4896-af84-bd070e40fc1c tempest-CreateVolumesFromSnapshotTest-1660672491 None] Acquiring lock "cinder-quobyte-79d9414c-aea5-4b75-b713-0b8528d27023" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:18:48 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-5d98e90e-d3a4-4896-af84-bd070e40fc1c tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "cinder-quobyte-79d9414c-aea5-4b75-b713-0b8528d27023" acquired by "delete_volume" :: waited 0.020s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:18:48 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1c9263-4750-485c-913d-2037b9e04a37]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:18:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5d98e90e-d3a4-4896-af84-bd070e40fc1c tempest-CreateVolumesFromSnapshotTest-1660672491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-79d9414c-aea5-4b75-b713-0b8528d27023 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:48 devstack sudo[113921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-79d9414c-aea5-4b75-b713-0b8528d27023 Jun 24 05:18:48 devstack sudo[113921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:48 devstack sudo[113919]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fe84db65-f511-4ca1-87c8-362530314618 tempest-CreateVolumesFromSnapshotTest-1660672491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.764s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:48 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-fe84db65-f511-4ca1-87c8-362530314618 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:18:48 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-fe84db65-f511-4ca1-87c8-362530314618 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Deleted volume successfully. Jun 24 05:18:48 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-fe84db65-f511-4ca1-87c8-362530314618 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "cinder-3d6f0ced-cd5d-41d3-9fec-c4c4af684305-delete_volume" released by "delete_volume" :: held 2.703s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:18:49 devstack sudo[113921]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5d98e90e-d3a4-4896-af84-bd070e40fc1c tempest-CreateVolumesFromSnapshotTest-1660672491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-79d9414c-aea5-4b75-b713-0b8528d27023" returned: 0 in 0.803s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5d98e90e-d3a4-4896-af84-bd070e40fc1c tempest-CreateVolumesFromSnapshotTest-1660672491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-79d9414c-aea5-4b75-b713-0b8528d27023 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:49 devstack sudo[113928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-79d9414c-aea5-4b75-b713-0b8528d27023 Jun 24 05:18:49 devstack sudo[113928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:49 devstack sudo[113928]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5d98e90e-d3a4-4896-af84-bd070e40fc1c tempest-CreateVolumesFromSnapshotTest-1660672491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-79d9414c-aea5-4b75-b713-0b8528d27023" returned: 0 in 0.698s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:49 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-5d98e90e-d3a4-4896-af84-bd070e40fc1c tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "cinder-quobyte-79d9414c-aea5-4b75-b713-0b8528d27023" released by "delete_volume" :: held 1.562s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:18:49 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-5d98e90e-d3a4-4896-af84-bd070e40fc1c tempest-CreateVolumesFromSnapshotTest-1660672491 None] Created reservations ['e89b8ddd-9f7a-444a-9689-39a17c4368db', '064ee181-362c-4c4a-ab7d-7cb85a008744', '8db9019c-0164-4d46-bf81-60b9436bfea5', '48386911-6b8c-4dd5-b761-dc068396d9f9'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:18:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5d98e90e-d3a4-4896-af84-bd070e40fc1c tempest-CreateVolumesFromSnapshotTest-1660672491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:18:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5d98e90e-d3a4-4896-af84-bd070e40fc1c tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:18:49 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-5d98e90e-d3a4-4896-af84-bd070e40fc1c tempest-CreateVolumesFromSnapshotTest-1660672491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:18:49 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-5d98e90e-d3a4-4896-af84-bd070e40fc1c tempest-CreateVolumesFromSnapshotTest-1660672491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:18:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5d98e90e-d3a4-4896-af84-bd070e40fc1c tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:18:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5d98e90e-d3a4-4896-af84-bd070e40fc1c tempest-CreateVolumesFromSnapshotTest-1660672491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:49 devstack sudo[113931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:18:49 devstack sudo[113931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:50 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3b274a7b-2dfa-4f12-a3d2-9c73bceb9467 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Acquiring lock "cinder-f0977641-a965-4449-ba30-ac099777be6f-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:18:50 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3b274a7b-2dfa-4f12-a3d2-9c73bceb9467 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "cinder-f0977641-a965-4449-ba30-ac099777be6f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:18:50 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3b274a7b-2dfa-4f12-a3d2-9c73bceb9467 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Acquiring lock "cinder-quobyte-f0977641-a965-4449-ba30-ac099777be6f" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:18:50 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3b274a7b-2dfa-4f12-a3d2-9c73bceb9467 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "cinder-quobyte-f0977641-a965-4449-ba30-ac099777be6f" acquired by "delete_volume" :: waited 0.016s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:18:50 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec075952-53b6-4e64-9e7a-778009da33a6]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:18:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3b274a7b-2dfa-4f12-a3d2-9c73bceb9467 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f0977641-a965-4449-ba30-ac099777be6f {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:50 devstack sudo[113931]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5d98e90e-d3a4-4896-af84-bd070e40fc1c tempest-CreateVolumesFromSnapshotTest-1660672491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.671s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:50 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-5d98e90e-d3a4-4896-af84-bd070e40fc1c tempest-CreateVolumesFromSnapshotTest-1660672491 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:18:50 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-5d98e90e-d3a4-4896-af84-bd070e40fc1c tempest-CreateVolumesFromSnapshotTest-1660672491 None] Deleted volume successfully. Jun 24 05:18:50 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-5d98e90e-d3a4-4896-af84-bd070e40fc1c tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "cinder-79d9414c-aea5-4b75-b713-0b8528d27023-delete_volume" released by "delete_volume" :: held 2.472s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:18:50 devstack sudo[113934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f0977641-a965-4449-ba30-ac099777be6f Jun 24 05:18:50 devstack sudo[113934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:51 devstack sudo[113934]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3b274a7b-2dfa-4f12-a3d2-9c73bceb9467 tempest-CreateVolumesFromSnapshotTest-1660672491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f0977641-a965-4449-ba30-ac099777be6f" returned: 0 in 0.752s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3b274a7b-2dfa-4f12-a3d2-9c73bceb9467 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f0977641-a965-4449-ba30-ac099777be6f {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:51 devstack sudo[113940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f0977641-a965-4449-ba30-ac099777be6f Jun 24 05:18:51 devstack sudo[113940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:51 devstack sudo[113940]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3b274a7b-2dfa-4f12-a3d2-9c73bceb9467 tempest-CreateVolumesFromSnapshotTest-1660672491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f0977641-a965-4449-ba30-ac099777be6f" returned: 0 in 0.637s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:51 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3b274a7b-2dfa-4f12-a3d2-9c73bceb9467 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "cinder-quobyte-f0977641-a965-4449-ba30-ac099777be6f" released by "delete_volume" :: held 1.437s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:18:51 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-3b274a7b-2dfa-4f12-a3d2-9c73bceb9467 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Created reservations ['c8b27d96-0856-4310-aaf3-5837ce239b3b', '62d8b769-f495-45e1-b68c-d07cbe767ad6', '5576396a-8977-4398-b453-4ab197f5650b', 'effed338-0e74-4f0a-b0e3-37ebfa5a926a'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:18:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3b274a7b-2dfa-4f12-a3d2-9c73bceb9467 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:18:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3b274a7b-2dfa-4f12-a3d2-9c73bceb9467 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:18:51 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-3b274a7b-2dfa-4f12-a3d2-9c73bceb9467 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:18:51 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-3b274a7b-2dfa-4f12-a3d2-9c73bceb9467 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:18:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3b274a7b-2dfa-4f12-a3d2-9c73bceb9467 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:18:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3b274a7b-2dfa-4f12-a3d2-9c73bceb9467 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:52 devstack sudo[113943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:18:52 devstack sudo[113943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:52 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a0bd7c12-9173-44f5-a4fe-309b166ee1e4 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Acquiring lock "cinder-f8b24591-9cb0-4736-92ec-04ffae183294-delete_snapshot" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:18:52 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a0bd7c12-9173-44f5-a4fe-309b166ee1e4 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "cinder-f8b24591-9cb0-4736-92ec-04ffae183294-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:18:52 devstack sudo[113943]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:52 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a0bd7c12-9173-44f5-a4fe-309b166ee1e4 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Acquiring lock "cinder-quobyte-756406d8-fb1d-4312-971f-577baf729589" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:18:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3b274a7b-2dfa-4f12-a3d2-9c73bceb9467 tempest-CreateVolumesFromSnapshotTest-1660672491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.653s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:52 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-3b274a7b-2dfa-4f12-a3d2-9c73bceb9467 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:18:52 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-3b274a7b-2dfa-4f12-a3d2-9c73bceb9467 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Deleted volume successfully. Jun 24 05:18:52 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a0bd7c12-9173-44f5-a4fe-309b166ee1e4 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "cinder-quobyte-756406d8-fb1d-4312-971f-577baf729589" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:18:52 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a0bd7c12-9173-44f5-a4fe-309b166ee1e4 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Acquiring lock "cinder-quobyte-f8b24591-9cb0-4736-92ec-04ffae183294" by "_delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:18:52 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3b274a7b-2dfa-4f12-a3d2-9c73bceb9467 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "cinder-f0977641-a965-4449-ba30-ac099777be6f-delete_volume" released by "delete_volume" :: held 2.309s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:18:52 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a0bd7c12-9173-44f5-a4fe-309b166ee1e4 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "cinder-quobyte-f8b24591-9cb0-4736-92ec-04ffae183294" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:18:52 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-a0bd7c12-9173-44f5-a4fe-309b166ee1e4 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Deleting offline snapshot f8b24591-9cb0-4736-92ec-04ffae183294 of volume 756406d8-fb1d-4312-971f-577baf729589 {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 05:18:52 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-a0bd7c12-9173-44f5-a4fe-309b166ee1e4 tempest-CreateVolumesFromSnapshotTest-1660672491 None] snapshot_file for this snap is: volume-756406d8-fb1d-4312-971f-577baf729589.f8b24591-9cb0-4736-92ec-04ffae183294 {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 05:18:52 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57bac67-16b4-46fa-ae36-0bc7f1e5d0f3]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:18:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a0bd7c12-9173-44f5-a4fe-309b166ee1e4 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589.f8b24591-9cb0-4736-92ec-04ffae183294 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:52 devstack sudo[113946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589.f8b24591-9cb0-4736-92ec-04ffae183294 Jun 24 05:18:52 devstack sudo[113946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:53 devstack sudo[113946]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a0bd7c12-9173-44f5-a4fe-309b166ee1e4 tempest-CreateVolumesFromSnapshotTest-1660672491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589.f8b24591-9cb0-4736-92ec-04ffae183294" returned: 0 in 0.739s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:53 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-a0bd7c12-9173-44f5-a4fe-309b166ee1e4 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-756406d8-fb1d-4312-971f-577baf729589(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:18:53 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[5321c3e2-7727-458f-b2d9-ac030725f21e]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:18:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a0bd7c12-9173-44f5-a4fe-309b166ee1e4 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:53 devstack sudo[113951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589 Jun 24 05:18:53 devstack sudo[113951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:54 devstack sudo[113951]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a0bd7c12-9173-44f5-a4fe-309b166ee1e4 tempest-CreateVolumesFromSnapshotTest-1660672491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589" returned: 0 in 0.761s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a0bd7c12-9173-44f5-a4fe-309b166ee1e4 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589.f8b24591-9cb0-4736-92ec-04ffae183294 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:54 devstack sudo[113956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589.f8b24591-9cb0-4736-92ec-04ffae183294 Jun 24 05:18:54 devstack sudo[113956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:54 devstack sudo[113956]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a0bd7c12-9173-44f5-a4fe-309b166ee1e4 tempest-CreateVolumesFromSnapshotTest-1660672491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589.f8b24591-9cb0-4736-92ec-04ffae183294" returned: 0 in 0.723s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a0bd7c12-9173-44f5-a4fe-309b166ee1e4 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589.f8b24591-9cb0-4736-92ec-04ffae183294 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:54 devstack sudo[113961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589.f8b24591-9cb0-4736-92ec-04ffae183294 Jun 24 05:18:54 devstack sudo[113961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:55 devstack sudo[113961]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a0bd7c12-9173-44f5-a4fe-309b166ee1e4 tempest-CreateVolumesFromSnapshotTest-1660672491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589.f8b24591-9cb0-4736-92ec-04ffae183294" returned: 0 in 0.639s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:55 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a0bd7c12-9173-44f5-a4fe-309b166ee1e4 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "cinder-quobyte-f8b24591-9cb0-4736-92ec-04ffae183294" released by "_delete_snapshot" :: held 2.961s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:18:55 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a0bd7c12-9173-44f5-a4fe-309b166ee1e4 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "cinder-quobyte-756406d8-fb1d-4312-971f-577baf729589" released by "delete_snapshot" :: held 2.993s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:18:55 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-a0bd7c12-9173-44f5-a4fe-309b166ee1e4 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Created reservations ['1bc16764-8acf-45a2-817b-20ac9b13fdb7', 'd2f79307-69f3-4fe0-8023-e1bda8ee01e6', 'cd7d1c1a-c5d8-42e1-b011-8defc3240e72', 'd1f4b791-5074-456f-9c5f-bd78d7ff2f83'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:18:55 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-a0bd7c12-9173-44f5-a4fe-309b166ee1e4 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Delete snapshot completed successfully. Jun 24 05:18:55 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a0bd7c12-9173-44f5-a4fe-309b166ee1e4 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "cinder-f8b24591-9cb0-4736-92ec-04ffae183294-delete_snapshot" released by "delete_snapshot" :: held 3.161s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:18:55 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3a45db1c-fd83-47d4-a3f8-8316031e1fc3 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Acquiring lock "cinder-756406d8-fb1d-4312-971f-577baf729589-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:18:55 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3a45db1c-fd83-47d4-a3f8-8316031e1fc3 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "cinder-756406d8-fb1d-4312-971f-577baf729589-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:18:55 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3a45db1c-fd83-47d4-a3f8-8316031e1fc3 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Acquiring lock "cinder-quobyte-756406d8-fb1d-4312-971f-577baf729589" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:18:55 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3a45db1c-fd83-47d4-a3f8-8316031e1fc3 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "cinder-quobyte-756406d8-fb1d-4312-971f-577baf729589" acquired by "delete_volume" :: waited 0.022s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:18:55 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05c24c9-9a95-4357-8c26-4a9e1fb1f5f4]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:18:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3a45db1c-fd83-47d4-a3f8-8316031e1fc3 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:56 devstack sudo[113964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589 Jun 24 05:18:56 devstack sudo[113964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:56 devstack sudo[113964]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3a45db1c-fd83-47d4-a3f8-8316031e1fc3 tempest-CreateVolumesFromSnapshotTest-1660672491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589" returned: 0 in 0.769s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3a45db1c-fd83-47d4-a3f8-8316031e1fc3 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:56 devstack sudo[113969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589 Jun 24 05:18:56 devstack sudo[113969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:57 devstack sudo[113969]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3a45db1c-fd83-47d4-a3f8-8316031e1fc3 tempest-CreateVolumesFromSnapshotTest-1660672491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-756406d8-fb1d-4312-971f-577baf729589" returned: 0 in 0.668s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:57 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3a45db1c-fd83-47d4-a3f8-8316031e1fc3 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "cinder-quobyte-756406d8-fb1d-4312-971f-577baf729589" released by "delete_volume" :: held 1.492s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:18:57 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-3a45db1c-fd83-47d4-a3f8-8316031e1fc3 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Created reservations ['4e1f44c8-cfbe-4a16-a74f-6e18e308540b', 'ca417053-68b6-4dc5-8192-e6b258ab65e7', 'f6cd22a6-df25-4b19-ba35-cbe44030e789', 'bfddf1ea-e9df-4b36-a64f-45f3d0828cfd'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:18:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3a45db1c-fd83-47d4-a3f8-8316031e1fc3 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:18:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3a45db1c-fd83-47d4-a3f8-8316031e1fc3 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:18:57 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-3a45db1c-fd83-47d4-a3f8-8316031e1fc3 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:18:57 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-3a45db1c-fd83-47d4-a3f8-8316031e1fc3 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:18:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3a45db1c-fd83-47d4-a3f8-8316031e1fc3 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:18:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3a45db1c-fd83-47d4-a3f8-8316031e1fc3 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:18:57 devstack sudo[113972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:18:57 devstack sudo[113972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:18:58 devstack sudo[113972]: pam_unix(sudo:session): session closed for user root Jun 24 05:18:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3a45db1c-fd83-47d4-a3f8-8316031e1fc3 tempest-CreateVolumesFromSnapshotTest-1660672491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.714s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:18:58 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-3a45db1c-fd83-47d4-a3f8-8316031e1fc3 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:18:58 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-3a45db1c-fd83-47d4-a3f8-8316031e1fc3 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Deleted volume successfully. Jun 24 05:18:58 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3a45db1c-fd83-47d4-a3f8-8316031e1fc3 tempest-CreateVolumesFromSnapshotTest-1660672491 None] Lock "cinder-756406d8-fb1d-4312-971f-577baf729589-delete_volume" released by "delete_volume" :: held 2.450s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:19:07 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:UPDATE=50,cinder:SELECT=38,cinder:INSERT=10,cinder:DELETE=2 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:19:08 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:SELECT=29,cinder:INSERT=18,cinder:UPDATE=56,cinder:DELETE=4 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:19:09 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 05:19:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:19:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:19:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:19:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:19:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:19:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:19:09 devstack sudo[114023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:19:09 devstack sudo[114023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:19:10 devstack sudo[114023]: pam_unix(sudo:session): session closed for user root Jun 24 05:19:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.659s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:19:10 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:19:10 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager._thread_info {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 05:19:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread count: 29 {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 05:19:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread info: [<_MainThread(MainThread, started 130211312517248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 05:19:13 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-4dacda95-108a-47fa-a5a9-4e3ba053878c req-d1fff2b1-c539-4e10-8331-a84f57d7a677 tempest-TestShelveInstance-413355169 None] Terminate volume connection completed successfully. Jun 24 05:19:13 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [req-4dacda95-108a-47fa-a5a9-4e3ba053878c req-d1fff2b1-c539-4e10-8331-a84f57d7a677 tempest-TestShelveInstance-413355169 None] Deleting attachment 0c88220f-dab4-4815-b320-4cdea858ff18. {{(pid=93830) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 05:19:14 devstack cinder-volume[93830]: DEBUG cinder.coordination [req-4dacda95-108a-47fa-a5a9-4e3ba053878c req-0096b525-418d-45dd-9f7e-407fa1385c31 tempest-TestShelveInstance-413355169 None] Acquiring lock "cinder-6536f660-fe0e-4e47-be61-f45478126152-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:19:14 devstack cinder-volume[93830]: DEBUG cinder.coordination [req-4dacda95-108a-47fa-a5a9-4e3ba053878c req-0096b525-418d-45dd-9f7e-407fa1385c31 tempest-TestShelveInstance-413355169 None] Lock "cinder-6536f660-fe0e-4e47-be61-f45478126152-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:19:14 devstack cinder-volume[93830]: DEBUG cinder.coordination [req-4dacda95-108a-47fa-a5a9-4e3ba053878c req-0096b525-418d-45dd-9f7e-407fa1385c31 tempest-TestShelveInstance-413355169 None] Acquiring lock "cinder-quobyte-6536f660-fe0e-4e47-be61-f45478126152" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:19:14 devstack cinder-volume[93830]: DEBUG cinder.coordination [req-4dacda95-108a-47fa-a5a9-4e3ba053878c req-0096b525-418d-45dd-9f7e-407fa1385c31 tempest-TestShelveInstance-413355169 None] Lock "cinder-quobyte-6536f660-fe0e-4e47-be61-f45478126152" acquired by "delete_volume" :: waited 0.018s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:19:14 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2058c2-b061-4b83-ae12-5d814e2a4e58]: (4, 'raw') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:19:14 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-4dacda95-108a-47fa-a5a9-4e3ba053878c req-0096b525-418d-45dd-9f7e-407fa1385c31 tempest-TestShelveInstance-413355169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6536f660-fe0e-4e47-be61-f45478126152 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:19:14 devstack sudo[114074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6536f660-fe0e-4e47-be61-f45478126152 Jun 24 05:19:14 devstack sudo[114074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:19:15 devstack sudo[114074]: pam_unix(sudo:session): session closed for user root Jun 24 05:19:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-4dacda95-108a-47fa-a5a9-4e3ba053878c req-0096b525-418d-45dd-9f7e-407fa1385c31 tempest-TestShelveInstance-413355169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6536f660-fe0e-4e47-be61-f45478126152" returned: 0 in 0.758s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:19:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-4dacda95-108a-47fa-a5a9-4e3ba053878c req-0096b525-418d-45dd-9f7e-407fa1385c31 tempest-TestShelveInstance-413355169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6536f660-fe0e-4e47-be61-f45478126152 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:19:15 devstack sudo[114078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6536f660-fe0e-4e47-be61-f45478126152 Jun 24 05:19:15 devstack sudo[114078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:19:15 devstack sudo[114078]: pam_unix(sudo:session): session closed for user root Jun 24 05:19:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-4dacda95-108a-47fa-a5a9-4e3ba053878c req-0096b525-418d-45dd-9f7e-407fa1385c31 tempest-TestShelveInstance-413355169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6536f660-fe0e-4e47-be61-f45478126152" returned: 1 in 0.731s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:19:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-4dacda95-108a-47fa-a5a9-4e3ba053878c req-0096b525-418d-45dd-9f7e-407fa1385c31 tempest-TestShelveInstance-413355169 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6536f660-fe0e-4e47-be61-f45478126152' failed. Not Retrying. {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 05:19:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-4dacda95-108a-47fa-a5a9-4e3ba053878c req-0096b525-418d-45dd-9f7e-407fa1385c31 tempest-TestShelveInstance-413355169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6536f660-fe0e-4e47-be61-f45478126152 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:19:15 devstack sudo[114083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6536f660-fe0e-4e47-be61-f45478126152 Jun 24 05:19:15 devstack sudo[114083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:19:16 devstack sudo[114083]: pam_unix(sudo:session): session closed for user root Jun 24 05:19:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-4dacda95-108a-47fa-a5a9-4e3ba053878c req-0096b525-418d-45dd-9f7e-407fa1385c31 tempest-TestShelveInstance-413355169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6536f660-fe0e-4e47-be61-f45478126152" returned: 0 in 0.659s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:19:16 devstack cinder-volume[93830]: DEBUG cinder.coordination [req-4dacda95-108a-47fa-a5a9-4e3ba053878c req-0096b525-418d-45dd-9f7e-407fa1385c31 tempest-TestShelveInstance-413355169 None] Lock "cinder-quobyte-6536f660-fe0e-4e47-be61-f45478126152" released by "delete_volume" :: held 2.208s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:19:16 devstack cinder-volume[93830]: DEBUG cinder.quota [req-4dacda95-108a-47fa-a5a9-4e3ba053878c req-0096b525-418d-45dd-9f7e-407fa1385c31 tempest-TestShelveInstance-413355169 None] Created reservations ['222275c5-5b40-4855-a4a6-bb92d7b702f0', '1d0e8b41-eebb-4ac1-81d9-b2a5281c90af', '568c0d1a-08e1-48a5-ac48-0ba1687a81b3', '13a4b155-2401-4b96-8810-6746e7a3601f'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:19:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-4dacda95-108a-47fa-a5a9-4e3ba053878c req-0096b525-418d-45dd-9f7e-407fa1385c31 tempest-TestShelveInstance-413355169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:19:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-4dacda95-108a-47fa-a5a9-4e3ba053878c req-0096b525-418d-45dd-9f7e-407fa1385c31 tempest-TestShelveInstance-413355169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:19:16 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [req-4dacda95-108a-47fa-a5a9-4e3ba053878c req-0096b525-418d-45dd-9f7e-407fa1385c31 tempest-TestShelveInstance-413355169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:19:16 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [req-4dacda95-108a-47fa-a5a9-4e3ba053878c req-0096b525-418d-45dd-9f7e-407fa1385c31 tempest-TestShelveInstance-413355169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:19:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [req-4dacda95-108a-47fa-a5a9-4e3ba053878c req-0096b525-418d-45dd-9f7e-407fa1385c31 tempest-TestShelveInstance-413355169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:19:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-4dacda95-108a-47fa-a5a9-4e3ba053878c req-0096b525-418d-45dd-9f7e-407fa1385c31 tempest-TestShelveInstance-413355169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:19:16 devstack sudo[114086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:19:16 devstack sudo[114086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:19:17 devstack sudo[114086]: pam_unix(sudo:session): session closed for user root Jun 24 05:19:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [req-4dacda95-108a-47fa-a5a9-4e3ba053878c req-0096b525-418d-45dd-9f7e-407fa1385c31 tempest-TestShelveInstance-413355169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.635s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:19:17 devstack cinder-volume[93830]: DEBUG cinder.manager [req-4dacda95-108a-47fa-a5a9-4e3ba053878c req-0096b525-418d-45dd-9f7e-407fa1385c31 tempest-TestShelveInstance-413355169 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:19:17 devstack cinder-volume[93830]: INFO cinder.volume.manager [req-4dacda95-108a-47fa-a5a9-4e3ba053878c req-0096b525-418d-45dd-9f7e-407fa1385c31 tempest-TestShelveInstance-413355169 None] Deleted volume successfully. Jun 24 05:19:17 devstack cinder-volume[93830]: DEBUG cinder.coordination [req-4dacda95-108a-47fa-a5a9-4e3ba053878c req-0096b525-418d-45dd-9f7e-407fa1385c31 tempest-TestShelveInstance-413355169 None] Lock "cinder-6536f660-fe0e-4e47-be61-f45478126152-delete_volume" released by "delete_volume" :: held 3.050s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:19:26 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=7 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:19:27 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:SELECT=6,cinder:UPDATE=9,cinder:INSERT=3,cinder:DELETE=1 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:19:30 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:19:30 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Flow 'volume_create_manager' (f9d7da09-63bc-48b0-adc7-a1a252b93b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:19:30 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04021916-0c95-4912-b994-a0a4d6abb8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:19:30 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04021916-0c95-4912-b994-a0a4d6abb8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6302d9b1-20d2-428f-b17a-cc6185cf686b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20ba3a1e6710494b960f351ace72cfe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:19:30Z,use_quota=True,user_id='6be6bf4cc87d467eb1095164e2df3264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(09e3c765-d261-4ba0-b6fb-f03d408535ed),volume_type_id=09e3c765-d261-4ba0-b6fb-f03d408535ed)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:19:30 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fef93c0d-42a6-4d50-869b-93f62fe343ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:19:30 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fef93c0d-42a6-4d50-869b-93f62fe343ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:19:30 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b43d3a9d-f263-49ab-94b9-7852fca9c8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:19:30 devstack cinder-volume[93830]: DEBUG cinder.image.glance [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Creating Keystone auth plugin from conf {{(pid=93830) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 24 05:19:30 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b43d3a9d-f263-49ab-94b9-7852fca9c8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6302d9b1-20d2-428f-b17a-cc6185cf686b', 'volume_name': 'volume-6302d9b1-20d2-428f-b17a-cc6185cf686b', 'volume_size': 1, 'image_id': 'cb066097-99f2-425e-b8b3-3d9cab2f2bae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb066097-99f2-425e-b8b3-3d9cab2f2bae', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f4b069190627767923d345021c80d551', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '20ba3a1e6710494b960f351ace72cfe9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2b36fb57b89d64abef6fba743bfdd8c38e150e9a16abff92c49ec9917f897b330d5fa28e28153dc611e20b25e79b3e153e8f6669e457ce70b1c30c694a29fb2d', 'id': 'cb066097-99f2-425e-b8b3-3d9cab2f2bae', 'created_at': datetime.datetime(2026, 6, 24, 3, 19, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 3, 19, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb066097-99f2-425e-b8b3-3d9cab2f2bae/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:19:30 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (869109f6-74a1-46ac-8330-a45e171a43cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:19:30 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (869109f6-74a1-46ac-8330-a45e171a43cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:19:30 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0203575-a195-4d03-ac22-2b7651c955af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:19:30 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Volume 6302d9b1-20d2-428f-b17a-cc6185cf686b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6302d9b1-20d2-428f-b17a-cc6185cf686b', 'volume_size': 1, 'image_id': 'cb066097-99f2-425e-b8b3-3d9cab2f2bae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb066097-99f2-425e-b8b3-3d9cab2f2bae', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f4b069190627767923d345021c80d551', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '20ba3a1e6710494b960f351ace72cfe9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2b36fb57b89d64abef6fba743bfdd8c38e150e9a16abff92c49ec9917f897b330d5fa28e28153dc611e20b25e79b3e153e8f6669e457ce70b1c30c694a29fb2d', 'id': 'cb066097-99f2-425e-b8b3-3d9cab2f2bae', 'created_at': datetime.datetime(2026, 6, 24, 3, 19, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 3, 19, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb066097-99f2-425e-b8b3-3d9cab2f2bae/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 24 05:19:30 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Trying to clone 6302d9b1-20d2-428f-b17a-cc6185cf686b from image cb066097-99f2-425e-b8b3-3d9cab2f2bae at location (None, [{'url': 'file:///opt/stack/data/glance/images/cb066097-99f2-425e-b8b3-3d9cab2f2bae', 'metadata': {}}]). {{(pid=93830) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 24 05:19:30 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cb066097-99f2-425e-b8b3-3d9cab2f2bae_oxtsmu5_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93830) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 24 05:19:30 devstack cinder-volume[93830]: INFO cinder.image.image_utils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Image download 0.00 MB at 0.00 MB/s Jun 24 05:19:30 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7576ce8-adde-4448-9536-547cd5658c0d]: (4, 'raw') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:19:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb066097-99f2-425e-b8b3-3d9cab2f2bae_oxtsmu5_devstack@QuobyteHD {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:19:30 devstack sudo[114098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb066097-99f2-425e-b8b3-3d9cab2f2bae_oxtsmu5_devstack@QuobyteHD Jun 24 05:19:30 devstack sudo[114098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:19:31 devstack sudo[114098]: pam_unix(sudo:session): session closed for user root Jun 24 05:19:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb066097-99f2-425e-b8b3-3d9cab2f2bae_oxtsmu5_devstack@QuobyteHD" returned: 0 in 0.718s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:19:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb066097-99f2-425e-b8b3-3d9cab2f2bae_oxtsmu5_devstack@QuobyteHD {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:19:31 devstack sudo[114102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb066097-99f2-425e-b8b3-3d9cab2f2bae_oxtsmu5_devstack@QuobyteHD Jun 24 05:19:31 devstack sudo[114102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:19:32 devstack sudo[114102]: pam_unix(sudo:session): session closed for user root Jun 24 05:19:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb066097-99f2-425e-b8b3-3d9cab2f2bae_oxtsmu5_devstack@QuobyteHD" returned: 1 in 0.693s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:19:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb066097-99f2-425e-b8b3-3d9cab2f2bae_oxtsmu5_devstack@QuobyteHD' failed. Not Retrying. {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 05:19:32 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Temporary image cb066097-99f2-425e-b8b3-3d9cab2f2bae is fetched for user 6be6bf4cc87d467eb1095164e2df3264. {{(pid=93830) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 24 05:19:32 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b501e1-2599-4ccb-b1e8-9989ee7bb873]: (4, 'raw') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:19:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb066097-99f2-425e-b8b3-3d9cab2f2bae_oxtsmu5_devstack@QuobyteHD {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:19:32 devstack sudo[114107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb066097-99f2-425e-b8b3-3d9cab2f2bae_oxtsmu5_devstack@QuobyteHD Jun 24 05:19:32 devstack sudo[114107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:19:32 devstack sudo[114107]: pam_unix(sudo:session): session closed for user root Jun 24 05:19:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb066097-99f2-425e-b8b3-3d9cab2f2bae_oxtsmu5_devstack@QuobyteHD" returned: 0 in 0.741s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:19:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb066097-99f2-425e-b8b3-3d9cab2f2bae_oxtsmu5_devstack@QuobyteHD {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:19:33 devstack sudo[114111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb066097-99f2-425e-b8b3-3d9cab2f2bae_oxtsmu5_devstack@QuobyteHD Jun 24 05:19:33 devstack sudo[114111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:19:33 devstack sudo[114111]: pam_unix(sudo:session): session closed for user root Jun 24 05:19:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb066097-99f2-425e-b8b3-3d9cab2f2bae_oxtsmu5_devstack@QuobyteHD" returned: 1 in 0.709s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:19:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb066097-99f2-425e-b8b3-3d9cab2f2bae_oxtsmu5_devstack@QuobyteHD' failed. Not Retrying. {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 05:19:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:19:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:19:33 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6302d9b1-20d2-428f-b17a-cc6185cf686b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20ba3a1e6710494b960f351ace72cfe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:19:30Z,use_quota=True,user_id='6be6bf4cc87d467eb1095164e2df3264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(09e3c765-d261-4ba0-b6fb-f03d408535ed),volume_type_id=09e3c765-d261-4ba0-b6fb-f03d408535ed)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:19:33 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Creating volume 6302d9b1-20d2-428f-b17a-cc6185cf686b {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:19:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:19:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:19:33 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:19:33 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:19:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:19:33 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:19:33 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:19:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6302d9b1-20d2-428f-b17a-cc6185cf686b 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:19:33 devstack sudo[114116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6302d9b1-20d2-428f-b17a-cc6185cf686b 1073741824 Jun 24 05:19:33 devstack sudo[114116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:19:34 devstack sudo[114116]: pam_unix(sudo:session): session closed for user root Jun 24 05:19:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6302d9b1-20d2-428f-b17a-cc6185cf686b 1073741824" returned: 0 in 0.786s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:19:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6302d9b1-20d2-428f-b17a-cc6185cf686b {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:19:34 devstack sudo[114122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6302d9b1-20d2-428f-b17a-cc6185cf686b Jun 24 05:19:34 devstack sudo[114122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:19:35 devstack sudo[114122]: pam_unix(sudo:session): session closed for user root Jun 24 05:19:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6302d9b1-20d2-428f-b17a-cc6185cf686b" returned: 0 in 0.625s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:19:35 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:19:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:19:35 devstack cinder-volume[93830]: DEBUG cinder.volume.volume_utils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Attempting download of cb066097-99f2-425e-b8b3-3d9cab2f2bae ((None, [{'url': 'file:///opt/stack/data/glance/images/cb066097-99f2-425e-b8b3-3d9cab2f2bae', 'metadata': {}}])) to volume 6302d9b1-20d2-428f-b17a-cc6185cf686b. {{(pid=93830) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 24 05:19:35 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30f6ba8-9fa7-44df-8a9b-326ea3740805]: (4, 'raw') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:19:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb066097-99f2-425e-b8b3-3d9cab2f2bae_a2hll46z {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:19:35 devstack sudo[114125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb066097-99f2-425e-b8b3-3d9cab2f2bae_a2hll46z Jun 24 05:19:35 devstack sudo[114125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:19:35 devstack sudo[114125]: pam_unix(sudo:session): session closed for user root Jun 24 05:19:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb066097-99f2-425e-b8b3-3d9cab2f2bae_a2hll46z" returned: 0 in 0.754s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:19:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb066097-99f2-425e-b8b3-3d9cab2f2bae_a2hll46z {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:19:36 devstack sudo[114129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb066097-99f2-425e-b8b3-3d9cab2f2bae_a2hll46z Jun 24 05:19:36 devstack sudo[114129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:19:36 devstack sudo[114129]: pam_unix(sudo:session): session closed for user root Jun 24 05:19:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb066097-99f2-425e-b8b3-3d9cab2f2bae_a2hll46z" returned: 1 in 0.745s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:19:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb066097-99f2-425e-b8b3-3d9cab2f2bae_a2hll46z' failed. Not Retrying. {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 05:19:36 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ee9c01-d93c-4400-ae21-faa21602f443]: (4, 'raw') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:19:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb066097-99f2-425e-b8b3-3d9cab2f2bae_oxtsmu5_devstack@QuobyteHD {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:19:36 devstack sudo[114133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb066097-99f2-425e-b8b3-3d9cab2f2bae_oxtsmu5_devstack@QuobyteHD Jun 24 05:19:36 devstack sudo[114133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:19:37 devstack sudo[114133]: pam_unix(sudo:session): session closed for user root Jun 24 05:19:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb066097-99f2-425e-b8b3-3d9cab2f2bae_oxtsmu5_devstack@QuobyteHD" returned: 0 in 0.694s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:19:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb066097-99f2-425e-b8b3-3d9cab2f2bae_oxtsmu5_devstack@QuobyteHD {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:19:37 devstack sudo[114137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb066097-99f2-425e-b8b3-3d9cab2f2bae_oxtsmu5_devstack@QuobyteHD Jun 24 05:19:37 devstack sudo[114137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:19:38 devstack sudo[114137]: pam_unix(sudo:session): session closed for user root Jun 24 05:19:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb066097-99f2-425e-b8b3-3d9cab2f2bae_oxtsmu5_devstack@QuobyteHD" returned: 1 in 0.699s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:19:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb066097-99f2-425e-b8b3-3d9cab2f2bae_oxtsmu5_devstack@QuobyteHD' failed. Not Retrying. {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 05:19:38 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] cb066097-99f2-425e-b8b3-3d9cab2f2bae was raw, converting to raw {{(pid=93830) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 24 05:19:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cb066097-99f2-425e-b8b3-3d9cab2f2bae_oxtsmu5_devstack@QuobyteHD /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6302d9b1-20d2-428f-b17a-cc6185cf686b {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:19:38 devstack sudo[114177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cb066097-99f2-425e-b8b3-3d9cab2f2bae_oxtsmu5_devstack@QuobyteHD /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6302d9b1-20d2-428f-b17a-cc6185cf686b Jun 24 05:19:38 devstack sudo[114177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:19:38 devstack sudo[114177]: pam_unix(sudo:session): session closed for user root Jun 24 05:19:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cb066097-99f2-425e-b8b3-3d9cab2f2bae_oxtsmu5_devstack@QuobyteHD /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6302d9b1-20d2-428f-b17a-cc6185cf686b" returned: 0 in 0.722s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:19:38 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cb066097-99f2-425e-b8b3-3d9cab2f2bae_oxtsmu5_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6302d9b1-20d2-428f-b17a-cc6185cf686b {{(pid=93830) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 05:19:38 devstack cinder-volume[93830]: INFO cinder.image.image_utils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Converted 0.00 MB image at 0.00 MB/s Jun 24 05:19:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6302d9b1-20d2-428f-b17a-cc6185cf686b 1G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:19:38 devstack sudo[114185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6302d9b1-20d2-428f-b17a-cc6185cf686b 1G Jun 24 05:19:38 devstack sudo[114185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:19:39 devstack sudo[114185]: pam_unix(sudo:session): session closed for user root Jun 24 05:19:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6302d9b1-20d2-428f-b17a-cc6185cf686b 1G" returned: 0 in 0.651s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:19:39 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b1a053-378e-41df-9b26-7e56a6d11f9e]: (4, 'raw') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:19:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6302d9b1-20d2-428f-b17a-cc6185cf686b {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:19:39 devstack sudo[114190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6302d9b1-20d2-428f-b17a-cc6185cf686b Jun 24 05:19:39 devstack sudo[114190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:19:40 devstack sudo[114190]: pam_unix(sudo:session): session closed for user root Jun 24 05:19:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6302d9b1-20d2-428f-b17a-cc6185cf686b" returned: 0 in 0.729s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:19:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6302d9b1-20d2-428f-b17a-cc6185cf686b {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:19:40 devstack sudo[114194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6302d9b1-20d2-428f-b17a-cc6185cf686b Jun 24 05:19:40 devstack sudo[114194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:19:40 devstack sudo[114194]: pam_unix(sudo:session): session closed for user root Jun 24 05:19:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6302d9b1-20d2-428f-b17a-cc6185cf686b" returned: 1 in 0.726s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:19:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6302d9b1-20d2-428f-b17a-cc6185cf686b' failed. Not Retrying. {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 05:19:40 devstack cinder-volume[93830]: DEBUG cinder.volume.volume_utils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Downloaded image cb066097-99f2-425e-b8b3-3d9cab2f2bae ((None, [{'url': 'file:///opt/stack/data/glance/images/cb066097-99f2-425e-b8b3-3d9cab2f2bae', 'metadata': {}}])) to volume 6302d9b1-20d2-428f-b17a-cc6185cf686b successfully. {{(pid=93830) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 24 05:19:40 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Temporary image cb066097-99f2-425e-b8b3-3d9cab2f2bae for user 6be6bf4cc87d467eb1095164e2df3264 is deleted. {{(pid=93830) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 24 05:19:40 devstack cinder-volume[93830]: DEBUG cinder.volume.volume_utils [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Marking volume 6302d9b1-20d2-428f-b17a-cc6185cf686b as bootable. {{(pid=93830) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 24 05:19:40 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Copying metadata from image cb066097-99f2-425e-b8b3-3d9cab2f2bae to 6302d9b1-20d2-428f-b17a-cc6185cf686b. {{(pid=93830) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 24 05:19:40 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Creating volume glance metadata for volume 6302d9b1-20d2-428f-b17a-cc6185cf686b backed by image cb066097-99f2-425e-b8b3-3d9cab2f2bae with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'cb066097-99f2-425e-b8b3-3d9cab2f2bae', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'f4b069190627767923d345021c80d551', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93830) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 24 05:19:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0203575-a195-4d03-ac22-2b7651c955af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6302d9b1-20d2-428f-b17a-cc6185cf686b', 'volume_size': 1, 'image_id': 'cb066097-99f2-425e-b8b3-3d9cab2f2bae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb066097-99f2-425e-b8b3-3d9cab2f2bae', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f4b069190627767923d345021c80d551', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '20ba3a1e6710494b960f351ace72cfe9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2b36fb57b89d64abef6fba743bfdd8c38e150e9a16abff92c49ec9917f897b330d5fa28e28153dc611e20b25e79b3e153e8f6669e457ce70b1c30c694a29fb2d', 'id': 'cb066097-99f2-425e-b8b3-3d9cab2f2bae', 'created_at': datetime.datetime(2026, 6, 24, 3, 19, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 3, 19, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb066097-99f2-425e-b8b3-3d9cab2f2bae/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:19:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cfa9f0d-414b-4bac-8580-a241481ed41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:19:41 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Volume volume-6302d9b1-20d2-428f-b17a-cc6185cf686b (6302d9b1-20d2-428f-b17a-cc6185cf686b): created successfully Jun 24 05:19:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cfa9f0d-414b-4bac-8580-a241481ed41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:19:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Flow 'volume_create_manager' (f9d7da09-63bc-48b0-adc7-a1a252b93b5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:19:41 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-a43d7cb9-d7d3-4739-94c7-1b2744a66c67 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Created volume successfully. Jun 24 05:19:41 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-fd3ce4ec-1f84-47ed-9c53-777e6aa33a46 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Acquiring lock "cinder-6302d9b1-20d2-428f-b17a-cc6185cf686b-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:19:41 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-fd3ce4ec-1f84-47ed-9c53-777e6aa33a46 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Lock "cinder-6302d9b1-20d2-428f-b17a-cc6185cf686b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:19:41 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-fd3ce4ec-1f84-47ed-9c53-777e6aa33a46 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Acquiring lock "cinder-quobyte-6302d9b1-20d2-428f-b17a-cc6185cf686b" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:19:41 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-fd3ce4ec-1f84-47ed-9c53-777e6aa33a46 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Lock "cinder-quobyte-6302d9b1-20d2-428f-b17a-cc6185cf686b" acquired by "delete_volume" :: waited 0.016s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:19:42 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[abebc20f-fd7b-488e-9c23-2781e33099a5]: (4, 'raw') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:19:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fd3ce4ec-1f84-47ed-9c53-777e6aa33a46 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6302d9b1-20d2-428f-b17a-cc6185cf686b {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:19:42 devstack sudo[114200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6302d9b1-20d2-428f-b17a-cc6185cf686b Jun 24 05:19:42 devstack sudo[114200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:19:42 devstack sudo[114200]: pam_unix(sudo:session): session closed for user root Jun 24 05:19:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fd3ce4ec-1f84-47ed-9c53-777e6aa33a46 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6302d9b1-20d2-428f-b17a-cc6185cf686b" returned: 0 in 0.714s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:19:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fd3ce4ec-1f84-47ed-9c53-777e6aa33a46 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6302d9b1-20d2-428f-b17a-cc6185cf686b {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:19:42 devstack sudo[114204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6302d9b1-20d2-428f-b17a-cc6185cf686b Jun 24 05:19:42 devstack sudo[114204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:19:43 devstack sudo[114204]: pam_unix(sudo:session): session closed for user root Jun 24 05:19:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fd3ce4ec-1f84-47ed-9c53-777e6aa33a46 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6302d9b1-20d2-428f-b17a-cc6185cf686b" returned: 1 in 0.730s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:19:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fd3ce4ec-1f84-47ed-9c53-777e6aa33a46 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6302d9b1-20d2-428f-b17a-cc6185cf686b' failed. Not Retrying. {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 05:19:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fd3ce4ec-1f84-47ed-9c53-777e6aa33a46 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6302d9b1-20d2-428f-b17a-cc6185cf686b {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:19:43 devstack sudo[114209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6302d9b1-20d2-428f-b17a-cc6185cf686b Jun 24 05:19:43 devstack sudo[114209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:19:44 devstack sudo[114209]: pam_unix(sudo:session): session closed for user root Jun 24 05:19:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fd3ce4ec-1f84-47ed-9c53-777e6aa33a46 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-6302d9b1-20d2-428f-b17a-cc6185cf686b" returned: 0 in 0.623s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:19:44 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-fd3ce4ec-1f84-47ed-9c53-777e6aa33a46 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Lock "cinder-quobyte-6302d9b1-20d2-428f-b17a-cc6185cf686b" released by "delete_volume" :: held 2.127s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:19:44 devstack cinder-volume[93830]: WARNING cinder.quota [None req-fd3ce4ec-1f84-47ed-9c53-777e6aa33a46 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 24 05:19:44 devstack cinder-volume[93830]: WARNING cinder.quota [None req-fd3ce4ec-1f84-47ed-9c53-777e6aa33a46 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 24 05:19:44 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-fd3ce4ec-1f84-47ed-9c53-777e6aa33a46 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Created reservations ['c06bc1b4-dc87-483f-ab16-ea073c3101d6', '702edcf6-fbf7-4576-9b4c-47a050afb415', '0bda19f7-cb5b-4abc-8da1-980e157c54be', 'b3218c18-7236-4409-a41a-b6836f43c3dc'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:19:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fd3ce4ec-1f84-47ed-9c53-777e6aa33a46 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:19:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fd3ce4ec-1f84-47ed-9c53-777e6aa33a46 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:19:44 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-fd3ce4ec-1f84-47ed-9c53-777e6aa33a46 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:19:44 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-fd3ce4ec-1f84-47ed-9c53-777e6aa33a46 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:19:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fd3ce4ec-1f84-47ed-9c53-777e6aa33a46 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:19:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fd3ce4ec-1f84-47ed-9c53-777e6aa33a46 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:19:44 devstack sudo[114212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:19:44 devstack sudo[114212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:19:44 devstack sudo[114212]: pam_unix(sudo:session): session closed for user root Jun 24 05:19:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fd3ce4ec-1f84-47ed-9c53-777e6aa33a46 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.622s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:19:44 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-fd3ce4ec-1f84-47ed-9c53-777e6aa33a46 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:19:44 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-fd3ce4ec-1f84-47ed-9c53-777e6aa33a46 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Deleted volume successfully. Jun 24 05:19:44 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-fd3ce4ec-1f84-47ed-9c53-777e6aa33a46 tempest-VolumeAndVolumeTypeFromImageTest-2128904076 None] Lock "cinder-6302d9b1-20d2-428f-b17a-cc6185cf686b-delete_volume" released by "delete_volume" :: held 2.930s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:19:51 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:19:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Flow 'volume_create_manager' (5b6a3be2-0193-43d3-9a92-d46b46bb8b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:19:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdbeb66b-881f-4fa1-a850-1c853fba1492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:19:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdbeb66b-881f-4fa1-a850-1c853fba1492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83c99faa-e6c9-4e19-bb69-632bd9dfe40e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ecfdc4425ca4fc990b825b92789385b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:19:51Z,use_quota=True,user_id='23e367a543ed4d5a9646c2c9d1d7f5d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:19:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384c4e3b-177d-4df1-9f00-0a4e7fb04670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:19:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384c4e3b-177d-4df1-9f00-0a4e7fb04670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:19:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a805be20-1c8e-4b13-a791-67e8b90feb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:19:51 devstack cinder-volume[93830]: DEBUG cinder.image.glance [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Creating Keystone auth plugin from conf {{(pid=93830) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 24 05:19:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a805be20-1c8e-4b13-a791-67e8b90feb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '83c99faa-e6c9-4e19-bb69-632bd9dfe40e', 'volume_name': 'volume-83c99faa-e6c9-4e19-bb69-632bd9dfe40e', 'volume_size': 1, 'image_id': '8aa47c06-01c6-4cfb-8093-bfdcf435f889', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8aa47c06-01c6-4cfb-8093-bfdcf435f889', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '63feed37cadf95ca1b882e6269b297df', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3ecfdc4425ca4fc990b825b92789385b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c4b48151e51f3c8b20d00c53d013588b3f97e219531f9fbd389ee8847acacb9ecdd2fadd0d6e627e4de890a6e0ddaef15b615b65f97202775a87d50d07847a3a', 'id': '8aa47c06-01c6-4cfb-8093-bfdcf435f889', 'created_at': datetime.datetime(2026, 6, 24, 3, 19, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 3, 19, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8aa47c06-01c6-4cfb-8093-bfdcf435f889/file', 'properties': {}}, 'image_service': }' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:19:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (284638c6-d4af-4508-ae60-71eedec23efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:19:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (284638c6-d4af-4508-ae60-71eedec23efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:19:51 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8ab2bbb-dce8-4223-b3a6-7bdbe1ff1835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:19:51 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Volume 83c99faa-e6c9-4e19-bb69-632bd9dfe40e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-83c99faa-e6c9-4e19-bb69-632bd9dfe40e', 'volume_size': 1, 'image_id': '8aa47c06-01c6-4cfb-8093-bfdcf435f889', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8aa47c06-01c6-4cfb-8093-bfdcf435f889', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '63feed37cadf95ca1b882e6269b297df', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3ecfdc4425ca4fc990b825b92789385b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c4b48151e51f3c8b20d00c53d013588b3f97e219531f9fbd389ee8847acacb9ecdd2fadd0d6e627e4de890a6e0ddaef15b615b65f97202775a87d50d07847a3a', 'id': '8aa47c06-01c6-4cfb-8093-bfdcf435f889', 'created_at': datetime.datetime(2026, 6, 24, 3, 19, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 3, 19, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8aa47c06-01c6-4cfb-8093-bfdcf435f889/file', 'properties': {}}, 'image_service': } Jun 24 05:19:51 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Trying to clone 83c99faa-e6c9-4e19-bb69-632bd9dfe40e from image 8aa47c06-01c6-4cfb-8093-bfdcf435f889 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8aa47c06-01c6-4cfb-8093-bfdcf435f889', 'metadata': {}}]). {{(pid=93830) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 24 05:19:51 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8aa47c06-01c6-4cfb-8093-bfdcf435f889_8xcgtdiidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93830) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 24 05:19:51 devstack cinder-volume[93830]: INFO cinder.image.image_utils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Image download 0.00 MB at 0.00 MB/s Jun 24 05:19:51 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88f2647-af0c-4d96-9c9a-191e97480590]: (4, 'raw') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:19:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8aa47c06-01c6-4cfb-8093-bfdcf435f889_8xcgtdiidevstack@QuobyteHD {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:19:51 devstack sudo[114217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8aa47c06-01c6-4cfb-8093-bfdcf435f889_8xcgtdiidevstack@QuobyteHD Jun 24 05:19:51 devstack sudo[114217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:19:52 devstack sudo[114217]: pam_unix(sudo:session): session closed for user root Jun 24 05:19:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8aa47c06-01c6-4cfb-8093-bfdcf435f889_8xcgtdiidevstack@QuobyteHD" returned: 0 in 0.717s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:19:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8aa47c06-01c6-4cfb-8093-bfdcf435f889_8xcgtdiidevstack@QuobyteHD {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:19:52 devstack sudo[114221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8aa47c06-01c6-4cfb-8093-bfdcf435f889_8xcgtdiidevstack@QuobyteHD Jun 24 05:19:52 devstack sudo[114221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:19:53 devstack sudo[114221]: pam_unix(sudo:session): session closed for user root Jun 24 05:19:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8aa47c06-01c6-4cfb-8093-bfdcf435f889_8xcgtdiidevstack@QuobyteHD" returned: 1 in 0.692s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:19:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8aa47c06-01c6-4cfb-8093-bfdcf435f889_8xcgtdiidevstack@QuobyteHD' failed. Not Retrying. {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 05:19:53 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Temporary image 8aa47c06-01c6-4cfb-8093-bfdcf435f889 is fetched for user 23e367a543ed4d5a9646c2c9d1d7f5d9. {{(pid=93830) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 24 05:19:53 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bfb5a3-7744-46e1-a68d-5951d6476b96]: (4, 'raw') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:19:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8aa47c06-01c6-4cfb-8093-bfdcf435f889_8xcgtdiidevstack@QuobyteHD {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:19:53 devstack sudo[114226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8aa47c06-01c6-4cfb-8093-bfdcf435f889_8xcgtdiidevstack@QuobyteHD Jun 24 05:19:53 devstack sudo[114226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:19:53 devstack sudo[114226]: pam_unix(sudo:session): session closed for user root Jun 24 05:19:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8aa47c06-01c6-4cfb-8093-bfdcf435f889_8xcgtdiidevstack@QuobyteHD" returned: 0 in 0.686s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:19:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8aa47c06-01c6-4cfb-8093-bfdcf435f889_8xcgtdiidevstack@QuobyteHD {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:19:53 devstack sudo[114230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8aa47c06-01c6-4cfb-8093-bfdcf435f889_8xcgtdiidevstack@QuobyteHD Jun 24 05:19:53 devstack sudo[114230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:19:54 devstack sudo[114230]: pam_unix(sudo:session): session closed for user root Jun 24 05:19:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8aa47c06-01c6-4cfb-8093-bfdcf435f889_8xcgtdiidevstack@QuobyteHD" returned: 1 in 0.690s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:19:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8aa47c06-01c6-4cfb-8093-bfdcf435f889_8xcgtdiidevstack@QuobyteHD' failed. Not Retrying. {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 05:19:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:19:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:19:54 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83c99faa-e6c9-4e19-bb69-632bd9dfe40e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ecfdc4425ca4fc990b825b92789385b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:19:51Z,use_quota=True,user_id='23e367a543ed4d5a9646c2c9d1d7f5d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:19:54 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Creating volume 83c99faa-e6c9-4e19-bb69-632bd9dfe40e {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:19:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:19:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:19:54 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:19:54 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:19:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:19:54 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:19:54 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:19:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-83c99faa-e6c9-4e19-bb69-632bd9dfe40e 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:19:54 devstack sudo[114235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-83c99faa-e6c9-4e19-bb69-632bd9dfe40e 1073741824 Jun 24 05:19:54 devstack sudo[114235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:19:55 devstack sudo[114235]: pam_unix(sudo:session): session closed for user root Jun 24 05:19:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-83c99faa-e6c9-4e19-bb69-632bd9dfe40e 1073741824" returned: 0 in 0.804s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:19:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-83c99faa-e6c9-4e19-bb69-632bd9dfe40e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:19:55 devstack sudo[114240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-83c99faa-e6c9-4e19-bb69-632bd9dfe40e Jun 24 05:19:55 devstack sudo[114240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:19:55 devstack sudo[114240]: pam_unix(sudo:session): session closed for user root Jun 24 05:19:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-83c99faa-e6c9-4e19-bb69-632bd9dfe40e" returned: 0 in 0.613s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:19:55 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:19:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:19:55 devstack cinder-volume[93830]: DEBUG cinder.volume.volume_utils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Attempting download of 8aa47c06-01c6-4cfb-8093-bfdcf435f889 ((None, [{'url': 'file:///opt/stack/data/glance/images/8aa47c06-01c6-4cfb-8093-bfdcf435f889', 'metadata': {}}])) to volume 83c99faa-e6c9-4e19-bb69-632bd9dfe40e. {{(pid=93830) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 24 05:19:56 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[460efdf7-b865-4974-9267-22114d13bbf5]: (4, 'raw') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:19:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8aa47c06-01c6-4cfb-8093-bfdcf435f889_ct6qjpfe {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:19:56 devstack sudo[114243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8aa47c06-01c6-4cfb-8093-bfdcf435f889_ct6qjpfe Jun 24 05:19:56 devstack sudo[114243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:19:56 devstack sudo[114243]: pam_unix(sudo:session): session closed for user root Jun 24 05:19:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8aa47c06-01c6-4cfb-8093-bfdcf435f889_ct6qjpfe" returned: 0 in 0.730s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:19:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8aa47c06-01c6-4cfb-8093-bfdcf435f889_ct6qjpfe {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:19:56 devstack sudo[114247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8aa47c06-01c6-4cfb-8093-bfdcf435f889_ct6qjpfe Jun 24 05:19:56 devstack sudo[114247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:19:57 devstack sudo[114247]: pam_unix(sudo:session): session closed for user root Jun 24 05:19:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8aa47c06-01c6-4cfb-8093-bfdcf435f889_ct6qjpfe" returned: 1 in 0.699s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:19:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8aa47c06-01c6-4cfb-8093-bfdcf435f889_ct6qjpfe' failed. Not Retrying. {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 05:19:57 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f78c83-4055-4e76-afd0-3d84095230a6]: (4, 'raw') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:19:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8aa47c06-01c6-4cfb-8093-bfdcf435f889_8xcgtdiidevstack@QuobyteHD {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:19:57 devstack sudo[114251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8aa47c06-01c6-4cfb-8093-bfdcf435f889_8xcgtdiidevstack@QuobyteHD Jun 24 05:19:57 devstack sudo[114251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:19:58 devstack sudo[114251]: pam_unix(sudo:session): session closed for user root Jun 24 05:19:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8aa47c06-01c6-4cfb-8093-bfdcf435f889_8xcgtdiidevstack@QuobyteHD" returned: 0 in 0.737s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:19:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8aa47c06-01c6-4cfb-8093-bfdcf435f889_8xcgtdiidevstack@QuobyteHD {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:19:58 devstack sudo[114255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8aa47c06-01c6-4cfb-8093-bfdcf435f889_8xcgtdiidevstack@QuobyteHD Jun 24 05:19:58 devstack sudo[114255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:19:58 devstack sudo[114255]: pam_unix(sudo:session): session closed for user root Jun 24 05:19:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8aa47c06-01c6-4cfb-8093-bfdcf435f889_8xcgtdiidevstack@QuobyteHD" returned: 1 in 0.691s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:19:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8aa47c06-01c6-4cfb-8093-bfdcf435f889_8xcgtdiidevstack@QuobyteHD' failed. Not Retrying. {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 05:19:58 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] 8aa47c06-01c6-4cfb-8093-bfdcf435f889 was raw, converting to raw {{(pid=93830) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 24 05:19:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8aa47c06-01c6-4cfb-8093-bfdcf435f889_8xcgtdiidevstack@QuobyteHD /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-83c99faa-e6c9-4e19-bb69-632bd9dfe40e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:19:58 devstack sudo[114260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8aa47c06-01c6-4cfb-8093-bfdcf435f889_8xcgtdiidevstack@QuobyteHD /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-83c99faa-e6c9-4e19-bb69-632bd9dfe40e Jun 24 05:19:58 devstack sudo[114260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:19:59 devstack sudo[114260]: pam_unix(sudo:session): session closed for user root Jun 24 05:19:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8aa47c06-01c6-4cfb-8093-bfdcf435f889_8xcgtdiidevstack@QuobyteHD /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-83c99faa-e6c9-4e19-bb69-632bd9dfe40e" returned: 0 in 0.734s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:19:59 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8aa47c06-01c6-4cfb-8093-bfdcf435f889_8xcgtdiidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-83c99faa-e6c9-4e19-bb69-632bd9dfe40e {{(pid=93830) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 05:19:59 devstack cinder-volume[93830]: INFO cinder.image.image_utils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Converted 0.00 MB image at 0.00 MB/s Jun 24 05:19:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-83c99faa-e6c9-4e19-bb69-632bd9dfe40e 1G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:19:59 devstack sudo[114265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-83c99faa-e6c9-4e19-bb69-632bd9dfe40e 1G Jun 24 05:19:59 devstack sudo[114265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:00 devstack sudo[114265]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-83c99faa-e6c9-4e19-bb69-632bd9dfe40e 1G" returned: 0 in 0.669s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:00 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c311f1-8bb6-4d40-8fca-bffd7f84bc03]: (4, 'raw') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:20:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-83c99faa-e6c9-4e19-bb69-632bd9dfe40e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:00 devstack sudo[114270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-83c99faa-e6c9-4e19-bb69-632bd9dfe40e Jun 24 05:20:00 devstack sudo[114270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:01 devstack sudo[114270]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-83c99faa-e6c9-4e19-bb69-632bd9dfe40e" returned: 0 in 0.756s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-83c99faa-e6c9-4e19-bb69-632bd9dfe40e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:01 devstack sudo[114275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-83c99faa-e6c9-4e19-bb69-632bd9dfe40e Jun 24 05:20:01 devstack sudo[114275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:01 devstack sudo[114275]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-83c99faa-e6c9-4e19-bb69-632bd9dfe40e" returned: 1 in 0.753s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-83c99faa-e6c9-4e19-bb69-632bd9dfe40e' failed. Not Retrying. {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 05:20:01 devstack cinder-volume[93830]: DEBUG cinder.volume.volume_utils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Downloaded image 8aa47c06-01c6-4cfb-8093-bfdcf435f889 ((None, [{'url': 'file:///opt/stack/data/glance/images/8aa47c06-01c6-4cfb-8093-bfdcf435f889', 'metadata': {}}])) to volume 83c99faa-e6c9-4e19-bb69-632bd9dfe40e successfully. {{(pid=93830) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 24 05:20:01 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Temporary image 8aa47c06-01c6-4cfb-8093-bfdcf435f889 for user 23e367a543ed4d5a9646c2c9d1d7f5d9 is deleted. {{(pid=93830) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 24 05:20:01 devstack cinder-volume[93830]: DEBUG cinder.volume.volume_utils [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Marking volume 83c99faa-e6c9-4e19-bb69-632bd9dfe40e as bootable. {{(pid=93830) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 24 05:20:01 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Copying metadata from image 8aa47c06-01c6-4cfb-8093-bfdcf435f889 to 83c99faa-e6c9-4e19-bb69-632bd9dfe40e. {{(pid=93830) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 24 05:20:01 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Creating volume glance metadata for volume 83c99faa-e6c9-4e19-bb69-632bd9dfe40e backed by image 8aa47c06-01c6-4cfb-8093-bfdcf435f889 with: {'image_id': '8aa47c06-01c6-4cfb-8093-bfdcf435f889', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '63feed37cadf95ca1b882e6269b297df', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93830) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 24 05:20:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8ab2bbb-dce8-4223-b3a6-7bdbe1ff1835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83c99faa-e6c9-4e19-bb69-632bd9dfe40e', 'volume_size': 1, 'image_id': '8aa47c06-01c6-4cfb-8093-bfdcf435f889', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8aa47c06-01c6-4cfb-8093-bfdcf435f889', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '63feed37cadf95ca1b882e6269b297df', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3ecfdc4425ca4fc990b825b92789385b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c4b48151e51f3c8b20d00c53d013588b3f97e219531f9fbd389ee8847acacb9ecdd2fadd0d6e627e4de890a6e0ddaef15b615b65f97202775a87d50d07847a3a', 'id': '8aa47c06-01c6-4cfb-8093-bfdcf435f889', 'created_at': datetime.datetime(2026, 6, 24, 3, 19, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 3, 19, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8aa47c06-01c6-4cfb-8093-bfdcf435f889/file', 'properties': {}}, 'image_service': }' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f09efdb6-86c7-4ea5-82f7-7891bf0597f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:01 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Volume volume-83c99faa-e6c9-4e19-bb69-632bd9dfe40e (83c99faa-e6c9-4e19-bb69-632bd9dfe40e): created successfully Jun 24 05:20:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f09efdb6-86c7-4ea5-82f7-7891bf0597f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Flow 'volume_create_manager' (5b6a3be2-0193-43d3-9a92-d46b46bb8b05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:20:01 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-8528eedc-7964-45b5-ad43-88b9a6c2fa06 tempest-VolumeImageDependencyTests-281952232 None] Created volume successfully. Jun 24 05:20:02 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e9c90186-258e-4fb4-a50d-144b8e6c393f tempest-VolumeImageDependencyTests-281952232 None] Acquiring lock "cinder-83c99faa-e6c9-4e19-bb69-632bd9dfe40e-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:20:02 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e9c90186-258e-4fb4-a50d-144b8e6c393f tempest-VolumeImageDependencyTests-281952232 None] Lock "cinder-83c99faa-e6c9-4e19-bb69-632bd9dfe40e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:20:02 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e9c90186-258e-4fb4-a50d-144b8e6c393f tempest-VolumeImageDependencyTests-281952232 None] Acquiring lock "cinder-quobyte-83c99faa-e6c9-4e19-bb69-632bd9dfe40e" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:20:02 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e9c90186-258e-4fb4-a50d-144b8e6c393f tempest-VolumeImageDependencyTests-281952232 None] Lock "cinder-quobyte-83c99faa-e6c9-4e19-bb69-632bd9dfe40e" acquired by "delete_volume" :: waited 0.014s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:20:03 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[1349f921-4679-43dc-bd31-87e2fdf8f64b]: (4, 'raw') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:20:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e9c90186-258e-4fb4-a50d-144b8e6c393f tempest-VolumeImageDependencyTests-281952232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-83c99faa-e6c9-4e19-bb69-632bd9dfe40e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:03 devstack sudo[114280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-83c99faa-e6c9-4e19-bb69-632bd9dfe40e Jun 24 05:20:03 devstack sudo[114280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:03 devstack sudo[114280]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e9c90186-258e-4fb4-a50d-144b8e6c393f tempest-VolumeImageDependencyTests-281952232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-83c99faa-e6c9-4e19-bb69-632bd9dfe40e" returned: 0 in 0.743s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e9c90186-258e-4fb4-a50d-144b8e6c393f tempest-VolumeImageDependencyTests-281952232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-83c99faa-e6c9-4e19-bb69-632bd9dfe40e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:03 devstack sudo[114285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-83c99faa-e6c9-4e19-bb69-632bd9dfe40e Jun 24 05:20:03 devstack sudo[114285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:04 devstack sudo[114285]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e9c90186-258e-4fb4-a50d-144b8e6c393f tempest-VolumeImageDependencyTests-281952232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-83c99faa-e6c9-4e19-bb69-632bd9dfe40e" returned: 1 in 0.723s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e9c90186-258e-4fb4-a50d-144b8e6c393f tempest-VolumeImageDependencyTests-281952232 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-83c99faa-e6c9-4e19-bb69-632bd9dfe40e' failed. Not Retrying. {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 05:20:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e9c90186-258e-4fb4-a50d-144b8e6c393f tempest-VolumeImageDependencyTests-281952232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-83c99faa-e6c9-4e19-bb69-632bd9dfe40e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:04 devstack sudo[114292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-83c99faa-e6c9-4e19-bb69-632bd9dfe40e Jun 24 05:20:04 devstack sudo[114292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:05 devstack sudo[114292]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e9c90186-258e-4fb4-a50d-144b8e6c393f tempest-VolumeImageDependencyTests-281952232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-83c99faa-e6c9-4e19-bb69-632bd9dfe40e" returned: 0 in 0.652s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:05 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e9c90186-258e-4fb4-a50d-144b8e6c393f tempest-VolumeImageDependencyTests-281952232 None] Lock "cinder-quobyte-83c99faa-e6c9-4e19-bb69-632bd9dfe40e" released by "delete_volume" :: held 2.175s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:20:05 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-e9c90186-258e-4fb4-a50d-144b8e6c393f tempest-VolumeImageDependencyTests-281952232 None] Created reservations ['4de57413-2144-4767-9340-e3e95b68db3e', 'd8ad7fd7-8166-488f-81a1-5398cc82ef36', '9a635d67-d652-48cf-95a7-cb5c2c410f78', 'efff305b-4479-4af3-987f-407ea062c08c'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:20:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e9c90186-258e-4fb4-a50d-144b8e6c393f tempest-VolumeImageDependencyTests-281952232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e9c90186-258e-4fb4-a50d-144b8e6c393f tempest-VolumeImageDependencyTests-281952232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:05 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e9c90186-258e-4fb4-a50d-144b8e6c393f tempest-VolumeImageDependencyTests-281952232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:20:05 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e9c90186-258e-4fb4-a50d-144b8e6c393f tempest-VolumeImageDependencyTests-281952232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:20:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e9c90186-258e-4fb4-a50d-144b8e6c393f tempest-VolumeImageDependencyTests-281952232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:20:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e9c90186-258e-4fb4-a50d-144b8e6c393f tempest-VolumeImageDependencyTests-281952232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:05 devstack sudo[114301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:20:05 devstack sudo[114301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:05 devstack sudo[114301]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e9c90186-258e-4fb4-a50d-144b8e6c393f tempest-VolumeImageDependencyTests-281952232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.605s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:05 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-e9c90186-258e-4fb4-a50d-144b8e6c393f tempest-VolumeImageDependencyTests-281952232 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:20:05 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-e9c90186-258e-4fb4-a50d-144b8e6c393f tempest-VolumeImageDependencyTests-281952232 None] Deleted volume successfully. Jun 24 05:20:05 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e9c90186-258e-4fb4-a50d-144b8e6c393f tempest-VolumeImageDependencyTests-281952232 None] Lock "cinder-83c99faa-e6c9-4e19-bb69-632bd9dfe40e-delete_volume" released by "delete_volume" :: held 2.957s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:20:09 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 05:20:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:20:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:20:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:20:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:09 devstack sudo[114325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:20:09 devstack sudo[114325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:10 devstack sudo[114325]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.664s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:10 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:20:10 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager._thread_info {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 05:20:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread count: 29 {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 05:20:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread info: [<_MainThread(MainThread, started 130211312517248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 05:20:15 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:SELECT=25,cinder:INSERT=12,cinder:UPDATE=26,cinder:DELETE=2 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:20:15 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:SELECT=26,cinder:UPDATE=24,cinder:INSERT=17,cinder:DELETE=2 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:20:18 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-17c1b371-8225-4cf0-aa41-58e455795950 tempest-CreateVolumesFromImageTest-388768697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:20:18 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-17c1b371-8225-4cf0-aa41-58e455795950 tempest-CreateVolumesFromImageTest-388768697 None] Flow 'volume_create_manager' (e29167cf-344a-4783-9dee-e3d80a1bdf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:20:18 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-17c1b371-8225-4cf0-aa41-58e455795950 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb2a101d-158a-48b4-ab8b-500125a48fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:18 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-17c1b371-8225-4cf0-aa41-58e455795950 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb2a101d-158a-48b4-ab8b-500125a48fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:20:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2004079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33df1e7f-628b-4d04-8572-e1c8164c6d07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2e1354dbae4cfaa9c248c8532a01d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:20:19Z,use_quota=True,user_id='1bfd9456b5e6410e9fd932ad277ed7c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:18 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-17c1b371-8225-4cf0-aa41-58e455795950 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f18d456-9f34-4a78-bb61-84ab999a23c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:18 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-17c1b371-8225-4cf0-aa41-58e455795950 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f18d456-9f34-4a78-bb61-84ab999a23c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:18 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-17c1b371-8225-4cf0-aa41-58e455795950 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0252f375-f89b-4d34-8598-7431febb602e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:18 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-17c1b371-8225-4cf0-aa41-58e455795950 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0252f375-f89b-4d34-8598-7431febb602e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33df1e7f-628b-4d04-8572-e1c8164c6d07', 'volume_name': 'volume-33df1e7f-628b-4d04-8572-e1c8164c6d07', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:18 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-17c1b371-8225-4cf0-aa41-58e455795950 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b38e8ae6-6c34-4102-8d3d-8facd08ca842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:18 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-17c1b371-8225-4cf0-aa41-58e455795950 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b38e8ae6-6c34-4102-8d3d-8facd08ca842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:18 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-17c1b371-8225-4cf0-aa41-58e455795950 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (361f5430-227d-4cca-9074-9155bc1c158d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:18 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-17c1b371-8225-4cf0-aa41-58e455795950 tempest-CreateVolumesFromImageTest-388768697 None] Volume 33df1e7f-628b-4d04-8572-e1c8164c6d07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33df1e7f-628b-4d04-8572-e1c8164c6d07', 'volume_size': 1} Jun 24 05:20:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-17c1b371-8225-4cf0-aa41-58e455795950 tempest-CreateVolumesFromImageTest-388768697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-17c1b371-8225-4cf0-aa41-58e455795950 tempest-CreateVolumesFromImageTest-388768697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:18 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-17c1b371-8225-4cf0-aa41-58e455795950 tempest-CreateVolumesFromImageTest-388768697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:20:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2004079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33df1e7f-628b-4d04-8572-e1c8164c6d07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2e1354dbae4cfaa9c248c8532a01d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:20:19Z,use_quota=True,user_id='1bfd9456b5e6410e9fd932ad277ed7c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:20:18 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-17c1b371-8225-4cf0-aa41-58e455795950 tempest-CreateVolumesFromImageTest-388768697 None] Creating volume 33df1e7f-628b-4d04-8572-e1c8164c6d07 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:20:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-17c1b371-8225-4cf0-aa41-58e455795950 tempest-CreateVolumesFromImageTest-388768697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-17c1b371-8225-4cf0-aa41-58e455795950 tempest-CreateVolumesFromImageTest-388768697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:18 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-17c1b371-8225-4cf0-aa41-58e455795950 tempest-CreateVolumesFromImageTest-388768697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:20:18 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-17c1b371-8225-4cf0-aa41-58e455795950 tempest-CreateVolumesFromImageTest-388768697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:20:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-17c1b371-8225-4cf0-aa41-58e455795950 tempest-CreateVolumesFromImageTest-388768697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:20:18 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-17c1b371-8225-4cf0-aa41-58e455795950 tempest-CreateVolumesFromImageTest-388768697 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:20:18 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-17c1b371-8225-4cf0-aa41-58e455795950 tempest-CreateVolumesFromImageTest-388768697 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:20:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-17c1b371-8225-4cf0-aa41-58e455795950 tempest-CreateVolumesFromImageTest-388768697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-33df1e7f-628b-4d04-8572-e1c8164c6d07 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:19 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-77194da3-b5e4-4b6a-ae46-0eddc98d685b tempest-CinderUnicodeTest-774697758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:20:19 devstack sudo[114348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-33df1e7f-628b-4d04-8572-e1c8164c6d07 1073741824 Jun 24 05:20:19 devstack sudo[114348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-77194da3-b5e4-4b6a-ae46-0eddc98d685b tempest-CinderUnicodeTest-774697758 None] Flow 'volume_create_manager' (c2b22ec3-8e64-40ed-b423-8d8f0c9a1870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:20:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-77194da3-b5e4-4b6a-ae46-0eddc98d685b tempest-CinderUnicodeTest-774697758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfa2a8d6-aed1-44cf-847c-d9724aad58e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-77194da3-b5e4-4b6a-ae46-0eddc98d685b tempest-CinderUnicodeTest-774697758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfa2a8d6-aed1-44cf-847c-d9724aad58e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:20:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0c05576-856e-462b-a60c-0f9190cd3a40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f887660f405e435d83167985f1f937d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:20:19Z,use_quota=True,user_id='2995ee1f31ba47a1aee6ef56edbb7c14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-77194da3-b5e4-4b6a-ae46-0eddc98d685b tempest-CinderUnicodeTest-774697758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caadcb33-e31b-400c-9309-8485321a9e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-77194da3-b5e4-4b6a-ae46-0eddc98d685b tempest-CinderUnicodeTest-774697758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caadcb33-e31b-400c-9309-8485321a9e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-77194da3-b5e4-4b6a-ae46-0eddc98d685b tempest-CinderUnicodeTest-774697758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb602e3d-68b1-48c0-a8e6-79e4a48527b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-77194da3-b5e4-4b6a-ae46-0eddc98d685b tempest-CinderUnicodeTest-774697758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb602e3d-68b1-48c0-a8e6-79e4a48527b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0c05576-856e-462b-a60c-0f9190cd3a40', 'volume_name': 'volume-a0c05576-856e-462b-a60c-0f9190cd3a40', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-77194da3-b5e4-4b6a-ae46-0eddc98d685b tempest-CinderUnicodeTest-774697758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6f1e0fb-48f1-4099-acc2-f6888a0ecb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-77194da3-b5e4-4b6a-ae46-0eddc98d685b tempest-CinderUnicodeTest-774697758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6f1e0fb-48f1-4099-acc2-f6888a0ecb89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-77194da3-b5e4-4b6a-ae46-0eddc98d685b tempest-CinderUnicodeTest-774697758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72068a49-884b-4883-b89f-c76feca4153a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:19 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-77194da3-b5e4-4b6a-ae46-0eddc98d685b tempest-CinderUnicodeTest-774697758 None] Volume a0c05576-856e-462b-a60c-0f9190cd3a40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0c05576-856e-462b-a60c-0f9190cd3a40', 'volume_size': 1} Jun 24 05:20:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-77194da3-b5e4-4b6a-ae46-0eddc98d685b tempest-CinderUnicodeTest-774697758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:19 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6c7040c-7a47-463f-8018-400d27b77582 tempest-CreateVolumesFromImageTest-388768697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:20:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a6c7040c-7a47-463f-8018-400d27b77582 tempest-CreateVolumesFromImageTest-388768697 None] Flow 'volume_create_manager' (3e08bfcb-8aa1-4f76-9c47-e7c324e75c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:20:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a6c7040c-7a47-463f-8018-400d27b77582 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7d008a1-a621-432d-a4c8-7ef44f2563cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a6c7040c-7a47-463f-8018-400d27b77582 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7d008a1-a621-432d-a4c8-7ef44f2563cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1289954223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d04f352-cfa5-410e-a1e4-98b591a42245,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2e1354dbae4cfaa9c248c8532a01d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:20:19Z,use_quota=True,user_id='1bfd9456b5e6410e9fd932ad277ed7c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a6c7040c-7a47-463f-8018-400d27b77582 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4632cf5-b092-4525-b558-a46bc5f4df1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a6c7040c-7a47-463f-8018-400d27b77582 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4632cf5-b092-4525-b558-a46bc5f4df1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a6c7040c-7a47-463f-8018-400d27b77582 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f362fb5e-b237-4017-b4d8-23692fdcd8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a6c7040c-7a47-463f-8018-400d27b77582 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f362fb5e-b237-4017-b4d8-23692fdcd8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d04f352-cfa5-410e-a1e4-98b591a42245', 'volume_name': 'volume-7d04f352-cfa5-410e-a1e4-98b591a42245', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a6c7040c-7a47-463f-8018-400d27b77582 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5efe8cb6-0955-4099-b792-4628dde1e065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a6c7040c-7a47-463f-8018-400d27b77582 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5efe8cb6-0955-4099-b792-4628dde1e065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a6c7040c-7a47-463f-8018-400d27b77582 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbc48c21-da99-4d4c-9e02-9e2e525a40d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:19 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-a6c7040c-7a47-463f-8018-400d27b77582 tempest-CreateVolumesFromImageTest-388768697 None] Volume 7d04f352-cfa5-410e-a1e4-98b591a42245: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d04f352-cfa5-410e-a1e4-98b591a42245', 'volume_size': 1} Jun 24 05:20:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a6c7040c-7a47-463f-8018-400d27b77582 tempest-CreateVolumesFromImageTest-388768697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:19 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-f845cc25-4209-43ef-bd9b-759651aa2410 tempest-CreateVolumesFromSnapshotTest-994771565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:20:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f845cc25-4209-43ef-bd9b-759651aa2410 tempest-CreateVolumesFromSnapshotTest-994771565 None] Flow 'volume_create_manager' (29685059-4f29-4fb4-b222-d0f559180e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:20:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f845cc25-4209-43ef-bd9b-759651aa2410 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63c2a8a6-45c6-458a-a54f-d8967972c9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f845cc25-4209-43ef-bd9b-759651aa2410 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63c2a8a6-45c6-458a-a54f-d8967972c9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1215663894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61da3d7d6c694af0a37056f29b182683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:20:20Z,use_quota=True,user_id='0c87690e00cc4ca39cd726cd49849dd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f845cc25-4209-43ef-bd9b-759651aa2410 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60ef644f-55dd-4d35-8822-d5f42e43d191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f845cc25-4209-43ef-bd9b-759651aa2410 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60ef644f-55dd-4d35-8822-d5f42e43d191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f845cc25-4209-43ef-bd9b-759651aa2410 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04142740-bae0-445b-bc00-71479fa4fa84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f845cc25-4209-43ef-bd9b-759651aa2410 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04142740-bae0-445b-bc00-71479fa4fa84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04', 'volume_name': 'volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f845cc25-4209-43ef-bd9b-759651aa2410 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f732a2e-5b60-4a8c-bcff-c3123a2a6502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f845cc25-4209-43ef-bd9b-759651aa2410 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f732a2e-5b60-4a8c-bcff-c3123a2a6502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:19 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f845cc25-4209-43ef-bd9b-759651aa2410 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1363cff3-65e7-47ab-8d0d-f91703b5f2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:19 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-f845cc25-4209-43ef-bd9b-759651aa2410 tempest-CreateVolumesFromSnapshotTest-994771565 None] Volume f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04', 'volume_size': 1} Jun 24 05:20:19 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f845cc25-4209-43ef-bd9b-759651aa2410 tempest-CreateVolumesFromSnapshotTest-994771565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:20 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf6ab840-f95b-40f6-b630-cab192703134 tempest-CreateVolumesFromImageTest-388768697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:20:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cf6ab840-f95b-40f6-b630-cab192703134 tempest-CreateVolumesFromImageTest-388768697 None] Flow 'volume_create_manager' (3a52346a-1da2-4e7c-a060-568d5f19941d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:20:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cf6ab840-f95b-40f6-b630-cab192703134 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fad7d8cb-3dbb-456f-94aa-d1eccd4e5f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cf6ab840-f95b-40f6-b630-cab192703134 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fad7d8cb-3dbb-456f-94aa-d1eccd4e5f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2022931307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a4b4447-25fd-44d5-925e-042ce13b8068,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2e1354dbae4cfaa9c248c8532a01d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:20:20Z,use_quota=True,user_id='1bfd9456b5e6410e9fd932ad277ed7c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cf6ab840-f95b-40f6-b630-cab192703134 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ba7810c-67c7-4530-b073-942e779dc0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cf6ab840-f95b-40f6-b630-cab192703134 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ba7810c-67c7-4530-b073-942e779dc0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cf6ab840-f95b-40f6-b630-cab192703134 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37163ca5-44df-471f-961c-5d30eff9690a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cf6ab840-f95b-40f6-b630-cab192703134 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37163ca5-44df-471f-961c-5d30eff9690a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a4b4447-25fd-44d5-925e-042ce13b8068', 'volume_name': 'volume-5a4b4447-25fd-44d5-925e-042ce13b8068', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cf6ab840-f95b-40f6-b630-cab192703134 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c1a97dc-30db-4633-97b3-c519752446f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cf6ab840-f95b-40f6-b630-cab192703134 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c1a97dc-30db-4633-97b3-c519752446f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cf6ab840-f95b-40f6-b630-cab192703134 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (882e3c2d-ac73-433c-b231-ecda0c68d001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:20 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-cf6ab840-f95b-40f6-b630-cab192703134 tempest-CreateVolumesFromImageTest-388768697 None] Volume 5a4b4447-25fd-44d5-925e-042ce13b8068: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a4b4447-25fd-44d5-925e-042ce13b8068', 'volume_size': 1} Jun 24 05:20:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-cf6ab840-f95b-40f6-b630-cab192703134 tempest-CreateVolumesFromImageTest-388768697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:20 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d712e2b-b648-47bf-b0f2-216ac52fd017 tempest-CreateVolumesFromImageTest-388768697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:20:20 devstack sudo[114348]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2d712e2b-b648-47bf-b0f2-216ac52fd017 tempest-CreateVolumesFromImageTest-388768697 None] Flow 'volume_create_manager' (259d06ed-03f0-430c-ad00-ff8658c03c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:20:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2d712e2b-b648-47bf-b0f2-216ac52fd017 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12264320-64ad-48ae-a25f-2b5ed8e02907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-17c1b371-8225-4cf0-aa41-58e455795950 tempest-CreateVolumesFromImageTest-388768697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-33df1e7f-628b-4d04-8572-e1c8164c6d07 1073741824" returned: 0 in 1.416s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2d712e2b-b648-47bf-b0f2-216ac52fd017 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12264320-64ad-48ae-a25f-2b5ed8e02907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-219266006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0b99bb9-1845-4810-8283-9063cc88e395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2e1354dbae4cfaa9c248c8532a01d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:20:20Z,use_quota=True,user_id='1bfd9456b5e6410e9fd932ad277ed7c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2d712e2b-b648-47bf-b0f2-216ac52fd017 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf8aad6d-53bb-47f3-a9ff-32b1228893dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2d712e2b-b648-47bf-b0f2-216ac52fd017 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf8aad6d-53bb-47f3-a9ff-32b1228893dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2d712e2b-b648-47bf-b0f2-216ac52fd017 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52a13a8a-797b-49e5-b41e-db5a4c8e6529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2d712e2b-b648-47bf-b0f2-216ac52fd017 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52a13a8a-797b-49e5-b41e-db5a4c8e6529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0b99bb9-1845-4810-8283-9063cc88e395', 'volume_name': 'volume-b0b99bb9-1845-4810-8283-9063cc88e395', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2d712e2b-b648-47bf-b0f2-216ac52fd017 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64eda33a-9165-4f92-bf35-c4e939df2bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2d712e2b-b648-47bf-b0f2-216ac52fd017 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64eda33a-9165-4f92-bf35-c4e939df2bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2d712e2b-b648-47bf-b0f2-216ac52fd017 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c34ae84-1169-4d35-8da9-c263ebf40984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:20 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-2d712e2b-b648-47bf-b0f2-216ac52fd017 tempest-CreateVolumesFromImageTest-388768697 None] Volume b0b99bb9-1845-4810-8283-9063cc88e395: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0b99bb9-1845-4810-8283-9063cc88e395', 'volume_size': 1} Jun 24 05:20:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-2d712e2b-b648-47bf-b0f2-216ac52fd017 tempest-CreateVolumesFromImageTest-388768697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-17c1b371-8225-4cf0-aa41-58e455795950 tempest-CreateVolumesFromImageTest-388768697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-33df1e7f-628b-4d04-8572-e1c8164c6d07 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:20 devstack sudo[114354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-33df1e7f-628b-4d04-8572-e1c8164c6d07 Jun 24 05:20:20 devstack sudo[114354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:20 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-b690c807-e6af-4b0e-84d2-e4593eeb5c96 tempest-CreateVolumesFromImageTest-388768697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:20:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b690c807-e6af-4b0e-84d2-e4593eeb5c96 tempest-CreateVolumesFromImageTest-388768697 None] Flow 'volume_create_manager' (2aa23d25-4034-4849-8d5e-254e4181f605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:20:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b690c807-e6af-4b0e-84d2-e4593eeb5c96 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2d697b3-c946-4706-ad9a-93f9db3ab7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b690c807-e6af-4b0e-84d2-e4593eeb5c96 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2d697b3-c946-4706-ad9a-93f9db3ab7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-870682129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1556c35c-68ab-48ef-898f-5fe31da9d4f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2e1354dbae4cfaa9c248c8532a01d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:20:21Z,use_quota=True,user_id='1bfd9456b5e6410e9fd932ad277ed7c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b690c807-e6af-4b0e-84d2-e4593eeb5c96 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9acc1ce1-8370-4c97-a29a-016c44783736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b690c807-e6af-4b0e-84d2-e4593eeb5c96 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9acc1ce1-8370-4c97-a29a-016c44783736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b690c807-e6af-4b0e-84d2-e4593eeb5c96 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f992b536-4a7e-4c2a-ae52-84bf7204d8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b690c807-e6af-4b0e-84d2-e4593eeb5c96 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f992b536-4a7e-4c2a-ae52-84bf7204d8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1556c35c-68ab-48ef-898f-5fe31da9d4f9', 'volume_name': 'volume-1556c35c-68ab-48ef-898f-5fe31da9d4f9', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b690c807-e6af-4b0e-84d2-e4593eeb5c96 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13e53215-7dca-4b1c-8811-81e1126f5d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b690c807-e6af-4b0e-84d2-e4593eeb5c96 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13e53215-7dca-4b1c-8811-81e1126f5d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:20 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b690c807-e6af-4b0e-84d2-e4593eeb5c96 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fb5a938-b20d-46bb-9c8a-8b40e2b61a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:20 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-b690c807-e6af-4b0e-84d2-e4593eeb5c96 tempest-CreateVolumesFromImageTest-388768697 None] Volume 1556c35c-68ab-48ef-898f-5fe31da9d4f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1556c35c-68ab-48ef-898f-5fe31da9d4f9', 'volume_size': 1} Jun 24 05:20:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-b690c807-e6af-4b0e-84d2-e4593eeb5c96 tempest-CreateVolumesFromImageTest-388768697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:21 devstack sudo[114354]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-17c1b371-8225-4cf0-aa41-58e455795950 tempest-CreateVolumesFromImageTest-388768697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-33df1e7f-628b-4d04-8572-e1c8164c6d07" returned: 0 in 0.669s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:21 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-17c1b371-8225-4cf0-aa41-58e455795950 tempest-CreateVolumesFromImageTest-388768697 None] <== create_volume: return (2201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:20:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-17c1b371-8225-4cf0-aa41-58e455795950 tempest-CreateVolumesFromImageTest-388768697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.204s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:20:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-77194da3-b5e4-4b6a-ae46-0eddc98d685b tempest-CinderUnicodeTest-774697758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.964s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:21 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-77194da3-b5e4-4b6a-ae46-0eddc98d685b tempest-CinderUnicodeTest-774697758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:20:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0c05576-856e-462b-a60c-0f9190cd3a40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f887660f405e435d83167985f1f937d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:20:19Z,use_quota=True,user_id='2995ee1f31ba47a1aee6ef56edbb7c14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:20:21 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-77194da3-b5e4-4b6a-ae46-0eddc98d685b tempest-CinderUnicodeTest-774697758 None] Creating volume a0c05576-856e-462b-a60c-0f9190cd3a40 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:20:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-77194da3-b5e4-4b6a-ae46-0eddc98d685b tempest-CinderUnicodeTest-774697758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-77194da3-b5e4-4b6a-ae46-0eddc98d685b tempest-CinderUnicodeTest-774697758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:21 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-77194da3-b5e4-4b6a-ae46-0eddc98d685b tempest-CinderUnicodeTest-774697758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:20:21 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-77194da3-b5e4-4b6a-ae46-0eddc98d685b tempest-CinderUnicodeTest-774697758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:20:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-77194da3-b5e4-4b6a-ae46-0eddc98d685b tempest-CinderUnicodeTest-774697758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:20:21 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-77194da3-b5e4-4b6a-ae46-0eddc98d685b tempest-CinderUnicodeTest-774697758 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:20:21 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-77194da3-b5e4-4b6a-ae46-0eddc98d685b tempest-CinderUnicodeTest-774697758 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:20:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-77194da3-b5e4-4b6a-ae46-0eddc98d685b tempest-CinderUnicodeTest-774697758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a0c05576-856e-462b-a60c-0f9190cd3a40 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:21 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-17c1b371-8225-4cf0-aa41-58e455795950 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (361f5430-227d-4cca-9074-9155bc1c158d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33df1e7f-628b-4d04-8572-e1c8164c6d07', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:21 devstack sudo[114358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a0c05576-856e-462b-a60c-0f9190cd3a40 1073741824 Jun 24 05:20:21 devstack sudo[114358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:21 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-17c1b371-8225-4cf0-aa41-58e455795950 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9b16681-e6f0-4977-a3db-c17738db8168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:21 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-17c1b371-8225-4cf0-aa41-58e455795950 tempest-CreateVolumesFromImageTest-388768697 None] Volume volume-33df1e7f-628b-4d04-8572-e1c8164c6d07 (33df1e7f-628b-4d04-8572-e1c8164c6d07): created successfully Jun 24 05:20:21 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-17c1b371-8225-4cf0-aa41-58e455795950 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9b16681-e6f0-4977-a3db-c17738db8168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:21 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-17c1b371-8225-4cf0-aa41-58e455795950 tempest-CreateVolumesFromImageTest-388768697 None] Flow 'volume_create_manager' (e29167cf-344a-4783-9dee-e3d80a1bdf2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:20:21 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-17c1b371-8225-4cf0-aa41-58e455795950 tempest-CreateVolumesFromImageTest-388768697 None] Created volume successfully. Jun 24 05:20:22 devstack sudo[114358]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-77194da3-b5e4-4b6a-ae46-0eddc98d685b tempest-CinderUnicodeTest-774697758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a0c05576-856e-462b-a60c-0f9190cd3a40 1073741824" returned: 0 in 0.902s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-77194da3-b5e4-4b6a-ae46-0eddc98d685b tempest-CinderUnicodeTest-774697758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a0c05576-856e-462b-a60c-0f9190cd3a40 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:22 devstack sudo[114364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a0c05576-856e-462b-a60c-0f9190cd3a40 Jun 24 05:20:22 devstack sudo[114364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:22 devstack sudo[114364]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-77194da3-b5e4-4b6a-ae46-0eddc98d685b tempest-CinderUnicodeTest-774697758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a0c05576-856e-462b-a60c-0f9190cd3a40" returned: 0 in 0.697s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:22 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-77194da3-b5e4-4b6a-ae46-0eddc98d685b tempest-CinderUnicodeTest-774697758 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:20:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-77194da3-b5e4-4b6a-ae46-0eddc98d685b tempest-CinderUnicodeTest-774697758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.641s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:20:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a6c7040c-7a47-463f-8018-400d27b77582 tempest-CreateVolumesFromImageTest-388768697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.447s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:22 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a6c7040c-7a47-463f-8018-400d27b77582 tempest-CreateVolumesFromImageTest-388768697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1289954223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d04f352-cfa5-410e-a1e4-98b591a42245,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2e1354dbae4cfaa9c248c8532a01d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:20:19Z,use_quota=True,user_id='1bfd9456b5e6410e9fd932ad277ed7c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:20:22 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-a6c7040c-7a47-463f-8018-400d27b77582 tempest-CreateVolumesFromImageTest-388768697 None] Creating volume 7d04f352-cfa5-410e-a1e4-98b591a42245 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:20:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a6c7040c-7a47-463f-8018-400d27b77582 tempest-CreateVolumesFromImageTest-388768697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a6c7040c-7a47-463f-8018-400d27b77582 tempest-CreateVolumesFromImageTest-388768697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:22 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a6c7040c-7a47-463f-8018-400d27b77582 tempest-CreateVolumesFromImageTest-388768697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:20:22 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a6c7040c-7a47-463f-8018-400d27b77582 tempest-CreateVolumesFromImageTest-388768697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:20:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a6c7040c-7a47-463f-8018-400d27b77582 tempest-CreateVolumesFromImageTest-388768697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:20:22 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a6c7040c-7a47-463f-8018-400d27b77582 tempest-CreateVolumesFromImageTest-388768697 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:20:22 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-a6c7040c-7a47-463f-8018-400d27b77582 tempest-CreateVolumesFromImageTest-388768697 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:20:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a6c7040c-7a47-463f-8018-400d27b77582 tempest-CreateVolumesFromImageTest-388768697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7d04f352-cfa5-410e-a1e4-98b591a42245 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:22 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-77194da3-b5e4-4b6a-ae46-0eddc98d685b tempest-CinderUnicodeTest-774697758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72068a49-884b-4883-b89f-c76feca4153a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0c05576-856e-462b-a60c-0f9190cd3a40', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:22 devstack sudo[114368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7d04f352-cfa5-410e-a1e4-98b591a42245 1073741824 Jun 24 05:20:22 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-77194da3-b5e4-4b6a-ae46-0eddc98d685b tempest-CinderUnicodeTest-774697758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55536594-31c2-4553-8fa5-37af12d16e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:22 devstack sudo[114368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:22 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-77194da3-b5e4-4b6a-ae46-0eddc98d685b tempest-CinderUnicodeTest-774697758 None] Volume volume-a0c05576-856e-462b-a60c-0f9190cd3a40 (a0c05576-856e-462b-a60c-0f9190cd3a40): created successfully Jun 24 05:20:22 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-77194da3-b5e4-4b6a-ae46-0eddc98d685b tempest-CinderUnicodeTest-774697758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55536594-31c2-4553-8fa5-37af12d16e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:22 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-77194da3-b5e4-4b6a-ae46-0eddc98d685b tempest-CinderUnicodeTest-774697758 None] Flow 'volume_create_manager' (c2b22ec3-8e64-40ed-b423-8d8f0c9a1870) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:20:22 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-77194da3-b5e4-4b6a-ae46-0eddc98d685b tempest-CinderUnicodeTest-774697758 None] Created volume successfully. Jun 24 05:20:22 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:20:22 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Flow 'volume_create_manager' (b4cb9f3c-f10d-4be6-a6c9-2810ab36caa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:20:22 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7c0cbc7-cb33-4c42-bc50-4bca5cdbaeb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:22 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7c0cbc7-cb33-4c42-bc50-4bca5cdbaeb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:20:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daade867-d711-4a3c-b1c8-002472fd4d36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6445b3bfd9374cdd8009f1bf294379c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:20:23Z,use_quota=True,user_id='2e48d9cafa2d4bd08896402094ca2bd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ce826c1-0dab-47d9-809b-1dd3f02d54fa),volume_type_id=5ce826c1-0dab-47d9-809b-1dd3f02d54fa)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:22 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64a05ae2-0d85-4a47-aea8-287b6ca4d622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:23 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64a05ae2-0d85-4a47-aea8-287b6ca4d622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:23 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbf78b48-8843-4c4e-9dfa-28834c7e8281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:23 devstack cinder-volume[93830]: DEBUG cinder.image.glance [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Creating Keystone auth plugin from conf {{(pid=93830) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 24 05:20:23 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbf78b48-8843-4c4e-9dfa-28834c7e8281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'daade867-d711-4a3c-b1c8-002472fd4d36', 'volume_name': 'volume-daade867-d711-4a3c-b1c8-002472fd4d36', 'volume_size': 1, 'image_id': 'e8cc3d5d-c36e-437b-99be-2a711e2a8732', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e8cc3d5d-c36e-437b-99be-2a711e2a8732', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd218f9f876a5700bc142e1ea3eba6826', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6445b3bfd9374cdd8009f1bf294379c1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0ae3477ae4ba4853dd5f0012e0bad94db1c8d36fe474c25759b2226d8868dcb37d8ec6c1c6058d9be7d67c58ce972ba5da97a349bffe2066cf3a08056b7ac19c', 'id': 'e8cc3d5d-c36e-437b-99be-2a711e2a8732', 'created_at': datetime.datetime(2026, 6, 24, 3, 20, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 3, 20, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e8cc3d5d-c36e-437b-99be-2a711e2a8732/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:23 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2048f508-21f9-480b-8164-ba32a4ccde36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:23 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2048f508-21f9-480b-8164-ba32a4ccde36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:23 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ad73864-17e9-45fc-875a-25d73a286c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:23 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Volume daade867-d711-4a3c-b1c8-002472fd4d36: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-daade867-d711-4a3c-b1c8-002472fd4d36', 'volume_size': 1, 'image_id': 'e8cc3d5d-c36e-437b-99be-2a711e2a8732', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e8cc3d5d-c36e-437b-99be-2a711e2a8732', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd218f9f876a5700bc142e1ea3eba6826', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6445b3bfd9374cdd8009f1bf294379c1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0ae3477ae4ba4853dd5f0012e0bad94db1c8d36fe474c25759b2226d8868dcb37d8ec6c1c6058d9be7d67c58ce972ba5da97a349bffe2066cf3a08056b7ac19c', 'id': 'e8cc3d5d-c36e-437b-99be-2a711e2a8732', 'created_at': datetime.datetime(2026, 6, 24, 3, 20, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 3, 20, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e8cc3d5d-c36e-437b-99be-2a711e2a8732/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 24 05:20:23 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Trying to clone daade867-d711-4a3c-b1c8-002472fd4d36 from image e8cc3d5d-c36e-437b-99be-2a711e2a8732 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e8cc3d5d-c36e-437b-99be-2a711e2a8732', 'metadata': {}}]). {{(pid=93830) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 24 05:20:23 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e8cc3d5d-c36e-437b-99be-2a711e2a8732_qa6_r605devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93830) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 24 05:20:23 devstack cinder-volume[93830]: INFO cinder.image.image_utils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Image download 0.00 MB at 0.00 MB/s Jun 24 05:20:23 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7213ab-0e42-4a68-96be-e80d82c7d4ee]: (4, 'raw') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:20:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8cc3d5d-c36e-437b-99be-2a711e2a8732_qa6_r605devstack@QuobyteHD {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:23 devstack sudo[114370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8cc3d5d-c36e-437b-99be-2a711e2a8732_qa6_r605devstack@QuobyteHD Jun 24 05:20:23 devstack sudo[114370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:23 devstack sudo[114368]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a6c7040c-7a47-463f-8018-400d27b77582 tempest-CreateVolumesFromImageTest-388768697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7d04f352-cfa5-410e-a1e4-98b591a42245 1073741824" returned: 0 in 0.971s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a6c7040c-7a47-463f-8018-400d27b77582 tempest-CreateVolumesFromImageTest-388768697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7d04f352-cfa5-410e-a1e4-98b591a42245 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:23 devstack sudo[114375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7d04f352-cfa5-410e-a1e4-98b591a42245 Jun 24 05:20:23 devstack sudo[114375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:24 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-af40eb53-9c15-42d8-8f66-056a0707f99b tempest-CinderUnicodeTest-774697758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:20:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-af40eb53-9c15-42d8-8f66-056a0707f99b tempest-CinderUnicodeTest-774697758 None] Flow 'volume_create_manager' (16d8ad51-abae-4278-9e21-c35d70e892d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:20:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-af40eb53-9c15-42d8-8f66-056a0707f99b tempest-CinderUnicodeTest-774697758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dba945a-4f6c-4fc1-89ee-6f8a8abde2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-af40eb53-9c15-42d8-8f66-056a0707f99b tempest-CinderUnicodeTest-774697758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dba945a-4f6c-4fc1-89ee-6f8a8abde2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:20:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-53162442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4912260-4d7e-4289-bc3a-4e8c1ef4d238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f887660f405e435d83167985f1f937d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:20:24Z,use_quota=True,user_id='2995ee1f31ba47a1aee6ef56edbb7c14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-af40eb53-9c15-42d8-8f66-056a0707f99b tempest-CinderUnicodeTest-774697758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13370506-b251-4d41-be7b-62dc08365c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-af40eb53-9c15-42d8-8f66-056a0707f99b tempest-CinderUnicodeTest-774697758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13370506-b251-4d41-be7b-62dc08365c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-af40eb53-9c15-42d8-8f66-056a0707f99b tempest-CinderUnicodeTest-774697758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaaebab2-4111-4a76-bf22-9618f2e05a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-af40eb53-9c15-42d8-8f66-056a0707f99b tempest-CinderUnicodeTest-774697758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaaebab2-4111-4a76-bf22-9618f2e05a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4912260-4d7e-4289-bc3a-4e8c1ef4d238', 'volume_name': 'volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-af40eb53-9c15-42d8-8f66-056a0707f99b tempest-CinderUnicodeTest-774697758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1434b03-2f7b-4634-9d5e-ea399441b3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-af40eb53-9c15-42d8-8f66-056a0707f99b tempest-CinderUnicodeTest-774697758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1434b03-2f7b-4634-9d5e-ea399441b3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-af40eb53-9c15-42d8-8f66-056a0707f99b tempest-CinderUnicodeTest-774697758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71131d69-2d08-4889-ba1a-39fe2defe7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:24 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-af40eb53-9c15-42d8-8f66-056a0707f99b tempest-CinderUnicodeTest-774697758 None] Volume c4912260-4d7e-4289-bc3a-4e8c1ef4d238: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238', 'volume_size': 1} Jun 24 05:20:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-af40eb53-9c15-42d8-8f66-056a0707f99b tempest-CinderUnicodeTest-774697758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:24 devstack sudo[114370]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8cc3d5d-c36e-437b-99be-2a711e2a8732_qa6_r605devstack@QuobyteHD" returned: 0 in 0.807s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8cc3d5d-c36e-437b-99be-2a711e2a8732_qa6_r605devstack@QuobyteHD {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:24 devstack sudo[114379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8cc3d5d-c36e-437b-99be-2a711e2a8732_qa6_r605devstack@QuobyteHD Jun 24 05:20:24 devstack sudo[114379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:24 devstack sudo[114375]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a6c7040c-7a47-463f-8018-400d27b77582 tempest-CreateVolumesFromImageTest-388768697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7d04f352-cfa5-410e-a1e4-98b591a42245" returned: 0 in 0.672s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:24 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a6c7040c-7a47-463f-8018-400d27b77582 tempest-CreateVolumesFromImageTest-388768697 None] <== create_volume: return (1692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:20:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a6c7040c-7a47-463f-8018-400d27b77582 tempest-CreateVolumesFromImageTest-388768697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.694s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:20:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f845cc25-4209-43ef-bd9b-759651aa2410 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.816s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:24 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f845cc25-4209-43ef-bd9b-759651aa2410 tempest-CreateVolumesFromSnapshotTest-994771565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1215663894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61da3d7d6c694af0a37056f29b182683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:20:20Z,use_quota=True,user_id='0c87690e00cc4ca39cd726cd49849dd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:20:24 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-f845cc25-4209-43ef-bd9b-759651aa2410 tempest-CreateVolumesFromSnapshotTest-994771565 None] Creating volume f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:20:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f845cc25-4209-43ef-bd9b-759651aa2410 tempest-CreateVolumesFromSnapshotTest-994771565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f845cc25-4209-43ef-bd9b-759651aa2410 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:24 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f845cc25-4209-43ef-bd9b-759651aa2410 tempest-CreateVolumesFromSnapshotTest-994771565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:20:24 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f845cc25-4209-43ef-bd9b-759651aa2410 tempest-CreateVolumesFromSnapshotTest-994771565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:20:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f845cc25-4209-43ef-bd9b-759651aa2410 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:20:24 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f845cc25-4209-43ef-bd9b-759651aa2410 tempest-CreateVolumesFromSnapshotTest-994771565 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:20:24 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-f845cc25-4209-43ef-bd9b-759651aa2410 tempest-CreateVolumesFromSnapshotTest-994771565 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:20:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f845cc25-4209-43ef-bd9b-759651aa2410 tempest-CreateVolumesFromSnapshotTest-994771565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a6c7040c-7a47-463f-8018-400d27b77582 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbc48c21-da99-4d4c-9e02-9e2e525a40d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d04f352-cfa5-410e-a1e4-98b591a42245', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a6c7040c-7a47-463f-8018-400d27b77582 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97a3b73b-535c-484b-8e49-d402e597bff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:24 devstack sudo[114382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04 1073741824 Jun 24 05:20:24 devstack sudo[114382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:24 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-a6c7040c-7a47-463f-8018-400d27b77582 tempest-CreateVolumesFromImageTest-388768697 None] Volume volume-7d04f352-cfa5-410e-a1e4-98b591a42245 (7d04f352-cfa5-410e-a1e4-98b591a42245): created successfully Jun 24 05:20:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a6c7040c-7a47-463f-8018-400d27b77582 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97a3b73b-535c-484b-8e49-d402e597bff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-a6c7040c-7a47-463f-8018-400d27b77582 tempest-CreateVolumesFromImageTest-388768697 None] Flow 'volume_create_manager' (3e08bfcb-8aa1-4f76-9c47-e7c324e75c8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:20:24 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-a6c7040c-7a47-463f-8018-400d27b77582 tempest-CreateVolumesFromImageTest-388768697 None] Created volume successfully. Jun 24 05:20:24 devstack sudo[114379]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8cc3d5d-c36e-437b-99be-2a711e2a8732_qa6_r605devstack@QuobyteHD" returned: 1 in 0.727s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8cc3d5d-c36e-437b-99be-2a711e2a8732_qa6_r605devstack@QuobyteHD' failed. Not Retrying. {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 05:20:24 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Temporary image e8cc3d5d-c36e-437b-99be-2a711e2a8732 is fetched for user 2e48d9cafa2d4bd08896402094ca2bd9. {{(pid=93830) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 24 05:20:24 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2ea911-8270-4cde-9da0-6cfba98e0e0a]: (4, 'raw') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:20:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8cc3d5d-c36e-437b-99be-2a711e2a8732_qa6_r605devstack@QuobyteHD {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:25 devstack sudo[114387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8cc3d5d-c36e-437b-99be-2a711e2a8732_qa6_r605devstack@QuobyteHD Jun 24 05:20:25 devstack sudo[114387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:25 devstack sudo[114382]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f845cc25-4209-43ef-bd9b-759651aa2410 tempest-CreateVolumesFromSnapshotTest-994771565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04 1073741824" returned: 0 in 0.834s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f845cc25-4209-43ef-bd9b-759651aa2410 tempest-CreateVolumesFromSnapshotTest-994771565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:25 devstack sudo[114394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04 Jun 24 05:20:25 devstack sudo[114394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:25 devstack sudo[114387]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8cc3d5d-c36e-437b-99be-2a711e2a8732_qa6_r605devstack@QuobyteHD" returned: 0 in 0.755s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8cc3d5d-c36e-437b-99be-2a711e2a8732_qa6_r605devstack@QuobyteHD {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:25 devstack sudo[114398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8cc3d5d-c36e-437b-99be-2a711e2a8732_qa6_r605devstack@QuobyteHD Jun 24 05:20:25 devstack sudo[114398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:26 devstack sudo[114394]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f845cc25-4209-43ef-bd9b-759651aa2410 tempest-CreateVolumesFromSnapshotTest-994771565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04" returned: 0 in 0.680s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:26 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f845cc25-4209-43ef-bd9b-759651aa2410 tempest-CreateVolumesFromSnapshotTest-994771565 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:20:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f845cc25-4209-43ef-bd9b-759651aa2410 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:20:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-cf6ab840-f95b-40f6-b630-cab192703134 tempest-CreateVolumesFromImageTest-388768697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.878s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:26 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-cf6ab840-f95b-40f6-b630-cab192703134 tempest-CreateVolumesFromImageTest-388768697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2022931307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a4b4447-25fd-44d5-925e-042ce13b8068,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2e1354dbae4cfaa9c248c8532a01d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:20:20Z,use_quota=True,user_id='1bfd9456b5e6410e9fd932ad277ed7c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:20:26 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-cf6ab840-f95b-40f6-b630-cab192703134 tempest-CreateVolumesFromImageTest-388768697 None] Creating volume 5a4b4447-25fd-44d5-925e-042ce13b8068 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:20:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-cf6ab840-f95b-40f6-b630-cab192703134 tempest-CreateVolumesFromImageTest-388768697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-cf6ab840-f95b-40f6-b630-cab192703134 tempest-CreateVolumesFromImageTest-388768697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:26 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-cf6ab840-f95b-40f6-b630-cab192703134 tempest-CreateVolumesFromImageTest-388768697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:20:26 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-cf6ab840-f95b-40f6-b630-cab192703134 tempest-CreateVolumesFromImageTest-388768697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:20:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-cf6ab840-f95b-40f6-b630-cab192703134 tempest-CreateVolumesFromImageTest-388768697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:20:26 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-cf6ab840-f95b-40f6-b630-cab192703134 tempest-CreateVolumesFromImageTest-388768697 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:20:26 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-cf6ab840-f95b-40f6-b630-cab192703134 tempest-CreateVolumesFromImageTest-388768697 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:20:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-cf6ab840-f95b-40f6-b630-cab192703134 tempest-CreateVolumesFromImageTest-388768697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-5a4b4447-25fd-44d5-925e-042ce13b8068 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:26 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f845cc25-4209-43ef-bd9b-759651aa2410 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1363cff3-65e7-47ab-8d0d-f91703b5f2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:26 devstack sudo[114401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-5a4b4447-25fd-44d5-925e-042ce13b8068 1073741824 Jun 24 05:20:26 devstack sudo[114401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:26 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f845cc25-4209-43ef-bd9b-759651aa2410 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cba1ef9-9503-4177-8b28-866f77bc7189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:26 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-f845cc25-4209-43ef-bd9b-759651aa2410 tempest-CreateVolumesFromSnapshotTest-994771565 None] Volume volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04 (f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04): created successfully Jun 24 05:20:26 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f845cc25-4209-43ef-bd9b-759651aa2410 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cba1ef9-9503-4177-8b28-866f77bc7189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:26 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-f845cc25-4209-43ef-bd9b-759651aa2410 tempest-CreateVolumesFromSnapshotTest-994771565 None] Flow 'volume_create_manager' (29685059-4f29-4fb4-b222-d0f559180e89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:20:26 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-f845cc25-4209-43ef-bd9b-759651aa2410 tempest-CreateVolumesFromSnapshotTest-994771565 None] Created volume successfully. Jun 24 05:20:26 devstack sudo[114398]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8cc3d5d-c36e-437b-99be-2a711e2a8732_qa6_r605devstack@QuobyteHD" returned: 1 in 0.802s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8cc3d5d-c36e-437b-99be-2a711e2a8732_qa6_r605devstack@QuobyteHD' failed. Not Retrying. {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 05:20:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:26 devstack sudo[114401]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-cf6ab840-f95b-40f6-b630-cab192703134 tempest-CreateVolumesFromImageTest-388768697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-5a4b4447-25fd-44d5-925e-042ce13b8068 1073741824" returned: 0 in 0.814s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-cf6ab840-f95b-40f6-b630-cab192703134 tempest-CreateVolumesFromImageTest-388768697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-5a4b4447-25fd-44d5-925e-042ce13b8068 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:26 devstack sudo[114410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-5a4b4447-25fd-44d5-925e-042ce13b8068 Jun 24 05:20:26 devstack sudo[114410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-249362ef-ef64-4ef5-be52-5ababc5de477 tempest-CreateVolumesFromSnapshotTest-994771565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:27 devstack sudo[114410]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-cf6ab840-f95b-40f6-b630-cab192703134 tempest-CreateVolumesFromImageTest-388768697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-5a4b4447-25fd-44d5-925e-042ce13b8068" returned: 0 in 0.660s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:27 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-cf6ab840-f95b-40f6-b630-cab192703134 tempest-CreateVolumesFromImageTest-388768697 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:20:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-cf6ab840-f95b-40f6-b630-cab192703134 tempest-CreateVolumesFromImageTest-388768697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:20:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-2d712e2b-b648-47bf-b0f2-216ac52fd017 tempest-CreateVolumesFromImageTest-388768697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.137s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:27 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-2d712e2b-b648-47bf-b0f2-216ac52fd017 tempest-CreateVolumesFromImageTest-388768697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-219266006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0b99bb9-1845-4810-8283-9063cc88e395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2e1354dbae4cfaa9c248c8532a01d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:20:20Z,use_quota=True,user_id='1bfd9456b5e6410e9fd932ad277ed7c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:20:27 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-2d712e2b-b648-47bf-b0f2-216ac52fd017 tempest-CreateVolumesFromImageTest-388768697 None] Creating volume b0b99bb9-1845-4810-8283-9063cc88e395 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:20:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-2d712e2b-b648-47bf-b0f2-216ac52fd017 tempest-CreateVolumesFromImageTest-388768697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-2d712e2b-b648-47bf-b0f2-216ac52fd017 tempest-CreateVolumesFromImageTest-388768697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:27 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-2d712e2b-b648-47bf-b0f2-216ac52fd017 tempest-CreateVolumesFromImageTest-388768697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:20:27 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-2d712e2b-b648-47bf-b0f2-216ac52fd017 tempest-CreateVolumesFromImageTest-388768697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:20:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-2d712e2b-b648-47bf-b0f2-216ac52fd017 tempest-CreateVolumesFromImageTest-388768697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:20:27 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-2d712e2b-b648-47bf-b0f2-216ac52fd017 tempest-CreateVolumesFromImageTest-388768697 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:20:27 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-2d712e2b-b648-47bf-b0f2-216ac52fd017 tempest-CreateVolumesFromImageTest-388768697 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:20:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2d712e2b-b648-47bf-b0f2-216ac52fd017 tempest-CreateVolumesFromImageTest-388768697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b0b99bb9-1845-4810-8283-9063cc88e395 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:27 devstack sudo[114413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b0b99bb9-1845-4810-8283-9063cc88e395 1073741824 Jun 24 05:20:27 devstack sudo[114413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:27 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cf6ab840-f95b-40f6-b630-cab192703134 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (882e3c2d-ac73-433c-b231-ecda0c68d001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a4b4447-25fd-44d5-925e-042ce13b8068', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:27 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cf6ab840-f95b-40f6-b630-cab192703134 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b9fd2b4-9a94-48ea-a4b9-e8da9c473364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:27 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-cf6ab840-f95b-40f6-b630-cab192703134 tempest-CreateVolumesFromImageTest-388768697 None] Volume volume-5a4b4447-25fd-44d5-925e-042ce13b8068 (5a4b4447-25fd-44d5-925e-042ce13b8068): created successfully Jun 24 05:20:27 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cf6ab840-f95b-40f6-b630-cab192703134 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b9fd2b4-9a94-48ea-a4b9-e8da9c473364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:27 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-cf6ab840-f95b-40f6-b630-cab192703134 tempest-CreateVolumesFromImageTest-388768697 None] Flow 'volume_create_manager' (3a52346a-1da2-4e7c-a060-568d5f19941d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:20:27 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-cf6ab840-f95b-40f6-b630-cab192703134 tempest-CreateVolumesFromImageTest-388768697 None] Created volume successfully. Jun 24 05:20:28 devstack sudo[114413]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2d712e2b-b648-47bf-b0f2-216ac52fd017 tempest-CreateVolumesFromImageTest-388768697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b0b99bb9-1845-4810-8283-9063cc88e395 1073741824" returned: 0 in 0.814s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2d712e2b-b648-47bf-b0f2-216ac52fd017 tempest-CreateVolumesFromImageTest-388768697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b0b99bb9-1845-4810-8283-9063cc88e395 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:28 devstack sudo[114418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b0b99bb9-1845-4810-8283-9063cc88e395 Jun 24 05:20:28 devstack sudo[114418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:29 devstack sudo[114418]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2d712e2b-b648-47bf-b0f2-216ac52fd017 tempest-CreateVolumesFromImageTest-388768697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b0b99bb9-1845-4810-8283-9063cc88e395" returned: 0 in 0.632s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:29 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-2d712e2b-b648-47bf-b0f2-216ac52fd017 tempest-CreateVolumesFromImageTest-388768697 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:20:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-2d712e2b-b648-47bf-b0f2-216ac52fd017 tempest-CreateVolumesFromImageTest-388768697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:20:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-b690c807-e6af-4b0e-84d2-e4593eeb5c96 tempest-CreateVolumesFromImageTest-388768697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.373s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:29 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-b690c807-e6af-4b0e-84d2-e4593eeb5c96 tempest-CreateVolumesFromImageTest-388768697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-870682129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1556c35c-68ab-48ef-898f-5fe31da9d4f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2e1354dbae4cfaa9c248c8532a01d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:20:21Z,use_quota=True,user_id='1bfd9456b5e6410e9fd932ad277ed7c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:20:29 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-b690c807-e6af-4b0e-84d2-e4593eeb5c96 tempest-CreateVolumesFromImageTest-388768697 None] Creating volume 1556c35c-68ab-48ef-898f-5fe31da9d4f9 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:20:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-b690c807-e6af-4b0e-84d2-e4593eeb5c96 tempest-CreateVolumesFromImageTest-388768697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-b690c807-e6af-4b0e-84d2-e4593eeb5c96 tempest-CreateVolumesFromImageTest-388768697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:29 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-b690c807-e6af-4b0e-84d2-e4593eeb5c96 tempest-CreateVolumesFromImageTest-388768697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:20:29 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-b690c807-e6af-4b0e-84d2-e4593eeb5c96 tempest-CreateVolumesFromImageTest-388768697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:20:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-b690c807-e6af-4b0e-84d2-e4593eeb5c96 tempest-CreateVolumesFromImageTest-388768697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:20:29 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-b690c807-e6af-4b0e-84d2-e4593eeb5c96 tempest-CreateVolumesFromImageTest-388768697 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:20:29 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-b690c807-e6af-4b0e-84d2-e4593eeb5c96 tempest-CreateVolumesFromImageTest-388768697 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:20:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-b690c807-e6af-4b0e-84d2-e4593eeb5c96 tempest-CreateVolumesFromImageTest-388768697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-1556c35c-68ab-48ef-898f-5fe31da9d4f9 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:29 devstack sudo[114421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-1556c35c-68ab-48ef-898f-5fe31da9d4f9 1073741824 Jun 24 05:20:29 devstack sudo[114421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:29 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2d712e2b-b648-47bf-b0f2-216ac52fd017 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c34ae84-1169-4d35-8da9-c263ebf40984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0b99bb9-1845-4810-8283-9063cc88e395', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:29 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2d712e2b-b648-47bf-b0f2-216ac52fd017 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90bfde4f-ec26-4f79-bf78-db83fb213257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:29 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-2d712e2b-b648-47bf-b0f2-216ac52fd017 tempest-CreateVolumesFromImageTest-388768697 None] Volume volume-b0b99bb9-1845-4810-8283-9063cc88e395 (b0b99bb9-1845-4810-8283-9063cc88e395): created successfully Jun 24 05:20:29 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2d712e2b-b648-47bf-b0f2-216ac52fd017 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90bfde4f-ec26-4f79-bf78-db83fb213257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:29 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2d712e2b-b648-47bf-b0f2-216ac52fd017 tempest-CreateVolumesFromImageTest-388768697 None] Flow 'volume_create_manager' (259d06ed-03f0-430c-ad00-ff8658c03c27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:20:29 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-2d712e2b-b648-47bf-b0f2-216ac52fd017 tempest-CreateVolumesFromImageTest-388768697 None] Created volume successfully. Jun 24 05:20:29 devstack sudo[114421]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-b690c807-e6af-4b0e-84d2-e4593eeb5c96 tempest-CreateVolumesFromImageTest-388768697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-1556c35c-68ab-48ef-898f-5fe31da9d4f9 1073741824" returned: 0 in 0.802s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-b690c807-e6af-4b0e-84d2-e4593eeb5c96 tempest-CreateVolumesFromImageTest-388768697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-1556c35c-68ab-48ef-898f-5fe31da9d4f9 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:29 devstack sudo[114427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-1556c35c-68ab-48ef-898f-5fe31da9d4f9 Jun 24 05:20:29 devstack sudo[114427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:30 devstack sudo[114427]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-b690c807-e6af-4b0e-84d2-e4593eeb5c96 tempest-CreateVolumesFromImageTest-388768697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-1556c35c-68ab-48ef-898f-5fe31da9d4f9" returned: 0 in 0.631s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:30 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-b690c807-e6af-4b0e-84d2-e4593eeb5c96 tempest-CreateVolumesFromImageTest-388768697 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:20:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-b690c807-e6af-4b0e-84d2-e4593eeb5c96 tempest-CreateVolumesFromImageTest-388768697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:20:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-af40eb53-9c15-42d8-8f66-056a0707f99b tempest-CinderUnicodeTest-774697758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.443s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:30 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-af40eb53-9c15-42d8-8f66-056a0707f99b tempest-CinderUnicodeTest-774697758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:20:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-53162442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4912260-4d7e-4289-bc3a-4e8c1ef4d238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f887660f405e435d83167985f1f937d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:20:24Z,use_quota=True,user_id='2995ee1f31ba47a1aee6ef56edbb7c14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:20:30 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-af40eb53-9c15-42d8-8f66-056a0707f99b tempest-CinderUnicodeTest-774697758 None] Creating volume c4912260-4d7e-4289-bc3a-4e8c1ef4d238 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:20:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-af40eb53-9c15-42d8-8f66-056a0707f99b tempest-CinderUnicodeTest-774697758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-af40eb53-9c15-42d8-8f66-056a0707f99b tempest-CinderUnicodeTest-774697758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:30 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-af40eb53-9c15-42d8-8f66-056a0707f99b tempest-CinderUnicodeTest-774697758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:20:30 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-af40eb53-9c15-42d8-8f66-056a0707f99b tempest-CinderUnicodeTest-774697758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:20:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-af40eb53-9c15-42d8-8f66-056a0707f99b tempest-CinderUnicodeTest-774697758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:20:30 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-af40eb53-9c15-42d8-8f66-056a0707f99b tempest-CinderUnicodeTest-774697758 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:20:30 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-af40eb53-9c15-42d8-8f66-056a0707f99b tempest-CinderUnicodeTest-774697758 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:20:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-af40eb53-9c15-42d8-8f66-056a0707f99b tempest-CinderUnicodeTest-774697758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:30 devstack sudo[114430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238 1073741824 Jun 24 05:20:30 devstack sudo[114430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:30 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b690c807-e6af-4b0e-84d2-e4593eeb5c96 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fb5a938-b20d-46bb-9c8a-8b40e2b61a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1556c35c-68ab-48ef-898f-5fe31da9d4f9', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:30 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b690c807-e6af-4b0e-84d2-e4593eeb5c96 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecaf482a-55d5-4f05-99e3-854e4eab9089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:30 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-b690c807-e6af-4b0e-84d2-e4593eeb5c96 tempest-CreateVolumesFromImageTest-388768697 None] Volume volume-1556c35c-68ab-48ef-898f-5fe31da9d4f9 (1556c35c-68ab-48ef-898f-5fe31da9d4f9): created successfully Jun 24 05:20:30 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b690c807-e6af-4b0e-84d2-e4593eeb5c96 tempest-CreateVolumesFromImageTest-388768697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecaf482a-55d5-4f05-99e3-854e4eab9089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:30 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-b690c807-e6af-4b0e-84d2-e4593eeb5c96 tempest-CreateVolumesFromImageTest-388768697 None] Flow 'volume_create_manager' (2aa23d25-4034-4849-8d5e-254e4181f605) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:20:30 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-b690c807-e6af-4b0e-84d2-e4593eeb5c96 tempest-CreateVolumesFromImageTest-388768697 None] Created volume successfully. Jun 24 05:20:31 devstack sudo[114430]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-af40eb53-9c15-42d8-8f66-056a0707f99b tempest-CinderUnicodeTest-774697758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238 1073741824" returned: 0 in 0.818s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-af40eb53-9c15-42d8-8f66-056a0707f99b tempest-CinderUnicodeTest-774697758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:31 devstack sudo[114437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238 Jun 24 05:20:31 devstack sudo[114437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:31 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a08c8233-275c-4fec-91b3-b8a7cba29b2e tempest-CreateVolumesFromImageTest-388768697 None] Acquiring lock "cinder-1556c35c-68ab-48ef-898f-5fe31da9d4f9-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:20:31 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a08c8233-275c-4fec-91b3-b8a7cba29b2e tempest-CreateVolumesFromImageTest-388768697 None] Lock "cinder-1556c35c-68ab-48ef-898f-5fe31da9d4f9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:20:31 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a08c8233-275c-4fec-91b3-b8a7cba29b2e tempest-CreateVolumesFromImageTest-388768697 None] Acquiring lock "cinder-quobyte-1556c35c-68ab-48ef-898f-5fe31da9d4f9" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:20:31 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a08c8233-275c-4fec-91b3-b8a7cba29b2e tempest-CreateVolumesFromImageTest-388768697 None] Lock "cinder-quobyte-1556c35c-68ab-48ef-898f-5fe31da9d4f9" acquired by "delete_volume" :: waited 0.018s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:20:31 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acda2fc-9faf-4096-b938-e562cfa3c197]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:20:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a08c8233-275c-4fec-91b3-b8a7cba29b2e tempest-CreateVolumesFromImageTest-388768697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-1556c35c-68ab-48ef-898f-5fe31da9d4f9 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:31 devstack sudo[114439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-1556c35c-68ab-48ef-898f-5fe31da9d4f9 Jun 24 05:20:31 devstack sudo[114439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:32 devstack sudo[114437]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-af40eb53-9c15-42d8-8f66-056a0707f99b tempest-CinderUnicodeTest-774697758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238" returned: 0 in 0.670s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:32 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-af40eb53-9c15-42d8-8f66-056a0707f99b tempest-CinderUnicodeTest-774697758 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:20:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-af40eb53-9c15-42d8-8f66-056a0707f99b tempest-CinderUnicodeTest-774697758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:20:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.549s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:32 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:20:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daade867-d711-4a3c-b1c8-002472fd4d36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6445b3bfd9374cdd8009f1bf294379c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:20:23Z,use_quota=True,user_id='2e48d9cafa2d4bd08896402094ca2bd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ce826c1-0dab-47d9-809b-1dd3f02d54fa),volume_type_id=5ce826c1-0dab-47d9-809b-1dd3f02d54fa)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:20:32 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Creating volume daade867-d711-4a3c-b1c8-002472fd4d36 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:20:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:32 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:20:32 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:20:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:20:32 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:20:32 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:20:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-daade867-d711-4a3c-b1c8-002472fd4d36 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:32 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-af40eb53-9c15-42d8-8f66-056a0707f99b tempest-CinderUnicodeTest-774697758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71131d69-2d08-4889-ba1a-39fe2defe7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:32 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-af40eb53-9c15-42d8-8f66-056a0707f99b tempest-CinderUnicodeTest-774697758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9bf9e69-6dce-43eb-87db-96db6cd5e411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:32 devstack sudo[114442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-daade867-d711-4a3c-b1c8-002472fd4d36 1073741824 Jun 24 05:20:32 devstack sudo[114442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:32 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-af40eb53-9c15-42d8-8f66-056a0707f99b tempest-CinderUnicodeTest-774697758 None] Volume volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238 (c4912260-4d7e-4289-bc3a-4e8c1ef4d238): created successfully Jun 24 05:20:32 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-af40eb53-9c15-42d8-8f66-056a0707f99b tempest-CinderUnicodeTest-774697758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9bf9e69-6dce-43eb-87db-96db6cd5e411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:32 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-af40eb53-9c15-42d8-8f66-056a0707f99b tempest-CinderUnicodeTest-774697758 None] Flow 'volume_create_manager' (16d8ad51-abae-4278-9e21-c35d70e892d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:20:32 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-af40eb53-9c15-42d8-8f66-056a0707f99b tempest-CinderUnicodeTest-774697758 None] Created volume successfully. Jun 24 05:20:32 devstack sudo[114439]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a08c8233-275c-4fec-91b3-b8a7cba29b2e tempest-CreateVolumesFromImageTest-388768697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-1556c35c-68ab-48ef-898f-5fe31da9d4f9" returned: 0 in 0.810s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a08c8233-275c-4fec-91b3-b8a7cba29b2e tempest-CreateVolumesFromImageTest-388768697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-1556c35c-68ab-48ef-898f-5fe31da9d4f9 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:32 devstack sudo[114447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-1556c35c-68ab-48ef-898f-5fe31da9d4f9 Jun 24 05:20:32 devstack sudo[114447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9ef6bc51-1f41-461e-8ad9-d2ddd4e30b4a tempest-CinderUnicodeTest-774697758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:32 devstack sudo[114442]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-daade867-d711-4a3c-b1c8-002472fd4d36 1073741824" returned: 0 in 0.879s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-daade867-d711-4a3c-b1c8-002472fd4d36 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:33 devstack sudo[114453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-daade867-d711-4a3c-b1c8-002472fd4d36 Jun 24 05:20:33 devstack sudo[114453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:33 devstack sudo[114447]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a08c8233-275c-4fec-91b3-b8a7cba29b2e tempest-CreateVolumesFromImageTest-388768697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-1556c35c-68ab-48ef-898f-5fe31da9d4f9" returned: 0 in 0.739s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:33 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a08c8233-275c-4fec-91b3-b8a7cba29b2e tempest-CreateVolumesFromImageTest-388768697 None] Lock "cinder-quobyte-1556c35c-68ab-48ef-898f-5fe31da9d4f9" released by "delete_volume" :: held 1.599s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:20:33 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-a08c8233-275c-4fec-91b3-b8a7cba29b2e tempest-CreateVolumesFromImageTest-388768697 None] Created reservations ['d3232104-865c-4922-9e53-33e7b109084a', '6c8dc2e0-e81a-47f3-9fe5-92ee7a450b20', 'ad2750a8-5414-4ad0-a5e3-0b122af8af4a', 'b4ead4dc-442b-44c3-97bb-b37629d888e0'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:20:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a08c8233-275c-4fec-91b3-b8a7cba29b2e tempest-CreateVolumesFromImageTest-388768697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a08c8233-275c-4fec-91b3-b8a7cba29b2e tempest-CreateVolumesFromImageTest-388768697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:33 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a08c8233-275c-4fec-91b3-b8a7cba29b2e tempest-CreateVolumesFromImageTest-388768697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:20:33 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a08c8233-275c-4fec-91b3-b8a7cba29b2e tempest-CreateVolumesFromImageTest-388768697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:20:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a08c8233-275c-4fec-91b3-b8a7cba29b2e tempest-CreateVolumesFromImageTest-388768697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:20:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a08c8233-275c-4fec-91b3-b8a7cba29b2e tempest-CreateVolumesFromImageTest-388768697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:33 devstack sudo[114456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:20:33 devstack sudo[114456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:33 devstack sudo[114453]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-daade867-d711-4a3c-b1c8-002472fd4d36" returned: 0 in 0.673s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:33 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] <== create_volume: return (1595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:20:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:20:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-249362ef-ef64-4ef5-be52-5ababc5de477 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.670s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:33 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-249362ef-ef64-4ef5-be52-5ababc5de477 tempest-CreateVolumesFromSnapshotTest-994771565 None] Creating offline snapshot 9e77c37e-b60c-42a1-9a9e-c6eaf81777b4 of volume f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04 {{(pid=93830) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 05:20:33 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff2671e-8fa5-4668-ae15-82eac45d5061]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:20:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-249362ef-ef64-4ef5-be52-5ababc5de477 tempest-CreateVolumesFromSnapshotTest-994771565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:33 devstack cinder-volume[93830]: DEBUG cinder.volume.volume_utils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Attempting download of e8cc3d5d-c36e-437b-99be-2a711e2a8732 ((None, [{'url': 'file:///opt/stack/data/glance/images/e8cc3d5d-c36e-437b-99be-2a711e2a8732', 'metadata': {}}])) to volume daade867-d711-4a3c-b1c8-002472fd4d36. {{(pid=93830) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 24 05:20:33 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-5e37630b-044d-44ee-8d22-6d7c71377eb3 tempest-CreateVolumesFromImageTest-388768697 None] Acquiring lock "cinder-b0b99bb9-1845-4810-8283-9063cc88e395-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:20:33 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-5e37630b-044d-44ee-8d22-6d7c71377eb3 tempest-CreateVolumesFromImageTest-388768697 None] Lock "cinder-b0b99bb9-1845-4810-8283-9063cc88e395-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:20:33 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9250901-68f6-45f9-98a9-dba478697927]: (4, 'raw') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:20:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e8cc3d5d-c36e-437b-99be-2a711e2a8732_bw5gf4k4 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:33 devstack sudo[114459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04 Jun 24 05:20:33 devstack sudo[114459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:33 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-5e37630b-044d-44ee-8d22-6d7c71377eb3 tempest-CreateVolumesFromImageTest-388768697 None] Acquiring lock "cinder-quobyte-b0b99bb9-1845-4810-8283-9063cc88e395" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:20:33 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-5e37630b-044d-44ee-8d22-6d7c71377eb3 tempest-CreateVolumesFromImageTest-388768697 None] Lock "cinder-quobyte-b0b99bb9-1845-4810-8283-9063cc88e395" acquired by "delete_volume" :: waited 0.020s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:20:33 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[37883264-0530-4851-83df-75ce0f5e17ac]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:20:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5e37630b-044d-44ee-8d22-6d7c71377eb3 tempest-CreateVolumesFromImageTest-388768697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b0b99bb9-1845-4810-8283-9063cc88e395 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:34 devstack sudo[114460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e8cc3d5d-c36e-437b-99be-2a711e2a8732_bw5gf4k4 Jun 24 05:20:34 devstack sudo[114460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:34 devstack sudo[114456]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a08c8233-275c-4fec-91b3-b8a7cba29b2e tempest-CreateVolumesFromImageTest-388768697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.716s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:34 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-a08c8233-275c-4fec-91b3-b8a7cba29b2e tempest-CreateVolumesFromImageTest-388768697 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:20:34 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-a08c8233-275c-4fec-91b3-b8a7cba29b2e tempest-CreateVolumesFromImageTest-388768697 None] Deleted volume successfully. Jun 24 05:20:34 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a08c8233-275c-4fec-91b3-b8a7cba29b2e tempest-CreateVolumesFromImageTest-388768697 None] Lock "cinder-1556c35c-68ab-48ef-898f-5fe31da9d4f9-delete_volume" released by "delete_volume" :: held 2.565s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:20:34 devstack sudo[114463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b0b99bb9-1845-4810-8283-9063cc88e395 Jun 24 05:20:34 devstack sudo[114463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:34 devstack sudo[114459]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-249362ef-ef64-4ef5-be52-5ababc5de477 tempest-CreateVolumesFromSnapshotTest-994771565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04" returned: 0 in 0.842s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-249362ef-ef64-4ef5-be52-5ababc5de477 tempest-CreateVolumesFromSnapshotTest-994771565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04.9e77c37e-b60c-42a1-9a9e-c6eaf81777b4 1G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:34 devstack sudo[114471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04.9e77c37e-b60c-42a1-9a9e-c6eaf81777b4 1G Jun 24 05:20:34 devstack sudo[114471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:34 devstack sudo[114460]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e8cc3d5d-c36e-437b-99be-2a711e2a8732_bw5gf4k4" returned: 0 in 0.772s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e8cc3d5d-c36e-437b-99be-2a711e2a8732_bw5gf4k4 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:34 devstack sudo[114474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e8cc3d5d-c36e-437b-99be-2a711e2a8732_bw5gf4k4 Jun 24 05:20:34 devstack sudo[114474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:34 devstack sudo[114463]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5e37630b-044d-44ee-8d22-6d7c71377eb3 tempest-CreateVolumesFromImageTest-388768697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b0b99bb9-1845-4810-8283-9063cc88e395" returned: 0 in 0.813s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5e37630b-044d-44ee-8d22-6d7c71377eb3 tempest-CreateVolumesFromImageTest-388768697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b0b99bb9-1845-4810-8283-9063cc88e395 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:34 devstack sudo[114478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b0b99bb9-1845-4810-8283-9063cc88e395 Jun 24 05:20:34 devstack sudo[114478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:35 devstack sudo[114474]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:35 devstack sudo[114471]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-249362ef-ef64-4ef5-be52-5ababc5de477 tempest-CreateVolumesFromSnapshotTest-994771565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04.9e77c37e-b60c-42a1-9a9e-c6eaf81777b4 1G" returned: 0 in 0.827s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-249362ef-ef64-4ef5-be52-5ababc5de477 tempest-CreateVolumesFromSnapshotTest-994771565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04.9e77c37e-b60c-42a1-9a9e-c6eaf81777b4 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e8cc3d5d-c36e-437b-99be-2a711e2a8732_bw5gf4k4" returned: 1 in 0.795s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e8cc3d5d-c36e-437b-99be-2a711e2a8732_bw5gf4k4' failed. Not Retrying. {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 05:20:35 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f27eb3-28e3-482b-a88e-b992f1253f78]: (4, 'raw') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:20:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8cc3d5d-c36e-437b-99be-2a711e2a8732_qa6_r605devstack@QuobyteHD {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:35 devstack sudo[114487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04.9e77c37e-b60c-42a1-9a9e-c6eaf81777b4 Jun 24 05:20:35 devstack sudo[114487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:35 devstack sudo[114478]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5e37630b-044d-44ee-8d22-6d7c71377eb3 tempest-CreateVolumesFromImageTest-388768697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-b0b99bb9-1845-4810-8283-9063cc88e395" returned: 0 in 0.700s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:35 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-5e37630b-044d-44ee-8d22-6d7c71377eb3 tempest-CreateVolumesFromImageTest-388768697 None] Lock "cinder-quobyte-b0b99bb9-1845-4810-8283-9063cc88e395" released by "delete_volume" :: held 1.562s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:20:35 devstack sudo[114488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8cc3d5d-c36e-437b-99be-2a711e2a8732_qa6_r605devstack@QuobyteHD Jun 24 05:20:35 devstack sudo[114488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:35 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-5e37630b-044d-44ee-8d22-6d7c71377eb3 tempest-CreateVolumesFromImageTest-388768697 None] Created reservations ['77d5f733-3583-406c-880a-b7d2dad10cdd', '1480a857-7823-4539-b781-36a84f30bfcb', 'a6af1467-356e-4a86-8787-5d28890397bd', '92f75bc5-95ba-4158-adc9-3a5906a41878'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:20:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5e37630b-044d-44ee-8d22-6d7c71377eb3 tempest-CreateVolumesFromImageTest-388768697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5e37630b-044d-44ee-8d22-6d7c71377eb3 tempest-CreateVolumesFromImageTest-388768697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:35 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-5e37630b-044d-44ee-8d22-6d7c71377eb3 tempest-CreateVolumesFromImageTest-388768697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:20:35 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-5e37630b-044d-44ee-8d22-6d7c71377eb3 tempest-CreateVolumesFromImageTest-388768697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:20:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5e37630b-044d-44ee-8d22-6d7c71377eb3 tempest-CreateVolumesFromImageTest-388768697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:20:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5e37630b-044d-44ee-8d22-6d7c71377eb3 tempest-CreateVolumesFromImageTest-388768697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:35 devstack sudo[114491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:20:35 devstack sudo[114491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:36 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3700c23c-95f5-4006-b953-46d97975e1a8 tempest-CreateVolumesFromImageTest-388768697 None] Acquiring lock "cinder-5a4b4447-25fd-44d5-925e-042ce13b8068-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:20:36 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3700c23c-95f5-4006-b953-46d97975e1a8 tempest-CreateVolumesFromImageTest-388768697 None] Lock "cinder-5a4b4447-25fd-44d5-925e-042ce13b8068-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:20:36 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3700c23c-95f5-4006-b953-46d97975e1a8 tempest-CreateVolumesFromImageTest-388768697 None] Acquiring lock "cinder-quobyte-5a4b4447-25fd-44d5-925e-042ce13b8068" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:20:36 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3700c23c-95f5-4006-b953-46d97975e1a8 tempest-CreateVolumesFromImageTest-388768697 None] Lock "cinder-quobyte-5a4b4447-25fd-44d5-925e-042ce13b8068" acquired by "delete_volume" :: waited 0.023s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:20:36 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee99db21-9233-43fa-acd9-b2681a86e939]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:20:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3700c23c-95f5-4006-b953-46d97975e1a8 tempest-CreateVolumesFromImageTest-388768697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-5a4b4447-25fd-44d5-925e-042ce13b8068 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:36 devstack sudo[114487]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-249362ef-ef64-4ef5-be52-5ababc5de477 tempest-CreateVolumesFromSnapshotTest-994771565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04.9e77c37e-b60c-42a1-9a9e-c6eaf81777b4" returned: 0 in 0.798s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:36 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-249362ef-ef64-4ef5-be52-5ababc5de477 tempest-CreateVolumesFromSnapshotTest-994771565 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04.9e77c37e-b60c-42a1-9a9e-c6eaf81777b4 is being set with open permissions: ugo+rw Jun 24 05:20:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-249362ef-ef64-4ef5-be52-5ababc5de477 tempest-CreateVolumesFromSnapshotTest-994771565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04.9e77c37e-b60c-42a1-9a9e-c6eaf81777b4 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:36 devstack sudo[114500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04.9e77c37e-b60c-42a1-9a9e-c6eaf81777b4 Jun 24 05:20:36 devstack sudo[114500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:36 devstack sudo[114488]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8cc3d5d-c36e-437b-99be-2a711e2a8732_qa6_r605devstack@QuobyteHD" returned: 0 in 0.851s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8cc3d5d-c36e-437b-99be-2a711e2a8732_qa6_r605devstack@QuobyteHD {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:36 devstack sudo[114499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-5a4b4447-25fd-44d5-925e-042ce13b8068 Jun 24 05:20:36 devstack sudo[114499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:36 devstack sudo[114491]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5e37630b-044d-44ee-8d22-6d7c71377eb3 tempest-CreateVolumesFromImageTest-388768697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.749s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:36 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-5e37630b-044d-44ee-8d22-6d7c71377eb3 tempest-CreateVolumesFromImageTest-388768697 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:20:36 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-5e37630b-044d-44ee-8d22-6d7c71377eb3 tempest-CreateVolumesFromImageTest-388768697 None] Deleted volume successfully. Jun 24 05:20:36 devstack sudo[114503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8cc3d5d-c36e-437b-99be-2a711e2a8732_qa6_r605devstack@QuobyteHD Jun 24 05:20:36 devstack sudo[114503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:36 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-5e37630b-044d-44ee-8d22-6d7c71377eb3 tempest-CreateVolumesFromImageTest-388768697 None] Lock "cinder-b0b99bb9-1845-4810-8283-9063cc88e395-delete_volume" released by "delete_volume" :: held 2.587s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:20:36 devstack sudo[114500]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-249362ef-ef64-4ef5-be52-5ababc5de477 tempest-CreateVolumesFromSnapshotTest-994771565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04.9e77c37e-b60c-42a1-9a9e-c6eaf81777b4" returned: 0 in 0.731s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-249362ef-ef64-4ef5-be52-5ababc5de477 tempest-CreateVolumesFromSnapshotTest-994771565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:37 devstack sudo[114499]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3700c23c-95f5-4006-b953-46d97975e1a8 tempest-CreateVolumesFromImageTest-388768697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-5a4b4447-25fd-44d5-925e-042ce13b8068" returned: 0 in 0.813s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3700c23c-95f5-4006-b953-46d97975e1a8 tempest-CreateVolumesFromImageTest-388768697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-5a4b4447-25fd-44d5-925e-042ce13b8068 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:37 devstack sudo[114513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04.info Jun 24 05:20:37 devstack sudo[114513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:37 devstack sudo[114514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-5a4b4447-25fd-44d5-925e-042ce13b8068 Jun 24 05:20:37 devstack sudo[114503]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:37 devstack sudo[114514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8cc3d5d-c36e-437b-99be-2a711e2a8732_qa6_r605devstack@QuobyteHD" returned: 1 in 0.746s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8cc3d5d-c36e-437b-99be-2a711e2a8732_qa6_r605devstack@QuobyteHD' failed. Not Retrying. {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 05:20:37 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] e8cc3d5d-c36e-437b-99be-2a711e2a8732 was raw, converting to raw {{(pid=93830) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 24 05:20:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e8cc3d5d-c36e-437b-99be-2a711e2a8732_qa6_r605devstack@QuobyteHD /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-daade867-d711-4a3c-b1c8-002472fd4d36 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:37 devstack sudo[114517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e8cc3d5d-c36e-437b-99be-2a711e2a8732_qa6_r605devstack@QuobyteHD /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-daade867-d711-4a3c-b1c8-002472fd4d36 Jun 24 05:20:37 devstack sudo[114517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:37 devstack sudo[114513]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-249362ef-ef64-4ef5-be52-5ababc5de477 tempest-CreateVolumesFromSnapshotTest-994771565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04.info" returned: 0 in 0.671s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:37 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-249362ef-ef64-4ef5-be52-5ababc5de477 tempest-CreateVolumesFromSnapshotTest-994771565 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04.info is being set with open permissions: ugo+rw Jun 24 05:20:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-249362ef-ef64-4ef5-be52-5ababc5de477 tempest-CreateVolumesFromSnapshotTest-994771565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:37 devstack sudo[114524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04.info Jun 24 05:20:37 devstack sudo[114524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:37 devstack sudo[114514]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3700c23c-95f5-4006-b953-46d97975e1a8 tempest-CreateVolumesFromImageTest-388768697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-5a4b4447-25fd-44d5-925e-042ce13b8068" returned: 0 in 0.705s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:37 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3700c23c-95f5-4006-b953-46d97975e1a8 tempest-CreateVolumesFromImageTest-388768697 None] Lock "cinder-quobyte-5a4b4447-25fd-44d5-925e-042ce13b8068" released by "delete_volume" :: held 1.568s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:20:37 devstack sudo[114517]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e8cc3d5d-c36e-437b-99be-2a711e2a8732_qa6_r605devstack@QuobyteHD /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-daade867-d711-4a3c-b1c8-002472fd4d36" returned: 0 in 0.752s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:37 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e8cc3d5d-c36e-437b-99be-2a711e2a8732_qa6_r605devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-daade867-d711-4a3c-b1c8-002472fd4d36 {{(pid=93830) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 05:20:37 devstack cinder-volume[93830]: INFO cinder.image.image_utils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Converted 0.00 MB image at 0.00 MB/s Jun 24 05:20:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-daade867-d711-4a3c-b1c8-002472fd4d36 1G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:37 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-3700c23c-95f5-4006-b953-46d97975e1a8 tempest-CreateVolumesFromImageTest-388768697 None] Created reservations ['d130059a-86e0-47af-901a-984989acdc96', '1a28affc-cd08-4238-9b0a-d991fb2b7b8d', '6afc0453-d206-4cfc-a0ec-47e67cc9f80e', '7c924326-4979-4065-80d2-1f58e15a8157'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:20:37 devstack sudo[114526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-daade867-d711-4a3c-b1c8-002472fd4d36 1G Jun 24 05:20:37 devstack sudo[114526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3700c23c-95f5-4006-b953-46d97975e1a8 tempest-CreateVolumesFromImageTest-388768697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3700c23c-95f5-4006-b953-46d97975e1a8 tempest-CreateVolumesFromImageTest-388768697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:37 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-3700c23c-95f5-4006-b953-46d97975e1a8 tempest-CreateVolumesFromImageTest-388768697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:20:37 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-3700c23c-95f5-4006-b953-46d97975e1a8 tempest-CreateVolumesFromImageTest-388768697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:20:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3700c23c-95f5-4006-b953-46d97975e1a8 tempest-CreateVolumesFromImageTest-388768697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:20:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3700c23c-95f5-4006-b953-46d97975e1a8 tempest-CreateVolumesFromImageTest-388768697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:37 devstack sudo[114528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:20:37 devstack sudo[114528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:38 devstack sudo[114524]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-249362ef-ef64-4ef5-be52-5ababc5de477 tempest-CreateVolumesFromSnapshotTest-994771565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04.info" returned: 0 in 0.720s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-249362ef-ef64-4ef5-be52-5ababc5de477 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.713s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:20:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9ef6bc51-1f41-461e-8ad9-d2ddd4e30b4a tempest-CinderUnicodeTest-774697758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.618s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:38 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-0650af9b-07c7-429a-949e-b8dc0d701fc6 tempest-CreateVolumesFromImageTest-388768697 None] Acquiring lock "cinder-7d04f352-cfa5-410e-a1e4-98b591a42245-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:20:38 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-9ef6bc51-1f41-461e-8ad9-d2ddd4e30b4a tempest-CinderUnicodeTest-774697758 None] Creating offline snapshot 15af1ef1-4dee-479a-86c0-24d0acf9c783 of volume c4912260-4d7e-4289-bc3a-4e8c1ef4d238 {{(pid=93830) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 05:20:38 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-0650af9b-07c7-429a-949e-b8dc0d701fc6 tempest-CreateVolumesFromImageTest-388768697 None] Lock "cinder-7d04f352-cfa5-410e-a1e4-98b591a42245-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:20:38 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-249362ef-ef64-4ef5-be52-5ababc5de477 tempest-CreateVolumesFromSnapshotTest-994771565 None] Create snapshot completed successfully Jun 24 05:20:38 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6486d27-2f82-4f05-98c6-69bcd747c56a]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:20:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9ef6bc51-1f41-461e-8ad9-d2ddd4e30b4a tempest-CinderUnicodeTest-774697758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:38 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-0650af9b-07c7-429a-949e-b8dc0d701fc6 tempest-CreateVolumesFromImageTest-388768697 None] Acquiring lock "cinder-quobyte-7d04f352-cfa5-410e-a1e4-98b591a42245" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:20:38 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-0650af9b-07c7-429a-949e-b8dc0d701fc6 tempest-CreateVolumesFromImageTest-388768697 None] Lock "cinder-quobyte-7d04f352-cfa5-410e-a1e4-98b591a42245" acquired by "delete_volume" :: waited 0.022s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:20:38 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab7f3f8-1036-417d-b99b-e722ebef199c]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:20:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0650af9b-07c7-429a-949e-b8dc0d701fc6 tempest-CreateVolumesFromImageTest-388768697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7d04f352-cfa5-410e-a1e4-98b591a42245 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:38 devstack sudo[114567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238 Jun 24 05:20:38 devstack sudo[114567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:38 devstack sudo[114528]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3700c23c-95f5-4006-b953-46d97975e1a8 tempest-CreateVolumesFromImageTest-388768697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.811s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:38 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-3700c23c-95f5-4006-b953-46d97975e1a8 tempest-CreateVolumesFromImageTest-388768697 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:20:38 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-3700c23c-95f5-4006-b953-46d97975e1a8 tempest-CreateVolumesFromImageTest-388768697 None] Deleted volume successfully. Jun 24 05:20:38 devstack sudo[114526]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:38 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3700c23c-95f5-4006-b953-46d97975e1a8 tempest-CreateVolumesFromImageTest-388768697 None] Lock "cinder-5a4b4447-25fd-44d5-925e-042ce13b8068-delete_volume" released by "delete_volume" :: held 2.669s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:20:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-daade867-d711-4a3c-b1c8-002472fd4d36 1G" returned: 0 in 0.960s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:38 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[21aef254-3ec2-4b1e-a2e3-171aeaba21ec]: (4, 'raw') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:20:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-daade867-d711-4a3c-b1c8-002472fd4d36 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:38 devstack sudo[114571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7d04f352-cfa5-410e-a1e4-98b591a42245 Jun 24 05:20:38 devstack sudo[114571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:38 devstack sudo[114575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-daade867-d711-4a3c-b1c8-002472fd4d36 Jun 24 05:20:38 devstack sudo[114575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:39 devstack sudo[114567]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9ef6bc51-1f41-461e-8ad9-d2ddd4e30b4a tempest-CinderUnicodeTest-774697758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238" returned: 0 in 0.864s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9ef6bc51-1f41-461e-8ad9-d2ddd4e30b4a tempest-CinderUnicodeTest-774697758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238.15af1ef1-4dee-479a-86c0-24d0acf9c783 1G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:39 devstack sudo[114583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238.15af1ef1-4dee-479a-86c0-24d0acf9c783 1G Jun 24 05:20:39 devstack sudo[114583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:39 devstack sudo[114571]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0650af9b-07c7-429a-949e-b8dc0d701fc6 tempest-CreateVolumesFromImageTest-388768697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7d04f352-cfa5-410e-a1e4-98b591a42245" returned: 0 in 0.936s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0650af9b-07c7-429a-949e-b8dc0d701fc6 tempest-CreateVolumesFromImageTest-388768697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7d04f352-cfa5-410e-a1e4-98b591a42245 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:39 devstack sudo[114589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7d04f352-cfa5-410e-a1e4-98b591a42245 Jun 24 05:20:39 devstack sudo[114589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:39 devstack sudo[114575]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-daade867-d711-4a3c-b1c8-002472fd4d36" returned: 0 in 0.916s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-daade867-d711-4a3c-b1c8-002472fd4d36 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:39 devstack sudo[114591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-daade867-d711-4a3c-b1c8-002472fd4d36 Jun 24 05:20:39 devstack sudo[114591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:40 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e9ee30f-76ce-4b56-9fde-929ca8e5a3a3 tempest-CreateVolumesFromSnapshotTest-994771565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:20:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7e9ee30f-76ce-4b56-9fde-929ca8e5a3a3 tempest-CreateVolumesFromSnapshotTest-994771565 None] Flow 'volume_create_manager' (eb3f10ea-4e78-4011-804a-4487fc2210e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:20:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7e9ee30f-76ce-4b56-9fde-929ca8e5a3a3 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be726b4d-1de0-47d0-b578-e5974562c643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7e9ee30f-76ce-4b56-9fde-929ca8e5a3a3 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be726b4d-1de0-47d0-b578-e5974562c643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1552435931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c60c6f5b-7164-42d2-b7fa-b657860dc08c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61da3d7d6c694af0a37056f29b182683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:20:40Z,use_quota=True,user_id='0c87690e00cc4ca39cd726cd49849dd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7e9ee30f-76ce-4b56-9fde-929ca8e5a3a3 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb1ec4b8-2dbf-4387-ad27-7460d642662f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7e9ee30f-76ce-4b56-9fde-929ca8e5a3a3 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb1ec4b8-2dbf-4387-ad27-7460d642662f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7e9ee30f-76ce-4b56-9fde-929ca8e5a3a3 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95db7946-4ce2-463c-8326-2c3df91f7ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7e9ee30f-76ce-4b56-9fde-929ca8e5a3a3 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95db7946-4ce2-463c-8326-2c3df91f7ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c60c6f5b-7164-42d2-b7fa-b657860dc08c', 'volume_name': 'volume-c60c6f5b-7164-42d2-b7fa-b657860dc08c', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7e9ee30f-76ce-4b56-9fde-929ca8e5a3a3 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (742103ac-42aa-48b4-a171-6b03fce825af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7e9ee30f-76ce-4b56-9fde-929ca8e5a3a3 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (742103ac-42aa-48b4-a171-6b03fce825af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7e9ee30f-76ce-4b56-9fde-929ca8e5a3a3 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fce72850-ddd5-484c-9aa6-52707b42347b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:40 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-7e9ee30f-76ce-4b56-9fde-929ca8e5a3a3 tempest-CreateVolumesFromSnapshotTest-994771565 None] Volume c60c6f5b-7164-42d2-b7fa-b657860dc08c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c60c6f5b-7164-42d2-b7fa-b657860dc08c', 'volume_size': 1} Jun 24 05:20:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7e9ee30f-76ce-4b56-9fde-929ca8e5a3a3 tempest-CreateVolumesFromSnapshotTest-994771565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:40 devstack sudo[114583]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9ef6bc51-1f41-461e-8ad9-d2ddd4e30b4a tempest-CinderUnicodeTest-774697758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238.15af1ef1-4dee-479a-86c0-24d0acf9c783 1G" returned: 0 in 1.111s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9ef6bc51-1f41-461e-8ad9-d2ddd4e30b4a tempest-CinderUnicodeTest-774697758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238.15af1ef1-4dee-479a-86c0-24d0acf9c783 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:40 devstack sudo[114598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238.15af1ef1-4dee-479a-86c0-24d0acf9c783 Jun 24 05:20:40 devstack sudo[114598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:40 devstack sudo[114589]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0650af9b-07c7-429a-949e-b8dc0d701fc6 tempest-CreateVolumesFromImageTest-388768697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-7d04f352-cfa5-410e-a1e4-98b591a42245" returned: 0 in 0.989s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:40 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-0650af9b-07c7-429a-949e-b8dc0d701fc6 tempest-CreateVolumesFromImageTest-388768697 None] Lock "cinder-quobyte-7d04f352-cfa5-410e-a1e4-98b591a42245" released by "delete_volume" :: held 1.984s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:20:40 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-d82805cd-3f98-4530-8a73-c7f076fdfba2 tempest-CreateVolumesFromSnapshotTest-994771565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:20:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d82805cd-3f98-4530-8a73-c7f076fdfba2 tempest-CreateVolumesFromSnapshotTest-994771565 None] Flow 'volume_create_manager' (05274fa4-f9a7-479f-a2f6-c07a7603884b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:20:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d82805cd-3f98-4530-8a73-c7f076fdfba2 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e67d81c-09cd-4bf6-8284-d25e4de0b2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:40 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-0650af9b-07c7-429a-949e-b8dc0d701fc6 tempest-CreateVolumesFromImageTest-388768697 None] Created reservations ['fbebc97c-b9d0-433a-9095-951696bd8104', '70766c8e-85aa-4a9f-98fe-3bf689e52e30', '7ddbb4ef-5370-4ae0-816e-7e0f29b7961f', '0142ecb4-2544-455c-bc5e-a646a2c63451'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:20:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d82805cd-3f98-4530-8a73-c7f076fdfba2 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e67d81c-09cd-4bf6-8284-d25e4de0b2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1838168442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c7b9a34-743d-4f97-ab81-cc5c2d57cdec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61da3d7d6c694af0a37056f29b182683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:20:41Z,use_quota=True,user_id='0c87690e00cc4ca39cd726cd49849dd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d82805cd-3f98-4530-8a73-c7f076fdfba2 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db006367-a95e-4d87-b245-c9bca46ba93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d82805cd-3f98-4530-8a73-c7f076fdfba2 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db006367-a95e-4d87-b245-c9bca46ba93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d82805cd-3f98-4530-8a73-c7f076fdfba2 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d70b96e-ba03-430f-8d59-26699109c482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d82805cd-3f98-4530-8a73-c7f076fdfba2 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d70b96e-ba03-430f-8d59-26699109c482) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c7b9a34-743d-4f97-ab81-cc5c2d57cdec', 'volume_name': 'volume-9c7b9a34-743d-4f97-ab81-cc5c2d57cdec', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d82805cd-3f98-4530-8a73-c7f076fdfba2 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6384f69a-9147-4a71-8e16-b3495484477f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d82805cd-3f98-4530-8a73-c7f076fdfba2 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6384f69a-9147-4a71-8e16-b3495484477f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d82805cd-3f98-4530-8a73-c7f076fdfba2 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (427a7453-61bd-4795-8673-d9872ce6a288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:40 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-d82805cd-3f98-4530-8a73-c7f076fdfba2 tempest-CreateVolumesFromSnapshotTest-994771565 None] Volume 9c7b9a34-743d-4f97-ab81-cc5c2d57cdec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c7b9a34-743d-4f97-ab81-cc5c2d57cdec', 'volume_size': 1} Jun 24 05:20:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-d82805cd-3f98-4530-8a73-c7f076fdfba2 tempest-CreateVolumesFromSnapshotTest-994771565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:40 devstack sudo[114591]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-daade867-d711-4a3c-b1c8-002472fd4d36" returned: 1 in 1.165s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-daade867-d711-4a3c-b1c8-002472fd4d36' failed. Not Retrying. {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 05:20:40 devstack cinder-volume[93830]: DEBUG cinder.volume.volume_utils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Downloaded image e8cc3d5d-c36e-437b-99be-2a711e2a8732 ((None, [{'url': 'file:///opt/stack/data/glance/images/e8cc3d5d-c36e-437b-99be-2a711e2a8732', 'metadata': {}}])) to volume daade867-d711-4a3c-b1c8-002472fd4d36 successfully. {{(pid=93830) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 24 05:20:40 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Temporary image e8cc3d5d-c36e-437b-99be-2a711e2a8732 for user 2e48d9cafa2d4bd08896402094ca2bd9 is deleted. {{(pid=93830) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 24 05:20:40 devstack cinder-volume[93830]: DEBUG cinder.volume.volume_utils [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Marking volume daade867-d711-4a3c-b1c8-002472fd4d36 as bootable. {{(pid=93830) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 24 05:20:40 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Copying metadata from image e8cc3d5d-c36e-437b-99be-2a711e2a8732 to daade867-d711-4a3c-b1c8-002472fd4d36. {{(pid=93830) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 24 05:20:40 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Creating volume glance metadata for volume daade867-d711-4a3c-b1c8-002472fd4d36 backed by image e8cc3d5d-c36e-437b-99be-2a711e2a8732 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'e8cc3d5d-c36e-437b-99be-2a711e2a8732', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'd218f9f876a5700bc142e1ea3eba6826', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93830) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 24 05:20:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-0650af9b-07c7-429a-949e-b8dc0d701fc6 tempest-CreateVolumesFromImageTest-388768697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-0650af9b-07c7-429a-949e-b8dc0d701fc6 tempest-CreateVolumesFromImageTest-388768697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:41 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-0650af9b-07c7-429a-949e-b8dc0d701fc6 tempest-CreateVolumesFromImageTest-388768697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:20:41 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-0650af9b-07c7-429a-949e-b8dc0d701fc6 tempest-CreateVolumesFromImageTest-388768697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:20:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-0650af9b-07c7-429a-949e-b8dc0d701fc6 tempest-CreateVolumesFromImageTest-388768697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:20:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0650af9b-07c7-429a-949e-b8dc0d701fc6 tempest-CreateVolumesFromImageTest-388768697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ad73864-17e9-45fc-875a-25d73a286c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daade867-d711-4a3c-b1c8-002472fd4d36', 'volume_size': 1, 'image_id': 'e8cc3d5d-c36e-437b-99be-2a711e2a8732', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e8cc3d5d-c36e-437b-99be-2a711e2a8732', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd218f9f876a5700bc142e1ea3eba6826', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6445b3bfd9374cdd8009f1bf294379c1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0ae3477ae4ba4853dd5f0012e0bad94db1c8d36fe474c25759b2226d8868dcb37d8ec6c1c6058d9be7d67c58ce972ba5da97a349bffe2066cf3a08056b7ac19c', 'id': 'e8cc3d5d-c36e-437b-99be-2a711e2a8732', 'created_at': datetime.datetime(2026, 6, 24, 3, 20, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 3, 20, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e8cc3d5d-c36e-437b-99be-2a711e2a8732/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f2a2894-08ac-430d-87cb-6620a050fb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:41 devstack sudo[114604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:20:41 devstack sudo[114604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:41 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Volume volume-daade867-d711-4a3c-b1c8-002472fd4d36 (daade867-d711-4a3c-b1c8-002472fd4d36): created successfully Jun 24 05:20:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f2a2894-08ac-430d-87cb-6620a050fb8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Flow 'volume_create_manager' (b4cb9f3c-f10d-4be6-a6c9-2810ab36caa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:20:41 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-dba7e5dd-5889-489c-bda9-924e0b1a8598 tempest-CreateVolumesFromSnapshotTest-994771565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:20:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-dba7e5dd-5889-489c-bda9-924e0b1a8598 tempest-CreateVolumesFromSnapshotTest-994771565 None] Flow 'volume_create_manager' (0fe11547-7dcc-4746-96af-e8960099b0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:20:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-dba7e5dd-5889-489c-bda9-924e0b1a8598 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e57793c6-e746-4ddf-ae87-48d527c4f679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:41 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-5fded44e-a561-4ec1-b8a2-1cb3480bf25d tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Created volume successfully. Jun 24 05:20:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-dba7e5dd-5889-489c-bda9-924e0b1a8598 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e57793c6-e746-4ddf-ae87-48d527c4f679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1214785314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07e6b3c7-5f3c-436f-b55d-3903abe1d7aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61da3d7d6c694af0a37056f29b182683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:20:41Z,use_quota=True,user_id='0c87690e00cc4ca39cd726cd49849dd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-dba7e5dd-5889-489c-bda9-924e0b1a8598 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (181e487b-4987-4924-a681-bef58f988ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-dba7e5dd-5889-489c-bda9-924e0b1a8598 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (181e487b-4987-4924-a681-bef58f988ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-dba7e5dd-5889-489c-bda9-924e0b1a8598 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbf1f3a8-e407-4c37-a8a7-e3932516ef6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-dba7e5dd-5889-489c-bda9-924e0b1a8598 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbf1f3a8-e407-4c37-a8a7-e3932516ef6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07e6b3c7-5f3c-436f-b55d-3903abe1d7aa', 'volume_name': 'volume-07e6b3c7-5f3c-436f-b55d-3903abe1d7aa', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-dba7e5dd-5889-489c-bda9-924e0b1a8598 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03f50b79-0ded-444b-aae9-a437758beb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-dba7e5dd-5889-489c-bda9-924e0b1a8598 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03f50b79-0ded-444b-aae9-a437758beb64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-dba7e5dd-5889-489c-bda9-924e0b1a8598 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63982f23-2bc6-41be-8212-6ebd1a149f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:41 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-dba7e5dd-5889-489c-bda9-924e0b1a8598 tempest-CreateVolumesFromSnapshotTest-994771565 None] Volume 07e6b3c7-5f3c-436f-b55d-3903abe1d7aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07e6b3c7-5f3c-436f-b55d-3903abe1d7aa', 'volume_size': 1} Jun 24 05:20:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-dba7e5dd-5889-489c-bda9-924e0b1a8598 tempest-CreateVolumesFromSnapshotTest-994771565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:41 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-d1bcd590-146a-46e7-ac25-a31de643cdb3 tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Acquiring lock "cinder-daade867-d711-4a3c-b1c8-002472fd4d36-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:20:41 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-d1bcd590-146a-46e7-ac25-a31de643cdb3 tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Lock "cinder-daade867-d711-4a3c-b1c8-002472fd4d36-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:20:41 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-d1bcd590-146a-46e7-ac25-a31de643cdb3 tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Acquiring lock "cinder-quobyte-daade867-d711-4a3c-b1c8-002472fd4d36" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:20:41 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-d1bcd590-146a-46e7-ac25-a31de643cdb3 tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Lock "cinder-quobyte-daade867-d711-4a3c-b1c8-002472fd4d36" acquired by "delete_volume" :: waited 0.020s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:20:41 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d81ff8c-e4e2-4494-ab79-07ac682af817]: (4, 'raw') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:20:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d1bcd590-146a-46e7-ac25-a31de643cdb3 tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-daade867-d711-4a3c-b1c8-002472fd4d36 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:41 devstack sudo[114609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-daade867-d711-4a3c-b1c8-002472fd4d36 Jun 24 05:20:41 devstack sudo[114609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:41 devstack sudo[114598]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9ef6bc51-1f41-461e-8ad9-d2ddd4e30b4a tempest-CinderUnicodeTest-774697758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238 -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238.15af1ef1-4dee-479a-86c0-24d0acf9c783" returned: 0 in 1.229s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:41 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-9ef6bc51-1f41-461e-8ad9-d2ddd4e30b4a tempest-CinderUnicodeTest-774697758 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238.15af1ef1-4dee-479a-86c0-24d0acf9c783 is being set with open permissions: ugo+rw Jun 24 05:20:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9ef6bc51-1f41-461e-8ad9-d2ddd4e30b4a tempest-CinderUnicodeTest-774697758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238.15af1ef1-4dee-479a-86c0-24d0acf9c783 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:41 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bb75f58-e790-43e6-acd6-2ab6b1f97c33 tempest-CreateVolumesFromSnapshotTest-994771565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:20:41 devstack sudo[114611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238.15af1ef1-4dee-479a-86c0-24d0acf9c783 Jun 24 05:20:41 devstack sudo[114611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3bb75f58-e790-43e6-acd6-2ab6b1f97c33 tempest-CreateVolumesFromSnapshotTest-994771565 None] Flow 'volume_create_manager' (37d6cf53-d9d5-4b4d-be7f-cd8d7b5886cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:20:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3bb75f58-e790-43e6-acd6-2ab6b1f97c33 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a81c112d-833e-4029-9375-65d9f386f961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3bb75f58-e790-43e6-acd6-2ab6b1f97c33 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a81c112d-833e-4029-9375-65d9f386f961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-395440910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b53db94-9ad6-4463-99fa-ba38744bd513,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61da3d7d6c694af0a37056f29b182683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:20:42Z,use_quota=True,user_id='0c87690e00cc4ca39cd726cd49849dd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3bb75f58-e790-43e6-acd6-2ab6b1f97c33 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (423d2e82-fdea-4682-b7c7-c96c67541aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3bb75f58-e790-43e6-acd6-2ab6b1f97c33 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (423d2e82-fdea-4682-b7c7-c96c67541aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3bb75f58-e790-43e6-acd6-2ab6b1f97c33 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c96a96dc-974c-4e61-ab90-403973380ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3bb75f58-e790-43e6-acd6-2ab6b1f97c33 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c96a96dc-974c-4e61-ab90-403973380ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b53db94-9ad6-4463-99fa-ba38744bd513', 'volume_name': 'volume-3b53db94-9ad6-4463-99fa-ba38744bd513', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3bb75f58-e790-43e6-acd6-2ab6b1f97c33 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7620e32a-2cf6-44c2-9964-1d095e4ab7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3bb75f58-e790-43e6-acd6-2ab6b1f97c33 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7620e32a-2cf6-44c2-9964-1d095e4ab7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:41 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3bb75f58-e790-43e6-acd6-2ab6b1f97c33 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95b8e8f9-a1f7-41fe-b09d-25b4e0066543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:41 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-3bb75f58-e790-43e6-acd6-2ab6b1f97c33 tempest-CreateVolumesFromSnapshotTest-994771565 None] Volume 3b53db94-9ad6-4463-99fa-ba38744bd513: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b53db94-9ad6-4463-99fa-ba38744bd513', 'volume_size': 1} Jun 24 05:20:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3bb75f58-e790-43e6-acd6-2ab6b1f97c33 tempest-CreateVolumesFromSnapshotTest-994771565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:41 devstack sudo[114604]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:41 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a778f496-5f9a-4585-8a29-c34e95b435bb tempest-CreateVolumesFromImageTest-388768697 None] Acquiring lock "cinder-33df1e7f-628b-4d04-8572-e1c8164c6d07-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:20:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-0650af9b-07c7-429a-949e-b8dc0d701fc6 tempest-CreateVolumesFromImageTest-388768697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.961s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:41 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-0650af9b-07c7-429a-949e-b8dc0d701fc6 tempest-CreateVolumesFromImageTest-388768697 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:20:42 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-0650af9b-07c7-429a-949e-b8dc0d701fc6 tempest-CreateVolumesFromImageTest-388768697 None] Deleted volume successfully. Jun 24 05:20:42 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a778f496-5f9a-4585-8a29-c34e95b435bb tempest-CreateVolumesFromImageTest-388768697 None] Lock "cinder-33df1e7f-628b-4d04-8572-e1c8164c6d07-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:20:42 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-0650af9b-07c7-429a-949e-b8dc0d701fc6 tempest-CreateVolumesFromImageTest-388768697 None] Lock "cinder-7d04f352-cfa5-410e-a1e4-98b591a42245-delete_volume" released by "delete_volume" :: held 3.534s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:20:42 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a778f496-5f9a-4585-8a29-c34e95b435bb tempest-CreateVolumesFromImageTest-388768697 None] Acquiring lock "cinder-quobyte-33df1e7f-628b-4d04-8572-e1c8164c6d07" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:20:42 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a778f496-5f9a-4585-8a29-c34e95b435bb tempest-CreateVolumesFromImageTest-388768697 None] Lock "cinder-quobyte-33df1e7f-628b-4d04-8572-e1c8164c6d07" acquired by "delete_volume" :: waited 0.016s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:20:42 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f692d7-a5c1-446e-ba5b-8cc3b773f632]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:20:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a778f496-5f9a-4585-8a29-c34e95b435bb tempest-CreateVolumesFromImageTest-388768697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-33df1e7f-628b-4d04-8572-e1c8164c6d07 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:42 devstack sudo[114614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-33df1e7f-628b-4d04-8572-e1c8164c6d07 Jun 24 05:20:42 devstack sudo[114614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:42 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ccd6bc3-51c6-4787-ac05-d5d14197d213 tempest-CreateVolumesFromSnapshotTest-994771565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:20:42 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3ccd6bc3-51c6-4787-ac05-d5d14197d213 tempest-CreateVolumesFromSnapshotTest-994771565 None] Flow 'volume_create_manager' (bd25a86b-e8f7-44c3-a2ae-b7e942c92986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:20:42 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3ccd6bc3-51c6-4787-ac05-d5d14197d213 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b885ce7-d7ed-433f-bb64-f617072b1b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:42 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3ccd6bc3-51c6-4787-ac05-d5d14197d213 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b885ce7-d7ed-433f-bb64-f617072b1b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-125073190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=859b0a9b-dc33-4780-a776-f00e805a9279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61da3d7d6c694af0a37056f29b182683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:20:42Z,use_quota=True,user_id='0c87690e00cc4ca39cd726cd49849dd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:42 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3ccd6bc3-51c6-4787-ac05-d5d14197d213 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de620792-c9d9-481d-ae47-09db9787f41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:42 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3ccd6bc3-51c6-4787-ac05-d5d14197d213 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de620792-c9d9-481d-ae47-09db9787f41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:42 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3ccd6bc3-51c6-4787-ac05-d5d14197d213 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c97a645-94ab-418d-9823-5c138e3bbc82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:42 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3ccd6bc3-51c6-4787-ac05-d5d14197d213 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c97a645-94ab-418d-9823-5c138e3bbc82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '859b0a9b-dc33-4780-a776-f00e805a9279', 'volume_name': 'volume-859b0a9b-dc33-4780-a776-f00e805a9279', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:42 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3ccd6bc3-51c6-4787-ac05-d5d14197d213 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75105ad7-e711-4eea-af2a-bf84684dd636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:42 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3ccd6bc3-51c6-4787-ac05-d5d14197d213 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75105ad7-e711-4eea-af2a-bf84684dd636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:42 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3ccd6bc3-51c6-4787-ac05-d5d14197d213 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e25dd69a-3147-4707-b07e-b3378ced0fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:42 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-3ccd6bc3-51c6-4787-ac05-d5d14197d213 tempest-CreateVolumesFromSnapshotTest-994771565 None] Volume 859b0a9b-dc33-4780-a776-f00e805a9279: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-859b0a9b-dc33-4780-a776-f00e805a9279', 'volume_size': 1} Jun 24 05:20:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3ccd6bc3-51c6-4787-ac05-d5d14197d213 tempest-CreateVolumesFromSnapshotTest-994771565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:42 devstack sudo[114611]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9ef6bc51-1f41-461e-8ad9-d2ddd4e30b4a tempest-CinderUnicodeTest-774697758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238.15af1ef1-4dee-479a-86c0-24d0acf9c783" returned: 0 in 0.891s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:42 devstack sudo[114609]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d1bcd590-146a-46e7-ac25-a31de643cdb3 tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-daade867-d711-4a3c-b1c8-002472fd4d36" returned: 0 in 1.183s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d1bcd590-146a-46e7-ac25-a31de643cdb3 tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-daade867-d711-4a3c-b1c8-002472fd4d36 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9ef6bc51-1f41-461e-8ad9-d2ddd4e30b4a tempest-CinderUnicodeTest-774697758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:42 devstack sudo[114620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238.info Jun 24 05:20:42 devstack sudo[114620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:42 devstack sudo[114619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-daade867-d711-4a3c-b1c8-002472fd4d36 Jun 24 05:20:42 devstack sudo[114619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:42 devstack sudo[114614]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a778f496-5f9a-4585-8a29-c34e95b435bb tempest-CreateVolumesFromImageTest-388768697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-33df1e7f-628b-4d04-8572-e1c8164c6d07" returned: 0 in 0.845s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a778f496-5f9a-4585-8a29-c34e95b435bb tempest-CreateVolumesFromImageTest-388768697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-33df1e7f-628b-4d04-8572-e1c8164c6d07 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:43 devstack sudo[114626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-33df1e7f-628b-4d04-8572-e1c8164c6d07 Jun 24 05:20:43 devstack sudo[114626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:43 devstack sudo[114620]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9ef6bc51-1f41-461e-8ad9-d2ddd4e30b4a tempest-CinderUnicodeTest-774697758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238.info" returned: 0 in 0.664s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:43 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-9ef6bc51-1f41-461e-8ad9-d2ddd4e30b4a tempest-CinderUnicodeTest-774697758 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238.info is being set with open permissions: ugo+rw Jun 24 05:20:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9ef6bc51-1f41-461e-8ad9-d2ddd4e30b4a tempest-CinderUnicodeTest-774697758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:43 devstack sudo[114632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238.info Jun 24 05:20:43 devstack sudo[114632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:43 devstack sudo[114619]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d1bcd590-146a-46e7-ac25-a31de643cdb3 tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-daade867-d711-4a3c-b1c8-002472fd4d36" returned: 1 in 0.861s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d1bcd590-146a-46e7-ac25-a31de643cdb3 tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-daade867-d711-4a3c-b1c8-002472fd4d36' failed. Not Retrying. {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 05:20:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d1bcd590-146a-46e7-ac25-a31de643cdb3 tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-daade867-d711-4a3c-b1c8-002472fd4d36 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:43 devstack sudo[114634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-daade867-d711-4a3c-b1c8-002472fd4d36 Jun 24 05:20:43 devstack sudo[114634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:43 devstack sudo[114626]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a778f496-5f9a-4585-8a29-c34e95b435bb tempest-CreateVolumesFromImageTest-388768697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-33df1e7f-628b-4d04-8572-e1c8164c6d07" returned: 0 in 0.718s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:43 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a778f496-5f9a-4585-8a29-c34e95b435bb tempest-CreateVolumesFromImageTest-388768697 None] Lock "cinder-quobyte-33df1e7f-628b-4d04-8572-e1c8164c6d07" released by "delete_volume" :: held 1.624s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:20:43 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-a778f496-5f9a-4585-8a29-c34e95b435bb tempest-CreateVolumesFromImageTest-388768697 None] Created reservations ['5df78762-c88c-4172-acb2-a2fb9cb8c54d', 'a576e4a4-4212-448a-a1bf-9a324acae14f', 'ec87fff1-2bc3-4a71-9f43-74f8cddf7a33', '106ee78b-a7c7-40a7-a9b1-32399374540a'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:20:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a778f496-5f9a-4585-8a29-c34e95b435bb tempest-CreateVolumesFromImageTest-388768697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a778f496-5f9a-4585-8a29-c34e95b435bb tempest-CreateVolumesFromImageTest-388768697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:43 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a778f496-5f9a-4585-8a29-c34e95b435bb tempest-CreateVolumesFromImageTest-388768697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:20:43 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a778f496-5f9a-4585-8a29-c34e95b435bb tempest-CreateVolumesFromImageTest-388768697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:20:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a778f496-5f9a-4585-8a29-c34e95b435bb tempest-CreateVolumesFromImageTest-388768697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:20:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a778f496-5f9a-4585-8a29-c34e95b435bb tempest-CreateVolumesFromImageTest-388768697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:43 devstack sudo[114637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:20:43 devstack sudo[114637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:44 devstack sudo[114632]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9ef6bc51-1f41-461e-8ad9-d2ddd4e30b4a tempest-CinderUnicodeTest-774697758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238.info" returned: 0 in 0.675s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9ef6bc51-1f41-461e-8ad9-d2ddd4e30b4a tempest-CinderUnicodeTest-774697758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.627s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:20:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7e9ee30f-76ce-4b56-9fde-929ca8e5a3a3 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.698s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:44 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7e9ee30f-76ce-4b56-9fde-929ca8e5a3a3 tempest-CreateVolumesFromSnapshotTest-994771565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1552435931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c60c6f5b-7164-42d2-b7fa-b657860dc08c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61da3d7d6c694af0a37056f29b182683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:20:40Z,use_quota=True,user_id='0c87690e00cc4ca39cd726cd49849dd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:20:44 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-7e9ee30f-76ce-4b56-9fde-929ca8e5a3a3 tempest-CreateVolumesFromSnapshotTest-994771565 None] Creating volume c60c6f5b-7164-42d2-b7fa-b657860dc08c {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:20:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7e9ee30f-76ce-4b56-9fde-929ca8e5a3a3 tempest-CreateVolumesFromSnapshotTest-994771565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7e9ee30f-76ce-4b56-9fde-929ca8e5a3a3 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:44 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7e9ee30f-76ce-4b56-9fde-929ca8e5a3a3 tempest-CreateVolumesFromSnapshotTest-994771565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:20:44 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7e9ee30f-76ce-4b56-9fde-929ca8e5a3a3 tempest-CreateVolumesFromSnapshotTest-994771565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:20:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7e9ee30f-76ce-4b56-9fde-929ca8e5a3a3 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:20:44 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7e9ee30f-76ce-4b56-9fde-929ca8e5a3a3 tempest-CreateVolumesFromSnapshotTest-994771565 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:20:44 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-7e9ee30f-76ce-4b56-9fde-929ca8e5a3a3 tempest-CreateVolumesFromSnapshotTest-994771565 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:20:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7e9ee30f-76ce-4b56-9fde-929ca8e5a3a3 tempest-CreateVolumesFromSnapshotTest-994771565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c60c6f5b-7164-42d2-b7fa-b657860dc08c 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:44 devstack sudo[114640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c60c6f5b-7164-42d2-b7fa-b657860dc08c 1073741824 Jun 24 05:20:44 devstack sudo[114640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:44 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-9ef6bc51-1f41-461e-8ad9-d2ddd4e30b4a tempest-CinderUnicodeTest-774697758 None] Create snapshot completed successfully Jun 24 05:20:44 devstack sudo[114634]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d1bcd590-146a-46e7-ac25-a31de643cdb3 tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-daade867-d711-4a3c-b1c8-002472fd4d36" returned: 0 in 0.743s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:44 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-d1bcd590-146a-46e7-ac25-a31de643cdb3 tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Lock "cinder-quobyte-daade867-d711-4a3c-b1c8-002472fd4d36" released by "delete_volume" :: held 2.885s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:20:44 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-d1bcd590-146a-46e7-ac25-a31de643cdb3 tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Created reservations ['cf844355-1177-4982-9fb0-eb18c211d56d', '3c25b2b0-b4a2-4831-8513-2f8903e57474', '58e60441-bd97-4905-9172-d1654501ad17', 'e0830e5a-930c-4dff-8956-458a813ed77b'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:20:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-d1bcd590-146a-46e7-ac25-a31de643cdb3 tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-d1bcd590-146a-46e7-ac25-a31de643cdb3 tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:44 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-d1bcd590-146a-46e7-ac25-a31de643cdb3 tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:20:44 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-d1bcd590-146a-46e7-ac25-a31de643cdb3 tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:20:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-d1bcd590-146a-46e7-ac25-a31de643cdb3 tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:20:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d1bcd590-146a-46e7-ac25-a31de643cdb3 tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:44 devstack sudo[114644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:20:44 devstack sudo[114644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:44 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-69b79cbd-eddc-4f18-acbe-5c28bbe86000 tempest-CinderUnicodeTest-774697758 None] Acquiring lock "cinder-15af1ef1-4dee-479a-86c0-24d0acf9c783-delete_snapshot" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:20:44 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-69b79cbd-eddc-4f18-acbe-5c28bbe86000 tempest-CinderUnicodeTest-774697758 None] Lock "cinder-15af1ef1-4dee-479a-86c0-24d0acf9c783-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:20:44 devstack sudo[114637]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:44 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-69b79cbd-eddc-4f18-acbe-5c28bbe86000 tempest-CinderUnicodeTest-774697758 None] Acquiring lock "cinder-quobyte-c4912260-4d7e-4289-bc3a-4e8c1ef4d238" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:20:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a778f496-5f9a-4585-8a29-c34e95b435bb tempest-CreateVolumesFromImageTest-388768697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.819s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:44 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-a778f496-5f9a-4585-8a29-c34e95b435bb tempest-CreateVolumesFromImageTest-388768697 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:20:44 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-a778f496-5f9a-4585-8a29-c34e95b435bb tempest-CreateVolumesFromImageTest-388768697 None] Deleted volume successfully. Jun 24 05:20:44 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-69b79cbd-eddc-4f18-acbe-5c28bbe86000 tempest-CinderUnicodeTest-774697758 None] Lock "cinder-quobyte-c4912260-4d7e-4289-bc3a-4e8c1ef4d238" acquired by "delete_snapshot" :: waited 0.051s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:20:44 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-69b79cbd-eddc-4f18-acbe-5c28bbe86000 tempest-CinderUnicodeTest-774697758 None] Acquiring lock "cinder-quobyte-15af1ef1-4dee-479a-86c0-24d0acf9c783" by "_delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:20:44 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-69b79cbd-eddc-4f18-acbe-5c28bbe86000 tempest-CinderUnicodeTest-774697758 None] Lock "cinder-quobyte-15af1ef1-4dee-479a-86c0-24d0acf9c783" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:20:44 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-69b79cbd-eddc-4f18-acbe-5c28bbe86000 tempest-CinderUnicodeTest-774697758 None] Deleting offline snapshot 15af1ef1-4dee-479a-86c0-24d0acf9c783 of volume c4912260-4d7e-4289-bc3a-4e8c1ef4d238 {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 05:20:44 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-69b79cbd-eddc-4f18-acbe-5c28bbe86000 tempest-CinderUnicodeTest-774697758 None] snapshot_file for this snap is: volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238.15af1ef1-4dee-479a-86c0-24d0acf9c783 {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 05:20:44 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a778f496-5f9a-4585-8a29-c34e95b435bb tempest-CreateVolumesFromImageTest-388768697 None] Lock "cinder-33df1e7f-628b-4d04-8572-e1c8164c6d07-delete_volume" released by "delete_volume" :: held 2.776s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:20:44 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa996ff-9c63-447e-aa8b-4a03e21030dd]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:20:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-69b79cbd-eddc-4f18-acbe-5c28bbe86000 tempest-CinderUnicodeTest-774697758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238.15af1ef1-4dee-479a-86c0-24d0acf9c783 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:44 devstack sudo[114646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238.15af1ef1-4dee-479a-86c0-24d0acf9c783 Jun 24 05:20:44 devstack sudo[114646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:45 devstack sudo[114640]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7e9ee30f-76ce-4b56-9fde-929ca8e5a3a3 tempest-CreateVolumesFromSnapshotTest-994771565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c60c6f5b-7164-42d2-b7fa-b657860dc08c 1073741824" returned: 0 in 1.345s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7e9ee30f-76ce-4b56-9fde-929ca8e5a3a3 tempest-CreateVolumesFromSnapshotTest-994771565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c60c6f5b-7164-42d2-b7fa-b657860dc08c {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:45 devstack sudo[114652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c60c6f5b-7164-42d2-b7fa-b657860dc08c Jun 24 05:20:45 devstack sudo[114652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:45 devstack sudo[114644]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d1bcd590-146a-46e7-ac25-a31de643cdb3 tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 1.154s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:45 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-d1bcd590-146a-46e7-ac25-a31de643cdb3 tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:20:45 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-d1bcd590-146a-46e7-ac25-a31de643cdb3 tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Deleted volume successfully. Jun 24 05:20:45 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-d1bcd590-146a-46e7-ac25-a31de643cdb3 tempest-VolumeAndVolumeTypeFromImageTest-1345092688 None] Lock "cinder-daade867-d711-4a3c-b1c8-002472fd4d36-delete_volume" released by "delete_volume" :: held 4.377s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:20:45 devstack sudo[114646]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-69b79cbd-eddc-4f18-acbe-5c28bbe86000 tempest-CinderUnicodeTest-774697758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238.15af1ef1-4dee-479a-86c0-24d0acf9c783" returned: 0 in 1.125s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:45 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-69b79cbd-eddc-4f18-acbe-5c28bbe86000 tempest-CinderUnicodeTest-774697758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:20:46 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb916de-b9af-4547-b6fa-c61e232d8867]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:20:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-69b79cbd-eddc-4f18-acbe-5c28bbe86000 tempest-CinderUnicodeTest-774697758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:46 devstack sudo[114657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238 Jun 24 05:20:46 devstack sudo[114657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:46 devstack sudo[114652]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7e9ee30f-76ce-4b56-9fde-929ca8e5a3a3 tempest-CreateVolumesFromSnapshotTest-994771565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c60c6f5b-7164-42d2-b7fa-b657860dc08c" returned: 0 in 0.840s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:46 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7e9ee30f-76ce-4b56-9fde-929ca8e5a3a3 tempest-CreateVolumesFromSnapshotTest-994771565 None] <== create_volume: return (2250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:20:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7e9ee30f-76ce-4b56-9fde-929ca8e5a3a3 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.253s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:20:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-d82805cd-3f98-4530-8a73-c7f076fdfba2 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.433s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:46 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-d82805cd-3f98-4530-8a73-c7f076fdfba2 tempest-CreateVolumesFromSnapshotTest-994771565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1838168442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c7b9a34-743d-4f97-ab81-cc5c2d57cdec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61da3d7d6c694af0a37056f29b182683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:20:41Z,use_quota=True,user_id='0c87690e00cc4ca39cd726cd49849dd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:20:46 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-d82805cd-3f98-4530-8a73-c7f076fdfba2 tempest-CreateVolumesFromSnapshotTest-994771565 None] Creating volume 9c7b9a34-743d-4f97-ab81-cc5c2d57cdec {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:20:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-d82805cd-3f98-4530-8a73-c7f076fdfba2 tempest-CreateVolumesFromSnapshotTest-994771565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-d82805cd-3f98-4530-8a73-c7f076fdfba2 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:46 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-d82805cd-3f98-4530-8a73-c7f076fdfba2 tempest-CreateVolumesFromSnapshotTest-994771565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:20:46 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-d82805cd-3f98-4530-8a73-c7f076fdfba2 tempest-CreateVolumesFromSnapshotTest-994771565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:20:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-d82805cd-3f98-4530-8a73-c7f076fdfba2 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:20:46 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-d82805cd-3f98-4530-8a73-c7f076fdfba2 tempest-CreateVolumesFromSnapshotTest-994771565 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:20:46 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-d82805cd-3f98-4530-8a73-c7f076fdfba2 tempest-CreateVolumesFromSnapshotTest-994771565 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:20:46 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d82805cd-3f98-4530-8a73-c7f076fdfba2 tempest-CreateVolumesFromSnapshotTest-994771565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9c7b9a34-743d-4f97-ab81-cc5c2d57cdec 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:46 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7e9ee30f-76ce-4b56-9fde-929ca8e5a3a3 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fce72850-ddd5-484c-9aa6-52707b42347b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c60c6f5b-7164-42d2-b7fa-b657860dc08c', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:46 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7e9ee30f-76ce-4b56-9fde-929ca8e5a3a3 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71d7ec7d-3c6d-4034-8e77-73b4d4dded17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:46 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-7e9ee30f-76ce-4b56-9fde-929ca8e5a3a3 tempest-CreateVolumesFromSnapshotTest-994771565 None] Volume volume-c60c6f5b-7164-42d2-b7fa-b657860dc08c (c60c6f5b-7164-42d2-b7fa-b657860dc08c): created successfully Jun 24 05:20:46 devstack sudo[114660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9c7b9a34-743d-4f97-ab81-cc5c2d57cdec 1073741824 Jun 24 05:20:46 devstack sudo[114660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:46 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7e9ee30f-76ce-4b56-9fde-929ca8e5a3a3 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71d7ec7d-3c6d-4034-8e77-73b4d4dded17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:46 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7e9ee30f-76ce-4b56-9fde-929ca8e5a3a3 tempest-CreateVolumesFromSnapshotTest-994771565 None] Flow 'volume_create_manager' (eb3f10ea-4e78-4011-804a-4487fc2210e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:20:46 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-7e9ee30f-76ce-4b56-9fde-929ca8e5a3a3 tempest-CreateVolumesFromSnapshotTest-994771565 None] Created volume successfully. Jun 24 05:20:47 devstack sudo[114657]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-69b79cbd-eddc-4f18-acbe-5c28bbe86000 tempest-CinderUnicodeTest-774697758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238" returned: 0 in 1.071s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-69b79cbd-eddc-4f18-acbe-5c28bbe86000 tempest-CinderUnicodeTest-774697758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238.15af1ef1-4dee-479a-86c0-24d0acf9c783 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:47 devstack sudo[114669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238.15af1ef1-4dee-479a-86c0-24d0acf9c783 Jun 24 05:20:47 devstack sudo[114669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:47 devstack sudo[114660]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d82805cd-3f98-4530-8a73-c7f076fdfba2 tempest-CreateVolumesFromSnapshotTest-994771565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9c7b9a34-743d-4f97-ab81-cc5c2d57cdec 1073741824" returned: 0 in 1.112s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d82805cd-3f98-4530-8a73-c7f076fdfba2 tempest-CreateVolumesFromSnapshotTest-994771565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9c7b9a34-743d-4f97-ab81-cc5c2d57cdec {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:47 devstack sudo[114672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9c7b9a34-743d-4f97-ab81-cc5c2d57cdec Jun 24 05:20:47 devstack sudo[114672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:48 devstack sudo[114669]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-69b79cbd-eddc-4f18-acbe-5c28bbe86000 tempest-CinderUnicodeTest-774697758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238.15af1ef1-4dee-479a-86c0-24d0acf9c783" returned: 0 in 1.005s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-69b79cbd-eddc-4f18-acbe-5c28bbe86000 tempest-CinderUnicodeTest-774697758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238.15af1ef1-4dee-479a-86c0-24d0acf9c783 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:48 devstack sudo[114677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238.15af1ef1-4dee-479a-86c0-24d0acf9c783 Jun 24 05:20:48 devstack sudo[114677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:48 devstack sudo[114672]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d82805cd-3f98-4530-8a73-c7f076fdfba2 tempest-CreateVolumesFromSnapshotTest-994771565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9c7b9a34-743d-4f97-ab81-cc5c2d57cdec" returned: 0 in 0.971s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:48 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-d82805cd-3f98-4530-8a73-c7f076fdfba2 tempest-CreateVolumesFromSnapshotTest-994771565 None] <== create_volume: return (2264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:20:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-d82805cd-3f98-4530-8a73-c7f076fdfba2 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.269s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:20:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-dba7e5dd-5889-489c-bda9-924e0b1a8598 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.396s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:48 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-dba7e5dd-5889-489c-bda9-924e0b1a8598 tempest-CreateVolumesFromSnapshotTest-994771565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1214785314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07e6b3c7-5f3c-436f-b55d-3903abe1d7aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61da3d7d6c694af0a37056f29b182683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:20:41Z,use_quota=True,user_id='0c87690e00cc4ca39cd726cd49849dd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:20:48 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-dba7e5dd-5889-489c-bda9-924e0b1a8598 tempest-CreateVolumesFromSnapshotTest-994771565 None] Creating volume 07e6b3c7-5f3c-436f-b55d-3903abe1d7aa {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:20:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-dba7e5dd-5889-489c-bda9-924e0b1a8598 tempest-CreateVolumesFromSnapshotTest-994771565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-dba7e5dd-5889-489c-bda9-924e0b1a8598 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:48 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-dba7e5dd-5889-489c-bda9-924e0b1a8598 tempest-CreateVolumesFromSnapshotTest-994771565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:20:48 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-dba7e5dd-5889-489c-bda9-924e0b1a8598 tempest-CreateVolumesFromSnapshotTest-994771565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:20:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-dba7e5dd-5889-489c-bda9-924e0b1a8598 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:20:48 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-dba7e5dd-5889-489c-bda9-924e0b1a8598 tempest-CreateVolumesFromSnapshotTest-994771565 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:20:48 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-dba7e5dd-5889-489c-bda9-924e0b1a8598 tempest-CreateVolumesFromSnapshotTest-994771565 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:20:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dba7e5dd-5889-489c-bda9-924e0b1a8598 tempest-CreateVolumesFromSnapshotTest-994771565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-07e6b3c7-5f3c-436f-b55d-3903abe1d7aa 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:48 devstack sudo[114680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-07e6b3c7-5f3c-436f-b55d-3903abe1d7aa 1073741824 Jun 24 05:20:48 devstack sudo[114680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:48 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d82805cd-3f98-4530-8a73-c7f076fdfba2 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (427a7453-61bd-4795-8673-d9872ce6a288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c7b9a34-743d-4f97-ab81-cc5c2d57cdec', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:48 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d82805cd-3f98-4530-8a73-c7f076fdfba2 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2663eba-8d3b-41c9-9f03-ec1c484bd9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:48 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-d82805cd-3f98-4530-8a73-c7f076fdfba2 tempest-CreateVolumesFromSnapshotTest-994771565 None] Volume volume-9c7b9a34-743d-4f97-ab81-cc5c2d57cdec (9c7b9a34-743d-4f97-ab81-cc5c2d57cdec): created successfully Jun 24 05:20:48 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d82805cd-3f98-4530-8a73-c7f076fdfba2 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2663eba-8d3b-41c9-9f03-ec1c484bd9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:48 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-d82805cd-3f98-4530-8a73-c7f076fdfba2 tempest-CreateVolumesFromSnapshotTest-994771565 None] Flow 'volume_create_manager' (05274fa4-f9a7-479f-a2f6-c07a7603884b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:20:48 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-d82805cd-3f98-4530-8a73-c7f076fdfba2 tempest-CreateVolumesFromSnapshotTest-994771565 None] Created volume successfully. Jun 24 05:20:48 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-e329fc50-da6e-48ef-9459-bc6f1da3c022 tempest-VolumeDependencyTests-1774128313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:20:48 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e329fc50-da6e-48ef-9459-bc6f1da3c022 tempest-VolumeDependencyTests-1774128313 None] Flow 'volume_create_manager' (381f78b4-d5a7-46d8-973d-a2de2542c370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:20:48 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e329fc50-da6e-48ef-9459-bc6f1da3c022 tempest-VolumeDependencyTests-1774128313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ddf8eb4-5b7e-44f7-8a85-57a497b46ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:48 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e329fc50-da6e-48ef-9459-bc6f1da3c022 tempest-VolumeDependencyTests-1774128313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ddf8eb4-5b7e-44f7-8a85-57a497b46ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1823270718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4771b250-f68d-4304-9ea4-56b40579eb8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc2f5f3f24d34479b017e3b209ac4ecc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:20:49Z,use_quota=True,user_id='122e153fba494e6fafed55226b846489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:48 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e329fc50-da6e-48ef-9459-bc6f1da3c022 tempest-VolumeDependencyTests-1774128313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b88331c7-1530-4826-b2da-e415c7c9261a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:48 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e329fc50-da6e-48ef-9459-bc6f1da3c022 tempest-VolumeDependencyTests-1774128313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b88331c7-1530-4826-b2da-e415c7c9261a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e329fc50-da6e-48ef-9459-bc6f1da3c022 tempest-VolumeDependencyTests-1774128313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a7f0685-d8da-4a35-940b-f90357e12c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e329fc50-da6e-48ef-9459-bc6f1da3c022 tempest-VolumeDependencyTests-1774128313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a7f0685-d8da-4a35-940b-f90357e12c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4771b250-f68d-4304-9ea4-56b40579eb8a', 'volume_name': 'volume-4771b250-f68d-4304-9ea4-56b40579eb8a', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e329fc50-da6e-48ef-9459-bc6f1da3c022 tempest-VolumeDependencyTests-1774128313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14f176d6-70c3-45df-98fa-60f81c160249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e329fc50-da6e-48ef-9459-bc6f1da3c022 tempest-VolumeDependencyTests-1774128313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14f176d6-70c3-45df-98fa-60f81c160249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e329fc50-da6e-48ef-9459-bc6f1da3c022 tempest-VolumeDependencyTests-1774128313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f71ec58f-34c1-4a8b-a9fe-941bb6bcb81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:49 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-e329fc50-da6e-48ef-9459-bc6f1da3c022 tempest-VolumeDependencyTests-1774128313 None] Volume 4771b250-f68d-4304-9ea4-56b40579eb8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4771b250-f68d-4304-9ea4-56b40579eb8a', 'volume_size': 1} Jun 24 05:20:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e329fc50-da6e-48ef-9459-bc6f1da3c022 tempest-VolumeDependencyTests-1774128313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:49 devstack sudo[114677]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-69b79cbd-eddc-4f18-acbe-5c28bbe86000 tempest-CinderUnicodeTest-774697758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238.15af1ef1-4dee-479a-86c0-24d0acf9c783" returned: 0 in 1.006s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:49 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-69b79cbd-eddc-4f18-acbe-5c28bbe86000 tempest-CinderUnicodeTest-774697758 None] Lock "cinder-quobyte-15af1ef1-4dee-479a-86c0-24d0acf9c783" released by "_delete_snapshot" :: held 4.397s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:20:49 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-69b79cbd-eddc-4f18-acbe-5c28bbe86000 tempest-CinderUnicodeTest-774697758 None] Lock "cinder-quobyte-c4912260-4d7e-4289-bc3a-4e8c1ef4d238" released by "delete_snapshot" :: held 4.440s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:20:49 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-69b79cbd-eddc-4f18-acbe-5c28bbe86000 tempest-CinderUnicodeTest-774697758 None] Created reservations ['487eb748-573e-47e3-b4af-d7691570282f', '6ab2f3be-333f-4c58-85e2-f4368615bcf2', 'a950151b-720b-4d02-857c-8519085c82fa', '7262a05e-8973-4e6c-86d9-485d9f5803d7'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:20:49 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-69b79cbd-eddc-4f18-acbe-5c28bbe86000 tempest-CinderUnicodeTest-774697758 None] Delete snapshot completed successfully. Jun 24 05:20:49 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-69b79cbd-eddc-4f18-acbe-5c28bbe86000 tempest-CinderUnicodeTest-774697758 None] Lock "cinder-15af1ef1-4dee-479a-86c0-24d0acf9c783-delete_snapshot" released by "delete_snapshot" :: held 4.649s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:20:49 devstack sudo[114680]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dba7e5dd-5889-489c-bda9-924e0b1a8598 tempest-CreateVolumesFromSnapshotTest-994771565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-07e6b3c7-5f3c-436f-b55d-3903abe1d7aa 1073741824" returned: 0 in 0.996s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dba7e5dd-5889-489c-bda9-924e0b1a8598 tempest-CreateVolumesFromSnapshotTest-994771565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-07e6b3c7-5f3c-436f-b55d-3903abe1d7aa {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:49 devstack sudo[114687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-07e6b3c7-5f3c-436f-b55d-3903abe1d7aa Jun 24 05:20:49 devstack sudo[114687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:50 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a3679fa6-c59a-4cf0-875b-df2114b503ee tempest-CinderUnicodeTest-774697758 None] Acquiring lock "cinder-c4912260-4d7e-4289-bc3a-4e8c1ef4d238-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:20:50 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a3679fa6-c59a-4cf0-875b-df2114b503ee tempest-CinderUnicodeTest-774697758 None] Lock "cinder-c4912260-4d7e-4289-bc3a-4e8c1ef4d238-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:20:50 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a3679fa6-c59a-4cf0-875b-df2114b503ee tempest-CinderUnicodeTest-774697758 None] Acquiring lock "cinder-quobyte-c4912260-4d7e-4289-bc3a-4e8c1ef4d238" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:20:50 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a3679fa6-c59a-4cf0-875b-df2114b503ee tempest-CinderUnicodeTest-774697758 None] Lock "cinder-quobyte-c4912260-4d7e-4289-bc3a-4e8c1ef4d238" acquired by "delete_volume" :: waited 0.019s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:20:50 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[2277a1ab-d602-4c75-a9bd-62fb7fc32ec4]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:20:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a3679fa6-c59a-4cf0-875b-df2114b503ee tempest-CinderUnicodeTest-774697758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:50 devstack sudo[114687]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-dba7e5dd-5889-489c-bda9-924e0b1a8598 tempest-CreateVolumesFromSnapshotTest-994771565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-07e6b3c7-5f3c-436f-b55d-3903abe1d7aa" returned: 0 in 0.675s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:50 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-dba7e5dd-5889-489c-bda9-924e0b1a8598 tempest-CreateVolumesFromSnapshotTest-994771565 None] <== create_volume: return (1720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:20:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-dba7e5dd-5889-489c-bda9-924e0b1a8598 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.724s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:20:50 devstack sudo[114689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238 Jun 24 05:20:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3bb75f58-e790-43e6-acd6-2ab6b1f97c33 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.377s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:50 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-3bb75f58-e790-43e6-acd6-2ab6b1f97c33 tempest-CreateVolumesFromSnapshotTest-994771565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-395440910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b53db94-9ad6-4463-99fa-ba38744bd513,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61da3d7d6c694af0a37056f29b182683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:20:42Z,use_quota=True,user_id='0c87690e00cc4ca39cd726cd49849dd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:20:50 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-3bb75f58-e790-43e6-acd6-2ab6b1f97c33 tempest-CreateVolumesFromSnapshotTest-994771565 None] Creating volume 3b53db94-9ad6-4463-99fa-ba38744bd513 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:20:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3bb75f58-e790-43e6-acd6-2ab6b1f97c33 tempest-CreateVolumesFromSnapshotTest-994771565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:50 devstack sudo[114689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3bb75f58-e790-43e6-acd6-2ab6b1f97c33 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:50 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-3bb75f58-e790-43e6-acd6-2ab6b1f97c33 tempest-CreateVolumesFromSnapshotTest-994771565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:20:50 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-3bb75f58-e790-43e6-acd6-2ab6b1f97c33 tempest-CreateVolumesFromSnapshotTest-994771565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:20:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3bb75f58-e790-43e6-acd6-2ab6b1f97c33 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:20:50 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-3bb75f58-e790-43e6-acd6-2ab6b1f97c33 tempest-CreateVolumesFromSnapshotTest-994771565 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:20:50 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-3bb75f58-e790-43e6-acd6-2ab6b1f97c33 tempest-CreateVolumesFromSnapshotTest-994771565 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:20:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3bb75f58-e790-43e6-acd6-2ab6b1f97c33 tempest-CreateVolumesFromSnapshotTest-994771565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-3b53db94-9ad6-4463-99fa-ba38744bd513 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:50 devstack sudo[114692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-3b53db94-9ad6-4463-99fa-ba38744bd513 1073741824 Jun 24 05:20:50 devstack sudo[114692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:50 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-dba7e5dd-5889-489c-bda9-924e0b1a8598 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63982f23-2bc6-41be-8212-6ebd1a149f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07e6b3c7-5f3c-436f-b55d-3903abe1d7aa', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:50 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-dba7e5dd-5889-489c-bda9-924e0b1a8598 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0e22252-d0ac-488f-979c-0389c43200d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:50 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-dba7e5dd-5889-489c-bda9-924e0b1a8598 tempest-CreateVolumesFromSnapshotTest-994771565 None] Volume volume-07e6b3c7-5f3c-436f-b55d-3903abe1d7aa (07e6b3c7-5f3c-436f-b55d-3903abe1d7aa): created successfully Jun 24 05:20:50 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-dba7e5dd-5889-489c-bda9-924e0b1a8598 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0e22252-d0ac-488f-979c-0389c43200d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:50 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-dba7e5dd-5889-489c-bda9-924e0b1a8598 tempest-CreateVolumesFromSnapshotTest-994771565 None] Flow 'volume_create_manager' (0fe11547-7dcc-4746-96af-e8960099b0fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:20:50 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-dba7e5dd-5889-489c-bda9-924e0b1a8598 tempest-CreateVolumesFromSnapshotTest-994771565 None] Created volume successfully. Jun 24 05:20:50 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-5176ba21-e001-41a5-92ed-e48ed03d421e tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:20:50 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5176ba21-e001-41a5-92ed-e48ed03d421e tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Flow 'volume_create_manager' (7144bd97-fb70-411a-b072-3e828c958acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:20:50 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5176ba21-e001-41a5-92ed-e48ed03d421e tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0037bd30-6189-4a3e-84e0-ec157e32bf92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:50 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5176ba21-e001-41a5-92ed-e48ed03d421e tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0037bd30-6189-4a3e-84e0-ec157e32bf92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:20:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-925416025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f84726a1-bf20-43a4-9f58-387147e41057,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29c19ed5956f4ae59db533696891afd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:20:51Z,use_quota=True,user_id='a275c448916f496284ab737a12644249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:50 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5176ba21-e001-41a5-92ed-e48ed03d421e tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4931b502-d3ac-459b-b494-30e623ff0b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:50 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5176ba21-e001-41a5-92ed-e48ed03d421e tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4931b502-d3ac-459b-b494-30e623ff0b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:50 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5176ba21-e001-41a5-92ed-e48ed03d421e tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba8f8068-9fbd-438c-9eec-be6f86f7ebd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:50 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5176ba21-e001-41a5-92ed-e48ed03d421e tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba8f8068-9fbd-438c-9eec-be6f86f7ebd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f84726a1-bf20-43a4-9f58-387147e41057', 'volume_name': 'volume-f84726a1-bf20-43a4-9f58-387147e41057', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:50 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5176ba21-e001-41a5-92ed-e48ed03d421e tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bef618f-301a-4a6b-959e-bf779f9eacd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:50 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5176ba21-e001-41a5-92ed-e48ed03d421e tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bef618f-301a-4a6b-959e-bf779f9eacd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:50 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5176ba21-e001-41a5-92ed-e48ed03d421e tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaa1616f-d41e-4ad4-853f-80c165646016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:50 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-5176ba21-e001-41a5-92ed-e48ed03d421e tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Volume f84726a1-bf20-43a4-9f58-387147e41057: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f84726a1-bf20-43a4-9f58-387147e41057', 'volume_size': 1} Jun 24 05:20:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5176ba21-e001-41a5-92ed-e48ed03d421e tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:51 devstack sudo[114689]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a3679fa6-c59a-4cf0-875b-df2114b503ee tempest-CinderUnicodeTest-774697758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238" returned: 0 in 0.904s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a3679fa6-c59a-4cf0-875b-df2114b503ee tempest-CinderUnicodeTest-774697758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:51 devstack sudo[114702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238 Jun 24 05:20:51 devstack sudo[114702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:51 devstack sudo[114692]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3bb75f58-e790-43e6-acd6-2ab6b1f97c33 tempest-CreateVolumesFromSnapshotTest-994771565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-3b53db94-9ad6-4463-99fa-ba38744bd513 1073741824" returned: 0 in 0.908s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3bb75f58-e790-43e6-acd6-2ab6b1f97c33 tempest-CreateVolumesFromSnapshotTest-994771565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-3b53db94-9ad6-4463-99fa-ba38744bd513 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:51 devstack sudo[114704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-3b53db94-9ad6-4463-99fa-ba38744bd513 Jun 24 05:20:51 devstack sudo[114704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:51 devstack sudo[114702]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a3679fa6-c59a-4cf0-875b-df2114b503ee tempest-CinderUnicodeTest-774697758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c4912260-4d7e-4289-bc3a-4e8c1ef4d238" returned: 0 in 0.725s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:51 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a3679fa6-c59a-4cf0-875b-df2114b503ee tempest-CinderUnicodeTest-774697758 None] Lock "cinder-quobyte-c4912260-4d7e-4289-bc3a-4e8c1ef4d238" released by "delete_volume" :: held 1.716s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:20:51 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-a3679fa6-c59a-4cf0-875b-df2114b503ee tempest-CinderUnicodeTest-774697758 None] Created reservations ['90b5fa83-041e-43b4-83aa-7fa5f631f0f7', '6fdd5716-63aa-4840-8c1c-547e82bd6fc6', '97d01d63-903f-4eba-87a8-906d33100c9d', '06813b61-8003-4956-9d2c-4f07b1539909'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:20:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a3679fa6-c59a-4cf0-875b-df2114b503ee tempest-CinderUnicodeTest-774697758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a3679fa6-c59a-4cf0-875b-df2114b503ee tempest-CinderUnicodeTest-774697758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:51 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a3679fa6-c59a-4cf0-875b-df2114b503ee tempest-CinderUnicodeTest-774697758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:20:51 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a3679fa6-c59a-4cf0-875b-df2114b503ee tempest-CinderUnicodeTest-774697758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:20:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a3679fa6-c59a-4cf0-875b-df2114b503ee tempest-CinderUnicodeTest-774697758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:20:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a3679fa6-c59a-4cf0-875b-df2114b503ee tempest-CinderUnicodeTest-774697758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:52 devstack sudo[114704]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3bb75f58-e790-43e6-acd6-2ab6b1f97c33 tempest-CreateVolumesFromSnapshotTest-994771565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-3b53db94-9ad6-4463-99fa-ba38744bd513" returned: 0 in 0.715s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:52 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-3bb75f58-e790-43e6-acd6-2ab6b1f97c33 tempest-CreateVolumesFromSnapshotTest-994771565 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:20:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3bb75f58-e790-43e6-acd6-2ab6b1f97c33 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:20:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3ccd6bc3-51c6-4787-ac05-d5d14197d213 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.456s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:52 devstack sudo[114708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:20:52 devstack sudo[114708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:52 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-3ccd6bc3-51c6-4787-ac05-d5d14197d213 tempest-CreateVolumesFromSnapshotTest-994771565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-125073190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=859b0a9b-dc33-4780-a776-f00e805a9279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61da3d7d6c694af0a37056f29b182683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:20:42Z,use_quota=True,user_id='0c87690e00cc4ca39cd726cd49849dd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:20:52 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-3ccd6bc3-51c6-4787-ac05-d5d14197d213 tempest-CreateVolumesFromSnapshotTest-994771565 None] Creating volume 859b0a9b-dc33-4780-a776-f00e805a9279 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:20:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3ccd6bc3-51c6-4787-ac05-d5d14197d213 tempest-CreateVolumesFromSnapshotTest-994771565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3ccd6bc3-51c6-4787-ac05-d5d14197d213 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:52 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-3ccd6bc3-51c6-4787-ac05-d5d14197d213 tempest-CreateVolumesFromSnapshotTest-994771565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:20:52 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-3ccd6bc3-51c6-4787-ac05-d5d14197d213 tempest-CreateVolumesFromSnapshotTest-994771565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:20:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3ccd6bc3-51c6-4787-ac05-d5d14197d213 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:20:52 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-3ccd6bc3-51c6-4787-ac05-d5d14197d213 tempest-CreateVolumesFromSnapshotTest-994771565 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:20:52 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-3ccd6bc3-51c6-4787-ac05-d5d14197d213 tempest-CreateVolumesFromSnapshotTest-994771565 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:20:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3ccd6bc3-51c6-4787-ac05-d5d14197d213 tempest-CreateVolumesFromSnapshotTest-994771565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-859b0a9b-dc33-4780-a776-f00e805a9279 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:52 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3bb75f58-e790-43e6-acd6-2ab6b1f97c33 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95b8e8f9-a1f7-41fe-b09d-25b4e0066543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b53db94-9ad6-4463-99fa-ba38744bd513', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:52 devstack sudo[114710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-859b0a9b-dc33-4780-a776-f00e805a9279 1073741824 Jun 24 05:20:52 devstack sudo[114710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:52 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3bb75f58-e790-43e6-acd6-2ab6b1f97c33 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09bad0fb-1456-4bdc-bcc0-b7b1e632e7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:52 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-3bb75f58-e790-43e6-acd6-2ab6b1f97c33 tempest-CreateVolumesFromSnapshotTest-994771565 None] Volume volume-3b53db94-9ad6-4463-99fa-ba38744bd513 (3b53db94-9ad6-4463-99fa-ba38744bd513): created successfully Jun 24 05:20:52 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3bb75f58-e790-43e6-acd6-2ab6b1f97c33 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09bad0fb-1456-4bdc-bcc0-b7b1e632e7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:52 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3bb75f58-e790-43e6-acd6-2ab6b1f97c33 tempest-CreateVolumesFromSnapshotTest-994771565 None] Flow 'volume_create_manager' (37d6cf53-d9d5-4b4d-be7f-cd8d7b5886cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:20:52 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-3bb75f58-e790-43e6-acd6-2ab6b1f97c33 tempest-CreateVolumesFromSnapshotTest-994771565 None] Created volume successfully. Jun 24 05:20:52 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-284025d2-94e9-4ce7-a741-9b6ea738e3a9 tempest-CinderUnicodeTest-774697758 None] Acquiring lock "cinder-a0c05576-856e-462b-a60c-0f9190cd3a40-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:20:52 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-284025d2-94e9-4ce7-a741-9b6ea738e3a9 tempest-CinderUnicodeTest-774697758 None] Lock "cinder-a0c05576-856e-462b-a60c-0f9190cd3a40-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:20:52 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-284025d2-94e9-4ce7-a741-9b6ea738e3a9 tempest-CinderUnicodeTest-774697758 None] Acquiring lock "cinder-quobyte-a0c05576-856e-462b-a60c-0f9190cd3a40" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:20:52 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-284025d2-94e9-4ce7-a741-9b6ea738e3a9 tempest-CinderUnicodeTest-774697758 None] Lock "cinder-quobyte-a0c05576-856e-462b-a60c-0f9190cd3a40" acquired by "delete_volume" :: waited 0.025s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:20:52 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae0d9d8-e22d-4731-8e78-a9765aa11326]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:20:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-284025d2-94e9-4ce7-a741-9b6ea738e3a9 tempest-CinderUnicodeTest-774697758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a0c05576-856e-462b-a60c-0f9190cd3a40 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:52 devstack sudo[114712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a0c05576-856e-462b-a60c-0f9190cd3a40 Jun 24 05:20:52 devstack sudo[114712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:52 devstack sudo[114708]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a3679fa6-c59a-4cf0-875b-df2114b503ee tempest-CinderUnicodeTest-774697758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.772s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:52 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-a3679fa6-c59a-4cf0-875b-df2114b503ee tempest-CinderUnicodeTest-774697758 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:20:52 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-a3679fa6-c59a-4cf0-875b-df2114b503ee tempest-CinderUnicodeTest-774697758 None] Deleted volume successfully. Jun 24 05:20:52 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a3679fa6-c59a-4cf0-875b-df2114b503ee tempest-CinderUnicodeTest-774697758 None] Lock "cinder-c4912260-4d7e-4289-bc3a-4e8c1ef4d238-delete_volume" released by "delete_volume" :: held 2.725s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:20:52 devstack sudo[114710]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3ccd6bc3-51c6-4787-ac05-d5d14197d213 tempest-CreateVolumesFromSnapshotTest-994771565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-859b0a9b-dc33-4780-a776-f00e805a9279 1073741824" returned: 0 in 0.886s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3ccd6bc3-51c6-4787-ac05-d5d14197d213 tempest-CreateVolumesFromSnapshotTest-994771565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-859b0a9b-dc33-4780-a776-f00e805a9279 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:52 devstack sudo[114719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-859b0a9b-dc33-4780-a776-f00e805a9279 Jun 24 05:20:52 devstack sudo[114719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:53 devstack sudo[114712]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-284025d2-94e9-4ce7-a741-9b6ea738e3a9 tempest-CinderUnicodeTest-774697758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a0c05576-856e-462b-a60c-0f9190cd3a40" returned: 0 in 0.787s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-284025d2-94e9-4ce7-a741-9b6ea738e3a9 tempest-CinderUnicodeTest-774697758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a0c05576-856e-462b-a60c-0f9190cd3a40 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:53 devstack sudo[114724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a0c05576-856e-462b-a60c-0f9190cd3a40 Jun 24 05:20:53 devstack sudo[114724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:53 devstack sudo[114719]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3ccd6bc3-51c6-4787-ac05-d5d14197d213 tempest-CreateVolumesFromSnapshotTest-994771565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-859b0a9b-dc33-4780-a776-f00e805a9279" returned: 0 in 0.680s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:53 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-3ccd6bc3-51c6-4787-ac05-d5d14197d213 tempest-CreateVolumesFromSnapshotTest-994771565 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:20:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-3ccd6bc3-51c6-4787-ac05-d5d14197d213 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.618s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:20:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e329fc50-da6e-48ef-9459-bc6f1da3c022 tempest-VolumeDependencyTests-1774128313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.619s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:53 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e329fc50-da6e-48ef-9459-bc6f1da3c022 tempest-VolumeDependencyTests-1774128313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1823270718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4771b250-f68d-4304-9ea4-56b40579eb8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc2f5f3f24d34479b017e3b209ac4ecc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:20:49Z,use_quota=True,user_id='122e153fba494e6fafed55226b846489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:20:53 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-e329fc50-da6e-48ef-9459-bc6f1da3c022 tempest-VolumeDependencyTests-1774128313 None] Creating volume 4771b250-f68d-4304-9ea4-56b40579eb8a {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:20:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e329fc50-da6e-48ef-9459-bc6f1da3c022 tempest-VolumeDependencyTests-1774128313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e329fc50-da6e-48ef-9459-bc6f1da3c022 tempest-VolumeDependencyTests-1774128313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:53 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e329fc50-da6e-48ef-9459-bc6f1da3c022 tempest-VolumeDependencyTests-1774128313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:20:53 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e329fc50-da6e-48ef-9459-bc6f1da3c022 tempest-VolumeDependencyTests-1774128313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:20:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e329fc50-da6e-48ef-9459-bc6f1da3c022 tempest-VolumeDependencyTests-1774128313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:20:53 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e329fc50-da6e-48ef-9459-bc6f1da3c022 tempest-VolumeDependencyTests-1774128313 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:20:53 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-e329fc50-da6e-48ef-9459-bc6f1da3c022 tempest-VolumeDependencyTests-1774128313 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:20:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e329fc50-da6e-48ef-9459-bc6f1da3c022 tempest-VolumeDependencyTests-1774128313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:53 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3ccd6bc3-51c6-4787-ac05-d5d14197d213 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e25dd69a-3147-4707-b07e-b3378ced0fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-859b0a9b-dc33-4780-a776-f00e805a9279', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:53 devstack sudo[114727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a 1073741824 Jun 24 05:20:53 devstack sudo[114727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:53 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3ccd6bc3-51c6-4787-ac05-d5d14197d213 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (401dc2d4-5c59-4677-ba98-01c494e4c33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:53 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-3ccd6bc3-51c6-4787-ac05-d5d14197d213 tempest-CreateVolumesFromSnapshotTest-994771565 None] Volume volume-859b0a9b-dc33-4780-a776-f00e805a9279 (859b0a9b-dc33-4780-a776-f00e805a9279): created successfully Jun 24 05:20:53 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3ccd6bc3-51c6-4787-ac05-d5d14197d213 tempest-CreateVolumesFromSnapshotTest-994771565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (401dc2d4-5c59-4677-ba98-01c494e4c33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:53 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-3ccd6bc3-51c6-4787-ac05-d5d14197d213 tempest-CreateVolumesFromSnapshotTest-994771565 None] Flow 'volume_create_manager' (bd25a86b-e8f7-44c3-a2ae-b7e942c92986) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:20:53 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-3ccd6bc3-51c6-4787-ac05-d5d14197d213 tempest-CreateVolumesFromSnapshotTest-994771565 None] Created volume successfully. Jun 24 05:20:54 devstack sudo[114724]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-284025d2-94e9-4ce7-a741-9b6ea738e3a9 tempest-CinderUnicodeTest-774697758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a0c05576-856e-462b-a60c-0f9190cd3a40" returned: 0 in 0.674s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:54 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-284025d2-94e9-4ce7-a741-9b6ea738e3a9 tempest-CinderUnicodeTest-774697758 None] Lock "cinder-quobyte-a0c05576-856e-462b-a60c-0f9190cd3a40" released by "delete_volume" :: held 1.514s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:20:54 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-284025d2-94e9-4ce7-a741-9b6ea738e3a9 tempest-CinderUnicodeTest-774697758 None] Created reservations ['1b3dbdce-c03c-49d7-bb9a-8f47a2a916de', '055dbb35-af3f-4954-a94f-70e48d7a8bcf', '8adb98f1-e6fa-4fcb-ae1d-9c18e69a7ca0', 'fa7f82fb-2d57-420b-b375-bbfafd9c7104'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:20:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-284025d2-94e9-4ce7-a741-9b6ea738e3a9 tempest-CinderUnicodeTest-774697758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-284025d2-94e9-4ce7-a741-9b6ea738e3a9 tempest-CinderUnicodeTest-774697758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:54 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-284025d2-94e9-4ce7-a741-9b6ea738e3a9 tempest-CinderUnicodeTest-774697758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:20:54 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-284025d2-94e9-4ce7-a741-9b6ea738e3a9 tempest-CinderUnicodeTest-774697758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:20:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-284025d2-94e9-4ce7-a741-9b6ea738e3a9 tempest-CinderUnicodeTest-774697758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:20:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-284025d2-94e9-4ce7-a741-9b6ea738e3a9 tempest-CinderUnicodeTest-774697758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:54 devstack sudo[114730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:20:54 devstack sudo[114730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:54 devstack sudo[114727]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e329fc50-da6e-48ef-9459-bc6f1da3c022 tempest-VolumeDependencyTests-1774128313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a 1073741824" returned: 0 in 0.854s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e329fc50-da6e-48ef-9459-bc6f1da3c022 tempest-VolumeDependencyTests-1774128313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:54 devstack sudo[114735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a Jun 24 05:20:54 devstack sudo[114735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:54 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a55b6113-6ca6-491a-ac0b-27365e791b05 tempest-CreateVolumesFromSnapshotTest-994771565 None] Acquiring lock "cinder-859b0a9b-dc33-4780-a776-f00e805a9279-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:20:54 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a55b6113-6ca6-491a-ac0b-27365e791b05 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "cinder-859b0a9b-dc33-4780-a776-f00e805a9279-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:20:54 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a55b6113-6ca6-491a-ac0b-27365e791b05 tempest-CreateVolumesFromSnapshotTest-994771565 None] Acquiring lock "cinder-quobyte-859b0a9b-dc33-4780-a776-f00e805a9279" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:20:54 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a55b6113-6ca6-491a-ac0b-27365e791b05 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "cinder-quobyte-859b0a9b-dc33-4780-a776-f00e805a9279" acquired by "delete_volume" :: waited 0.031s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:20:54 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[c675656f-c566-4673-a4f2-0d1e679b39ee]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:20:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a55b6113-6ca6-491a-ac0b-27365e791b05 tempest-CreateVolumesFromSnapshotTest-994771565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-859b0a9b-dc33-4780-a776-f00e805a9279 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:54 devstack sudo[114730]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-284025d2-94e9-4ce7-a741-9b6ea738e3a9 tempest-CinderUnicodeTest-774697758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.790s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:54 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-284025d2-94e9-4ce7-a741-9b6ea738e3a9 tempest-CinderUnicodeTest-774697758 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:20:54 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-284025d2-94e9-4ce7-a741-9b6ea738e3a9 tempest-CinderUnicodeTest-774697758 None] Deleted volume successfully. Jun 24 05:20:55 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-284025d2-94e9-4ce7-a741-9b6ea738e3a9 tempest-CinderUnicodeTest-774697758 None] Lock "cinder-a0c05576-856e-462b-a60c-0f9190cd3a40-delete_volume" released by "delete_volume" :: held 2.585s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:20:55 devstack sudo[114738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-859b0a9b-dc33-4780-a776-f00e805a9279 Jun 24 05:20:55 devstack sudo[114738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:55 devstack sudo[114735]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e329fc50-da6e-48ef-9459-bc6f1da3c022 tempest-VolumeDependencyTests-1774128313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a" returned: 0 in 0.891s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:55 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e329fc50-da6e-48ef-9459-bc6f1da3c022 tempest-VolumeDependencyTests-1774128313 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:20:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e329fc50-da6e-48ef-9459-bc6f1da3c022 tempest-VolumeDependencyTests-1774128313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:20:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5176ba21-e001-41a5-92ed-e48ed03d421e tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.613s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:55 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-5176ba21-e001-41a5-92ed-e48ed03d421e tempest-CreateVolumesFromSourceVolumeTest-829686924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:20:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-925416025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f84726a1-bf20-43a4-9f58-387147e41057,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29c19ed5956f4ae59db533696891afd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:20:51Z,use_quota=True,user_id='a275c448916f496284ab737a12644249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:20:55 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-5176ba21-e001-41a5-92ed-e48ed03d421e tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Creating volume f84726a1-bf20-43a4-9f58-387147e41057 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:20:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5176ba21-e001-41a5-92ed-e48ed03d421e tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5176ba21-e001-41a5-92ed-e48ed03d421e tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:55 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-5176ba21-e001-41a5-92ed-e48ed03d421e tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:20:55 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-5176ba21-e001-41a5-92ed-e48ed03d421e tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:20:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5176ba21-e001-41a5-92ed-e48ed03d421e tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:20:55 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-5176ba21-e001-41a5-92ed-e48ed03d421e tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:20:55 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-5176ba21-e001-41a5-92ed-e48ed03d421e tempest-CreateVolumesFromSourceVolumeTest-829686924 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:20:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5176ba21-e001-41a5-92ed-e48ed03d421e tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f84726a1-bf20-43a4-9f58-387147e41057 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:55 devstack sudo[114741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f84726a1-bf20-43a4-9f58-387147e41057 1073741824 Jun 24 05:20:55 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e329fc50-da6e-48ef-9459-bc6f1da3c022 tempest-VolumeDependencyTests-1774128313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f71ec58f-34c1-4a8b-a9fe-941bb6bcb81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4771b250-f68d-4304-9ea4-56b40579eb8a', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:55 devstack sudo[114741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:55 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e329fc50-da6e-48ef-9459-bc6f1da3c022 tempest-VolumeDependencyTests-1774128313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf18caa6-ebd2-4fc3-ad88-f6b1351ded28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:55 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-e329fc50-da6e-48ef-9459-bc6f1da3c022 tempest-VolumeDependencyTests-1774128313 None] Volume volume-4771b250-f68d-4304-9ea4-56b40579eb8a (4771b250-f68d-4304-9ea4-56b40579eb8a): created successfully Jun 24 05:20:55 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e329fc50-da6e-48ef-9459-bc6f1da3c022 tempest-VolumeDependencyTests-1774128313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf18caa6-ebd2-4fc3-ad88-f6b1351ded28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:55 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-e329fc50-da6e-48ef-9459-bc6f1da3c022 tempest-VolumeDependencyTests-1774128313 None] Flow 'volume_create_manager' (381f78b4-d5a7-46d8-973d-a2de2542c370) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:20:55 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-e329fc50-da6e-48ef-9459-bc6f1da3c022 tempest-VolumeDependencyTests-1774128313 None] Created volume successfully. Jun 24 05:20:55 devstack sudo[114738]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a55b6113-6ca6-491a-ac0b-27365e791b05 tempest-CreateVolumesFromSnapshotTest-994771565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-859b0a9b-dc33-4780-a776-f00e805a9279" returned: 0 in 0.879s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a55b6113-6ca6-491a-ac0b-27365e791b05 tempest-CreateVolumesFromSnapshotTest-994771565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-859b0a9b-dc33-4780-a776-f00e805a9279 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:55 devstack sudo[114746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-859b0a9b-dc33-4780-a776-f00e805a9279 Jun 24 05:20:55 devstack sudo[114746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:56 devstack sudo[114741]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5176ba21-e001-41a5-92ed-e48ed03d421e tempest-CreateVolumesFromSourceVolumeTest-829686924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f84726a1-bf20-43a4-9f58-387147e41057 1073741824" returned: 0 in 1.100s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:56 devstack sudo[114746]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a55b6113-6ca6-491a-ac0b-27365e791b05 tempest-CreateVolumesFromSnapshotTest-994771565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-859b0a9b-dc33-4780-a776-f00e805a9279" returned: 0 in 0.824s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5176ba21-e001-41a5-92ed-e48ed03d421e tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f84726a1-bf20-43a4-9f58-387147e41057 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:56 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a55b6113-6ca6-491a-ac0b-27365e791b05 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "cinder-quobyte-859b0a9b-dc33-4780-a776-f00e805a9279" released by "delete_volume" :: held 1.791s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:20:56 devstack sudo[114753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f84726a1-bf20-43a4-9f58-387147e41057 Jun 24 05:20:56 devstack sudo[114753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-ab857e12-f565-4dd5-8960-fd099dff3f97 tempest-VolumeDependencyTests-1774128313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:56 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-a55b6113-6ca6-491a-ac0b-27365e791b05 tempest-CreateVolumesFromSnapshotTest-994771565 None] Created reservations ['56f633ec-7448-4ce4-9dc7-c944cafb7b6b', '83173e96-9861-4daf-ab34-9e315baa825b', '508cecab-1442-45f5-ae67-683a1a2489d2', '9f630336-f77a-40b6-9d33-bb5028781132'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:20:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a55b6113-6ca6-491a-ac0b-27365e791b05 tempest-CreateVolumesFromSnapshotTest-994771565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a55b6113-6ca6-491a-ac0b-27365e791b05 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:56 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a55b6113-6ca6-491a-ac0b-27365e791b05 tempest-CreateVolumesFromSnapshotTest-994771565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:20:56 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-a55b6113-6ca6-491a-ac0b-27365e791b05 tempest-CreateVolumesFromSnapshotTest-994771565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:20:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-a55b6113-6ca6-491a-ac0b-27365e791b05 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:20:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a55b6113-6ca6-491a-ac0b-27365e791b05 tempest-CreateVolumesFromSnapshotTest-994771565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:56 devstack sudo[114755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:20:56 devstack sudo[114755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:57 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9cda2adc-4e9f-456b-ac76-14901a227ef4 tempest-CreateVolumesFromSnapshotTest-994771565 None] Acquiring lock "cinder-3b53db94-9ad6-4463-99fa-ba38744bd513-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:20:57 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9cda2adc-4e9f-456b-ac76-14901a227ef4 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "cinder-3b53db94-9ad6-4463-99fa-ba38744bd513-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:20:57 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9cda2adc-4e9f-456b-ac76-14901a227ef4 tempest-CreateVolumesFromSnapshotTest-994771565 None] Acquiring lock "cinder-quobyte-3b53db94-9ad6-4463-99fa-ba38744bd513" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:20:57 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9cda2adc-4e9f-456b-ac76-14901a227ef4 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "cinder-quobyte-3b53db94-9ad6-4463-99fa-ba38744bd513" acquired by "delete_volume" :: waited 0.017s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:20:57 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[51053f9c-6afa-430c-851a-da9afa123fc6]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:20:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9cda2adc-4e9f-456b-ac76-14901a227ef4 tempest-CreateVolumesFromSnapshotTest-994771565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-3b53db94-9ad6-4463-99fa-ba38744bd513 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:57 devstack sudo[114753]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-5176ba21-e001-41a5-92ed-e48ed03d421e tempest-CreateVolumesFromSourceVolumeTest-829686924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f84726a1-bf20-43a4-9f58-387147e41057" returned: 0 in 0.739s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:57 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-5176ba21-e001-41a5-92ed-e48ed03d421e tempest-CreateVolumesFromSourceVolumeTest-829686924 None] <== create_volume: return (1928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:20:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-5176ba21-e001-41a5-92ed-e48ed03d421e tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.931s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:20:57 devstack sudo[114758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-3b53db94-9ad6-4463-99fa-ba38744bd513 Jun 24 05:20:57 devstack sudo[114758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-ab857e12-f565-4dd5-8960-fd099dff3f97 tempest-VolumeDependencyTests-1774128313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.706s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:57 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5176ba21-e001-41a5-92ed-e48ed03d421e tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaa1616f-d41e-4ad4-853f-80c165646016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f84726a1-bf20-43a4-9f58-387147e41057', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:57 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5176ba21-e001-41a5-92ed-e48ed03d421e tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cb36460-7058-48fc-83d8-edfe7c2e9b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:57 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-ab857e12-f565-4dd5-8960-fd099dff3f97 tempest-VolumeDependencyTests-1774128313 None] Creating offline snapshot 961301b7-aab9-4420-a88f-d0fb048d477d of volume 4771b250-f68d-4304-9ea4-56b40579eb8a {{(pid=93830) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 05:20:57 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-5176ba21-e001-41a5-92ed-e48ed03d421e tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Volume volume-f84726a1-bf20-43a4-9f58-387147e41057 (f84726a1-bf20-43a4-9f58-387147e41057): created successfully Jun 24 05:20:57 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5176ba21-e001-41a5-92ed-e48ed03d421e tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cb36460-7058-48fc-83d8-edfe7c2e9b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:57 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-5176ba21-e001-41a5-92ed-e48ed03d421e tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Flow 'volume_create_manager' (7144bd97-fb70-411a-b072-3e828c958acc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:20:57 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f3d5b4-0380-40a5-91b6-307340a2644f]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:20:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ab857e12-f565-4dd5-8960-fd099dff3f97 tempest-VolumeDependencyTests-1774128313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:57 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-5176ba21-e001-41a5-92ed-e48ed03d421e tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Created volume successfully. Jun 24 05:20:57 devstack sudo[114755]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:57 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-a55b6113-6ca6-491a-ac0b-27365e791b05 tempest-CreateVolumesFromSnapshotTest-994771565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.753s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:57 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-a55b6113-6ca6-491a-ac0b-27365e791b05 tempest-CreateVolumesFromSnapshotTest-994771565 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:20:57 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-a55b6113-6ca6-491a-ac0b-27365e791b05 tempest-CreateVolumesFromSnapshotTest-994771565 None] Deleted volume successfully. Jun 24 05:20:57 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-a55b6113-6ca6-491a-ac0b-27365e791b05 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "cinder-859b0a9b-dc33-4780-a776-f00e805a9279-delete_volume" released by "delete_volume" :: held 2.842s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:20:57 devstack sudo[114761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a Jun 24 05:20:57 devstack sudo[114761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:58 devstack sudo[114758]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9cda2adc-4e9f-456b-ac76-14901a227ef4 tempest-CreateVolumesFromSnapshotTest-994771565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-3b53db94-9ad6-4463-99fa-ba38744bd513" returned: 0 in 0.837s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9cda2adc-4e9f-456b-ac76-14901a227ef4 tempest-CreateVolumesFromSnapshotTest-994771565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-3b53db94-9ad6-4463-99fa-ba38744bd513 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:58 devstack sudo[114766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-3b53db94-9ad6-4463-99fa-ba38744bd513 Jun 24 05:20:58 devstack sudo[114766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:58 devstack sudo[114761]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ab857e12-f565-4dd5-8960-fd099dff3f97 tempest-VolumeDependencyTests-1774128313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a" returned: 0 in 0.940s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ab857e12-f565-4dd5-8960-fd099dff3f97 tempest-VolumeDependencyTests-1774128313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a.961301b7-aab9-4420-a88f-d0fb048d477d 1G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:58 devstack sudo[114772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a.961301b7-aab9-4420-a88f-d0fb048d477d 1G Jun 24 05:20:58 devstack sudo[114772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:58 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-13a0dcbd-f672-4114-abd9-34221a26b84c tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:20:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-13a0dcbd-f672-4114-abd9-34221a26b84c tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Flow 'volume_create_manager' (b4430c96-2dfd-40b5-9d4c-38e9cb6cb11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:20:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-13a0dcbd-f672-4114-abd9-34221a26b84c tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0c14c99-08b2-470a-9fef-c4d16017b41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-13a0dcbd-f672-4114-abd9-34221a26b84c tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0c14c99-08b2-470a-9fef-c4d16017b41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-420732710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f2ce93c-c3b2-44c1-88b5-73a787164307,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29c19ed5956f4ae59db533696891afd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:20:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:20:59Z,use_quota=True,user_id='a275c448916f496284ab737a12644249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-13a0dcbd-f672-4114-abd9-34221a26b84c tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c194bfc5-a9a3-4b61-afe6-31a3d335311a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-13a0dcbd-f672-4114-abd9-34221a26b84c tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c194bfc5-a9a3-4b61-afe6-31a3d335311a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-13a0dcbd-f672-4114-abd9-34221a26b84c tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85fd309a-df6d-4042-90b9-0167063608a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-13a0dcbd-f672-4114-abd9-34221a26b84c tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85fd309a-df6d-4042-90b9-0167063608a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f2ce93c-c3b2-44c1-88b5-73a787164307', 'volume_name': 'volume-8f2ce93c-c3b2-44c1-88b5-73a787164307', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-13a0dcbd-f672-4114-abd9-34221a26b84c tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (221353e0-a079-4a4a-863a-66fa1ff406ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-13a0dcbd-f672-4114-abd9-34221a26b84c tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (221353e0-a079-4a4a-863a-66fa1ff406ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:58 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-13a0dcbd-f672-4114-abd9-34221a26b84c tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e4fd526-b5dc-4f4d-8854-9578ce8c69eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:58 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-13a0dcbd-f672-4114-abd9-34221a26b84c tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Volume 8f2ce93c-c3b2-44c1-88b5-73a787164307: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f2ce93c-c3b2-44c1-88b5-73a787164307', 'volume_size': 1} Jun 24 05:20:58 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-13a0dcbd-f672-4114-abd9-34221a26b84c tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:59 devstack sudo[114766]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9cda2adc-4e9f-456b-ac76-14901a227ef4 tempest-CreateVolumesFromSnapshotTest-994771565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-3b53db94-9ad6-4463-99fa-ba38744bd513" returned: 0 in 1.008s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:59 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9cda2adc-4e9f-456b-ac76-14901a227ef4 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "cinder-quobyte-3b53db94-9ad6-4463-99fa-ba38744bd513" released by "delete_volume" :: held 1.905s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:20:59 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-9cda2adc-4e9f-456b-ac76-14901a227ef4 tempest-CreateVolumesFromSnapshotTest-994771565 None] Created reservations ['c56b36cd-a575-4275-b97a-4157157d9c31', '09919900-58c8-4fa2-9675-f575de1d95c2', 'e4fe066c-6682-44ef-9f29-583be1d57115', 'c1742baa-5265-463e-bdc7-0055f4f1ef9b'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:20:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9cda2adc-4e9f-456b-ac76-14901a227ef4 tempest-CreateVolumesFromSnapshotTest-994771565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9cda2adc-4e9f-456b-ac76-14901a227ef4 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:20:59 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-9cda2adc-4e9f-456b-ac76-14901a227ef4 tempest-CreateVolumesFromSnapshotTest-994771565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:20:59 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-9cda2adc-4e9f-456b-ac76-14901a227ef4 tempest-CreateVolumesFromSnapshotTest-994771565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:20:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9cda2adc-4e9f-456b-ac76-14901a227ef4 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:20:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9cda2adc-4e9f-456b-ac76-14901a227ef4 tempest-CreateVolumesFromSnapshotTest-994771565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:59 devstack sudo[114778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:20:59 devstack sudo[114778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:20:59 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcfab3cc-0c9f-414e-94f1-0d7814741463 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:20:59 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fcfab3cc-0c9f-414e-94f1-0d7814741463 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Flow 'volume_create_manager' (a44bc530-c476-4239-a84d-9e5dfe0f4880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:20:59 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fcfab3cc-0c9f-414e-94f1-0d7814741463 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc4fb15a-576f-4707-aafd-7a466fcf5264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:59 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fcfab3cc-0c9f-414e-94f1-0d7814741463 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc4fb15a-576f-4707-aafd-7a466fcf5264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1846464674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6aed71a-6ecc-4c04-9e6a-d8bd8a2bf256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29c19ed5956f4ae59db533696891afd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:20:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:20:59Z,use_quota=True,user_id='a275c448916f496284ab737a12644249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:59 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fcfab3cc-0c9f-414e-94f1-0d7814741463 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65a713f6-b09e-46a5-91a1-3e268af5b514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:59 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fcfab3cc-0c9f-414e-94f1-0d7814741463 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65a713f6-b09e-46a5-91a1-3e268af5b514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:59 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fcfab3cc-0c9f-414e-94f1-0d7814741463 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed0b0f63-c8ab-4931-9dc9-908fd0ce7723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:59 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fcfab3cc-0c9f-414e-94f1-0d7814741463 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed0b0f63-c8ab-4931-9dc9-908fd0ce7723) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6aed71a-6ecc-4c04-9e6a-d8bd8a2bf256', 'volume_name': 'volume-a6aed71a-6ecc-4c04-9e6a-d8bd8a2bf256', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:59 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fcfab3cc-0c9f-414e-94f1-0d7814741463 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (088d1625-e180-45e4-a02a-0abab9b748c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:59 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fcfab3cc-0c9f-414e-94f1-0d7814741463 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (088d1625-e180-45e4-a02a-0abab9b748c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:20:59 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fcfab3cc-0c9f-414e-94f1-0d7814741463 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51288cc0-061b-4c1d-b8c2-07dcc6fb20ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:20:59 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-fcfab3cc-0c9f-414e-94f1-0d7814741463 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Volume a6aed71a-6ecc-4c04-9e6a-d8bd8a2bf256: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6aed71a-6ecc-4c04-9e6a-d8bd8a2bf256', 'volume_size': 1} Jun 24 05:20:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fcfab3cc-0c9f-414e-94f1-0d7814741463 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:20:59 devstack sudo[114772]: pam_unix(sudo:session): session closed for user root Jun 24 05:20:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ab857e12-f565-4dd5-8960-fd099dff3f97 tempest-VolumeDependencyTests-1774128313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a.961301b7-aab9-4420-a88f-d0fb048d477d 1G" returned: 0 in 1.436s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:20:59 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ab857e12-f565-4dd5-8960-fd099dff3f97 tempest-VolumeDependencyTests-1774128313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4771b250-f68d-4304-9ea4-56b40579eb8a -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a.961301b7-aab9-4420-a88f-d0fb048d477d {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:20:59 devstack sudo[114780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4771b250-f68d-4304-9ea4-56b40579eb8a -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a.961301b7-aab9-4420-a88f-d0fb048d477d Jun 24 05:20:59 devstack sudo[114780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:00 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0880c06-2c54-4969-9bdd-e8eef3aaf819 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:21:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-c0880c06-2c54-4969-9bdd-e8eef3aaf819 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Flow 'volume_create_manager' (8646b483-31f9-4201-ae05-4ed504318637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:21:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-c0880c06-2c54-4969-9bdd-e8eef3aaf819 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (586b72ba-01cd-4930-bc61-0e64d6d75cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:21:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-c0880c06-2c54-4969-9bdd-e8eef3aaf819 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (586b72ba-01cd-4930-bc61-0e64d6d75cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-879430008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d87c831-7cb3-43fe-8f7d-a11c1859558b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29c19ed5956f4ae59db533696891afd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:21:00Z,use_quota=True,user_id='a275c448916f496284ab737a12644249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:21:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-c0880c06-2c54-4969-9bdd-e8eef3aaf819 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05710ede-5c05-4e22-8298-6c9405167ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:21:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-c0880c06-2c54-4969-9bdd-e8eef3aaf819 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05710ede-5c05-4e22-8298-6c9405167ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:21:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-c0880c06-2c54-4969-9bdd-e8eef3aaf819 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eeb0502-3d67-4b85-8626-f7fee62a258e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:21:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-c0880c06-2c54-4969-9bdd-e8eef3aaf819 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eeb0502-3d67-4b85-8626-f7fee62a258e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d87c831-7cb3-43fe-8f7d-a11c1859558b', 'volume_name': 'volume-2d87c831-7cb3-43fe-8f7d-a11c1859558b', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:21:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-c0880c06-2c54-4969-9bdd-e8eef3aaf819 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (890fe041-c166-4f05-8fb3-c9de0f7ad53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:21:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-c0880c06-2c54-4969-9bdd-e8eef3aaf819 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (890fe041-c166-4f05-8fb3-c9de0f7ad53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:21:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-c0880c06-2c54-4969-9bdd-e8eef3aaf819 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10ece1ee-48ff-4872-99bf-7c774e0514a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:21:00 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-c0880c06-2c54-4969-9bdd-e8eef3aaf819 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Volume 2d87c831-7cb3-43fe-8f7d-a11c1859558b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d87c831-7cb3-43fe-8f7d-a11c1859558b', 'volume_size': 1} Jun 24 05:21:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-c0880c06-2c54-4969-9bdd-e8eef3aaf819 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:21:00 devstack sudo[114778]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9cda2adc-4e9f-456b-ac76-14901a227ef4 tempest-CreateVolumesFromSnapshotTest-994771565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.952s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:00 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-9cda2adc-4e9f-456b-ac76-14901a227ef4 tempest-CreateVolumesFromSnapshotTest-994771565 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:21:00 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-9cda2adc-4e9f-456b-ac76-14901a227ef4 tempest-CreateVolumesFromSnapshotTest-994771565 None] Deleted volume successfully. Jun 24 05:21:00 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-9cda2adc-4e9f-456b-ac76-14901a227ef4 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "cinder-3b53db94-9ad6-4463-99fa-ba38744bd513-delete_volume" released by "delete_volume" :: held 3.330s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:21:00 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-8fef0252-1bc7-4436-a686-d6cfd34307e9 tempest-CreateVolumesFromSnapshotTest-994771565 None] Acquiring lock "cinder-07e6b3c7-5f3c-436f-b55d-3903abe1d7aa-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:21:00 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-8fef0252-1bc7-4436-a686-d6cfd34307e9 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "cinder-07e6b3c7-5f3c-436f-b55d-3903abe1d7aa-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:21:00 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-8fef0252-1bc7-4436-a686-d6cfd34307e9 tempest-CreateVolumesFromSnapshotTest-994771565 None] Acquiring lock "cinder-quobyte-07e6b3c7-5f3c-436f-b55d-3903abe1d7aa" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:21:00 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-8fef0252-1bc7-4436-a686-d6cfd34307e9 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "cinder-quobyte-07e6b3c7-5f3c-436f-b55d-3903abe1d7aa" acquired by "delete_volume" :: waited 0.039s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:21:00 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bda324-e023-4cd9-b9d8-7ccc6a4846bf]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:21:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8fef0252-1bc7-4436-a686-d6cfd34307e9 tempest-CreateVolumesFromSnapshotTest-994771565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-07e6b3c7-5f3c-436f-b55d-3903abe1d7aa {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:00 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-706dd466-c2cb-4720-9fff-bce7f28614e9 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:21:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-706dd466-c2cb-4720-9fff-bce7f28614e9 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Flow 'volume_create_manager' (ab298736-cb59-4dbc-8aca-c8e02901df68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:21:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-706dd466-c2cb-4720-9fff-bce7f28614e9 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08939a6-b156-4628-97cd-d1e74ee35f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:21:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-706dd466-c2cb-4720-9fff-bce7f28614e9 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08939a6-b156-4628-97cd-d1e74ee35f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1181495622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96af417b-14fc-417b-bd50-c7e57b8121d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29c19ed5956f4ae59db533696891afd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:21:01Z,use_quota=True,user_id='a275c448916f496284ab737a12644249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:21:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-706dd466-c2cb-4720-9fff-bce7f28614e9 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b273b0c-0cdf-4933-8186-37587b4799d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:21:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-706dd466-c2cb-4720-9fff-bce7f28614e9 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b273b0c-0cdf-4933-8186-37587b4799d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:21:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-706dd466-c2cb-4720-9fff-bce7f28614e9 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e7600f2-a4f6-4a90-9e3c-a3ef7ea4a51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:21:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-706dd466-c2cb-4720-9fff-bce7f28614e9 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e7600f2-a4f6-4a90-9e3c-a3ef7ea4a51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96af417b-14fc-417b-bd50-c7e57b8121d6', 'volume_name': 'volume-96af417b-14fc-417b-bd50-c7e57b8121d6', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:21:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-706dd466-c2cb-4720-9fff-bce7f28614e9 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36aa76ab-115d-4424-a52d-baf148b92114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:21:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-706dd466-c2cb-4720-9fff-bce7f28614e9 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36aa76ab-115d-4424-a52d-baf148b92114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:21:00 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-706dd466-c2cb-4720-9fff-bce7f28614e9 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (942d3daa-83c1-495a-898c-f70a2be93d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:21:00 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-706dd466-c2cb-4720-9fff-bce7f28614e9 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Volume 96af417b-14fc-417b-bd50-c7e57b8121d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96af417b-14fc-417b-bd50-c7e57b8121d6', 'volume_size': 1} Jun 24 05:21:00 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-706dd466-c2cb-4720-9fff-bce7f28614e9 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:21:00 devstack sudo[114784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-07e6b3c7-5f3c-436f-b55d-3903abe1d7aa Jun 24 05:21:00 devstack sudo[114784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:01 devstack sudo[114780]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ab857e12-f565-4dd5-8960-fd099dff3f97 tempest-VolumeDependencyTests-1774128313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4771b250-f68d-4304-9ea4-56b40579eb8a -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a.961301b7-aab9-4420-a88f-d0fb048d477d" returned: 0 in 1.215s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:01 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-ab857e12-f565-4dd5-8960-fd099dff3f97 tempest-VolumeDependencyTests-1774128313 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a.961301b7-aab9-4420-a88f-d0fb048d477d is being set with open permissions: ugo+rw Jun 24 05:21:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ab857e12-f565-4dd5-8960-fd099dff3f97 tempest-VolumeDependencyTests-1774128313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a.961301b7-aab9-4420-a88f-d0fb048d477d {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:01 devstack sudo[114789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a.961301b7-aab9-4420-a88f-d0fb048d477d Jun 24 05:21:01 devstack sudo[114789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:01 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ae3ba0e-6373-496a-b1f2-17e81e9bddef tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:21:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2ae3ba0e-6373-496a-b1f2-17e81e9bddef tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Flow 'volume_create_manager' (bc29e219-30a9-4ece-90a0-dd39eb4961ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:21:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2ae3ba0e-6373-496a-b1f2-17e81e9bddef tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (228bd5c0-d35e-48ef-ae30-9f725d2e5eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:21:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2ae3ba0e-6373-496a-b1f2-17e81e9bddef tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (228bd5c0-d35e-48ef-ae30-9f725d2e5eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2029990592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50d84a44-7b1b-4570-8890-42fe7b4913d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29c19ed5956f4ae59db533696891afd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:21:01Z,use_quota=True,user_id='a275c448916f496284ab737a12644249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:21:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2ae3ba0e-6373-496a-b1f2-17e81e9bddef tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6414c5cd-17cc-42e5-a34d-8a5d594fe80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:21:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2ae3ba0e-6373-496a-b1f2-17e81e9bddef tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6414c5cd-17cc-42e5-a34d-8a5d594fe80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:21:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2ae3ba0e-6373-496a-b1f2-17e81e9bddef tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4690e74-7f6d-4282-b3c5-f0f0f743a02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:21:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2ae3ba0e-6373-496a-b1f2-17e81e9bddef tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4690e74-7f6d-4282-b3c5-f0f0f743a02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50d84a44-7b1b-4570-8890-42fe7b4913d4', 'volume_name': 'volume-50d84a44-7b1b-4570-8890-42fe7b4913d4', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:21:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2ae3ba0e-6373-496a-b1f2-17e81e9bddef tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e187140-7a4e-4f1d-a886-f337b1532873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:21:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2ae3ba0e-6373-496a-b1f2-17e81e9bddef tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e187140-7a4e-4f1d-a886-f337b1532873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:21:01 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2ae3ba0e-6373-496a-b1f2-17e81e9bddef tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4aadfc0-785a-4877-98d5-e9fb10277acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:21:01 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-2ae3ba0e-6373-496a-b1f2-17e81e9bddef tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Volume 50d84a44-7b1b-4570-8890-42fe7b4913d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50d84a44-7b1b-4570-8890-42fe7b4913d4', 'volume_size': 1} Jun 24 05:21:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-2ae3ba0e-6373-496a-b1f2-17e81e9bddef tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:21:01 devstack sudo[114784]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8fef0252-1bc7-4436-a686-d6cfd34307e9 tempest-CreateVolumesFromSnapshotTest-994771565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-07e6b3c7-5f3c-436f-b55d-3903abe1d7aa" returned: 0 in 0.999s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8fef0252-1bc7-4436-a686-d6cfd34307e9 tempest-CreateVolumesFromSnapshotTest-994771565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-07e6b3c7-5f3c-436f-b55d-3903abe1d7aa {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:01 devstack sudo[114795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-07e6b3c7-5f3c-436f-b55d-3903abe1d7aa Jun 24 05:21:01 devstack sudo[114795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:01 devstack sudo[114789]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ab857e12-f565-4dd5-8960-fd099dff3f97 tempest-VolumeDependencyTests-1774128313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a.961301b7-aab9-4420-a88f-d0fb048d477d" returned: 0 in 0.744s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:01 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ab857e12-f565-4dd5-8960-fd099dff3f97 tempest-VolumeDependencyTests-1774128313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:01 devstack sudo[114797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a.info Jun 24 05:21:01 devstack sudo[114797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:02 devstack sudo[114795]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8fef0252-1bc7-4436-a686-d6cfd34307e9 tempest-CreateVolumesFromSnapshotTest-994771565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-07e6b3c7-5f3c-436f-b55d-3903abe1d7aa" returned: 0 in 0.729s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:02 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-8fef0252-1bc7-4436-a686-d6cfd34307e9 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "cinder-quobyte-07e6b3c7-5f3c-436f-b55d-3903abe1d7aa" released by "delete_volume" :: held 1.788s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:21:02 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-8fef0252-1bc7-4436-a686-d6cfd34307e9 tempest-CreateVolumesFromSnapshotTest-994771565 None] Created reservations ['83259d2c-712b-4d06-a07f-2d9d84ba9cc1', '250e6f8a-2db2-4a0c-bc1e-e5859e9a7a63', '38feaa8f-89d4-4c9f-bc42-ac2fa514e36d', '170370db-ced6-41fb-9630-f5a217c884fb'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:21:02 devstack sudo[114797]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ab857e12-f565-4dd5-8960-fd099dff3f97 tempest-VolumeDependencyTests-1774128313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a.info" returned: 0 in 0.685s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:02 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-ab857e12-f565-4dd5-8960-fd099dff3f97 tempest-VolumeDependencyTests-1774128313 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a.info is being set with open permissions: ugo+rw Jun 24 05:21:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ab857e12-f565-4dd5-8960-fd099dff3f97 tempest-VolumeDependencyTests-1774128313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:02 devstack sudo[114801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a.info Jun 24 05:21:02 devstack sudo[114801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-8fef0252-1bc7-4436-a686-d6cfd34307e9 tempest-CreateVolumesFromSnapshotTest-994771565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:21:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-8fef0252-1bc7-4436-a686-d6cfd34307e9 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:21:02 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-8fef0252-1bc7-4436-a686-d6cfd34307e9 tempest-CreateVolumesFromSnapshotTest-994771565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:21:02 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-8fef0252-1bc7-4436-a686-d6cfd34307e9 tempest-CreateVolumesFromSnapshotTest-994771565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:21:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-8fef0252-1bc7-4436-a686-d6cfd34307e9 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:21:02 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8fef0252-1bc7-4436-a686-d6cfd34307e9 tempest-CreateVolumesFromSnapshotTest-994771565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:02 devstack sudo[114803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:21:02 devstack sudo[114803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:02 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-bd4c257c-b9d6-40ca-8d07-3a33445c2d93 tempest-CreateVolumesFromSnapshotTest-994771565 None] Acquiring lock "cinder-9c7b9a34-743d-4f97-ab81-cc5c2d57cdec-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:21:02 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-bd4c257c-b9d6-40ca-8d07-3a33445c2d93 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "cinder-9c7b9a34-743d-4f97-ab81-cc5c2d57cdec-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:21:03 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-bd4c257c-b9d6-40ca-8d07-3a33445c2d93 tempest-CreateVolumesFromSnapshotTest-994771565 None] Acquiring lock "cinder-quobyte-9c7b9a34-743d-4f97-ab81-cc5c2d57cdec" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:21:03 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-bd4c257c-b9d6-40ca-8d07-3a33445c2d93 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "cinder-quobyte-9c7b9a34-743d-4f97-ab81-cc5c2d57cdec" acquired by "delete_volume" :: waited 0.026s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:21:03 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[591802b7-5a6e-426a-97c4-e0f0006771a1]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:21:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-bd4c257c-b9d6-40ca-8d07-3a33445c2d93 tempest-CreateVolumesFromSnapshotTest-994771565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9c7b9a34-743d-4f97-ab81-cc5c2d57cdec {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:03 devstack sudo[114805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9c7b9a34-743d-4f97-ab81-cc5c2d57cdec Jun 24 05:21:03 devstack sudo[114805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:03 devstack sudo[114801]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ab857e12-f565-4dd5-8960-fd099dff3f97 tempest-VolumeDependencyTests-1774128313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a.info" returned: 0 in 0.847s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:03 devstack sudo[114803]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-ab857e12-f565-4dd5-8960-fd099dff3f97 tempest-VolumeDependencyTests-1774128313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.014s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:21:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-13a0dcbd-f672-4114-abd9-34221a26b84c tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.421s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:21:03 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-13a0dcbd-f672-4114-abd9-34221a26b84c tempest-CreateVolumesFromSourceVolumeTest-829686924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-420732710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f2ce93c-c3b2-44c1-88b5-73a787164307,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29c19ed5956f4ae59db533696891afd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:20:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:20:59Z,use_quota=True,user_id='a275c448916f496284ab737a12644249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:21:03 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-13a0dcbd-f672-4114-abd9-34221a26b84c tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Creating volume 8f2ce93c-c3b2-44c1-88b5-73a787164307 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:21:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-13a0dcbd-f672-4114-abd9-34221a26b84c tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:21:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-13a0dcbd-f672-4114-abd9-34221a26b84c tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:21:03 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-13a0dcbd-f672-4114-abd9-34221a26b84c tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:21:03 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-13a0dcbd-f672-4114-abd9-34221a26b84c tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:21:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-13a0dcbd-f672-4114-abd9-34221a26b84c tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:21:03 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-13a0dcbd-f672-4114-abd9-34221a26b84c tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:21:03 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-13a0dcbd-f672-4114-abd9-34221a26b84c tempest-CreateVolumesFromSourceVolumeTest-829686924 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:21:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-13a0dcbd-f672-4114-abd9-34221a26b84c tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-8f2ce93c-c3b2-44c1-88b5-73a787164307 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-8fef0252-1bc7-4436-a686-d6cfd34307e9 tempest-CreateVolumesFromSnapshotTest-994771565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.857s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:03 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-8fef0252-1bc7-4436-a686-d6cfd34307e9 tempest-CreateVolumesFromSnapshotTest-994771565 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:21:03 devstack sudo[114809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-8f2ce93c-c3b2-44c1-88b5-73a787164307 1073741824 Jun 24 05:21:03 devstack sudo[114809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:03 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-8fef0252-1bc7-4436-a686-d6cfd34307e9 tempest-CreateVolumesFromSnapshotTest-994771565 None] Deleted volume successfully. Jun 24 05:21:03 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-ab857e12-f565-4dd5-8960-fd099dff3f97 tempest-VolumeDependencyTests-1774128313 None] Create snapshot completed successfully Jun 24 05:21:03 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-8fef0252-1bc7-4436-a686-d6cfd34307e9 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "cinder-07e6b3c7-5f3c-436f-b55d-3903abe1d7aa-delete_volume" released by "delete_volume" :: held 2.929s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:21:03 devstack sudo[114805]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-bd4c257c-b9d6-40ca-8d07-3a33445c2d93 tempest-CreateVolumesFromSnapshotTest-994771565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9c7b9a34-743d-4f97-ab81-cc5c2d57cdec" returned: 0 in 0.862s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:03 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-bd4c257c-b9d6-40ca-8d07-3a33445c2d93 tempest-CreateVolumesFromSnapshotTest-994771565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9c7b9a34-743d-4f97-ab81-cc5c2d57cdec {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:03 devstack sudo[114814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9c7b9a34-743d-4f97-ab81-cc5c2d57cdec Jun 24 05:21:03 devstack sudo[114814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:04 devstack sudo[114809]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-13a0dcbd-f672-4114-abd9-34221a26b84c tempest-CreateVolumesFromSourceVolumeTest-829686924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-8f2ce93c-c3b2-44c1-88b5-73a787164307 1073741824" returned: 0 in 1.077s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:04 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-13a0dcbd-f672-4114-abd9-34221a26b84c tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-8f2ce93c-c3b2-44c1-88b5-73a787164307 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:04 devstack sudo[114820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-8f2ce93c-c3b2-44c1-88b5-73a787164307 Jun 24 05:21:04 devstack sudo[114820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:04 devstack sudo[114814]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-bd4c257c-b9d6-40ca-8d07-3a33445c2d93 tempest-CreateVolumesFromSnapshotTest-994771565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-9c7b9a34-743d-4f97-ab81-cc5c2d57cdec" returned: 0 in 1.047s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:05 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-bd4c257c-b9d6-40ca-8d07-3a33445c2d93 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "cinder-quobyte-9c7b9a34-743d-4f97-ab81-cc5c2d57cdec" released by "delete_volume" :: held 1.985s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:21:05 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-bd4c257c-b9d6-40ca-8d07-3a33445c2d93 tempest-CreateVolumesFromSnapshotTest-994771565 None] Created reservations ['dadd5450-cb53-4a09-9d0b-27b1e4f3e01c', 'c18ace24-5712-4c12-9ec0-20af08d0a3a0', 'aa9a3a07-fe9e-467e-9f6d-45145fddbf21', '2a2a09fc-f133-480d-999f-0285547c9352'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:21:05 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:21:05 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-08938c09-efd0-4551-a2f4-2f69c0b8b7b9 tempest-CreateVolumesFromSnapshotTest-994771565 None] Acquiring lock "cinder-c60c6f5b-7164-42d2-b7fa-b657860dc08c-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:21:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-bd4c257c-b9d6-40ca-8d07-3a33445c2d93 tempest-CreateVolumesFromSnapshotTest-994771565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:21:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-bd4c257c-b9d6-40ca-8d07-3a33445c2d93 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:21:05 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-bd4c257c-b9d6-40ca-8d07-3a33445c2d93 tempest-CreateVolumesFromSnapshotTest-994771565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:21:05 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-bd4c257c-b9d6-40ca-8d07-3a33445c2d93 tempest-CreateVolumesFromSnapshotTest-994771565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:21:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-bd4c257c-b9d6-40ca-8d07-3a33445c2d93 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:21:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-bd4c257c-b9d6-40ca-8d07-3a33445c2d93 tempest-CreateVolumesFromSnapshotTest-994771565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:05 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Flow 'volume_create_manager' (e75ea261-0705-49d2-89ab-3e6489187862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:21:05 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b069c3c-5be7-493c-b719-939a5f5e9c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:21:05 devstack sudo[114820]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:05 devstack sudo[114830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:21:05 devstack sudo[114830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:05 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-08938c09-efd0-4551-a2f4-2f69c0b8b7b9 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "cinder-c60c6f5b-7164-42d2-b7fa-b657860dc08c-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:21:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-13a0dcbd-f672-4114-abd9-34221a26b84c tempest-CreateVolumesFromSourceVolumeTest-829686924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-8f2ce93c-c3b2-44c1-88b5-73a787164307" returned: 0 in 0.869s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:05 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-13a0dcbd-f672-4114-abd9-34221a26b84c tempest-CreateVolumesFromSourceVolumeTest-829686924 None] <== create_volume: return (2014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:21:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-13a0dcbd-f672-4114-abd9-34221a26b84c tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.017s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:21:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fcfab3cc-0c9f-414e-94f1-0d7814741463 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.941s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:21:05 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-fcfab3cc-0c9f-414e-94f1-0d7814741463 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1846464674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6aed71a-6ecc-4c04-9e6a-d8bd8a2bf256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29c19ed5956f4ae59db533696891afd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:20:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:20:59Z,use_quota=True,user_id='a275c448916f496284ab737a12644249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:21:05 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-fcfab3cc-0c9f-414e-94f1-0d7814741463 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Creating volume a6aed71a-6ecc-4c04-9e6a-d8bd8a2bf256 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:21:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fcfab3cc-0c9f-414e-94f1-0d7814741463 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:21:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fcfab3cc-0c9f-414e-94f1-0d7814741463 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:21:05 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-fcfab3cc-0c9f-414e-94f1-0d7814741463 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:21:05 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-fcfab3cc-0c9f-414e-94f1-0d7814741463 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:21:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fcfab3cc-0c9f-414e-94f1-0d7814741463 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:21:05 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-fcfab3cc-0c9f-414e-94f1-0d7814741463 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:21:05 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-fcfab3cc-0c9f-414e-94f1-0d7814741463 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:21:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fcfab3cc-0c9f-414e-94f1-0d7814741463 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a6aed71a-6ecc-4c04-9e6a-d8bd8a2bf256 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:05 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b069c3c-5be7-493c-b719-939a5f5e9c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-303416772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e37a5e00-c0a4-4c4e-941d-70079c4133df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc2f5f3f24d34479b017e3b209ac4ecc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=961301b7-aab9-4420-a88f-d0fb048d477d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:21:05Z,use_quota=True,user_id='122e153fba494e6fafed55226b846489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:21:05 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51f35d44-e528-4bc8-b43a-ac3160b3e5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:21:05 devstack sudo[114832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a6aed71a-6ecc-4c04-9e6a-d8bd8a2bf256 1073741824 Jun 24 05:21:05 devstack sudo[114832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:05 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51f35d44-e528-4bc8-b43a-ac3160b3e5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:21:05 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (624bde4a-7550-422f-9a3a-40c1b9df4375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:21:05 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (624bde4a-7550-422f-9a3a-40c1b9df4375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e37a5e00-c0a4-4c4e-941d-70079c4133df', 'volume_name': 'volume-e37a5e00-c0a4-4c4e-941d-70079c4133df', 'volume_size': 1, 'snapshot_id': '961301b7-aab9-4420-a88f-d0fb048d477d'}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:21:05 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4318edcf-8e64-49e1-b855-43a433542899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:21:05 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4318edcf-8e64-49e1-b855-43a433542899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:21:05 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c751a75-182d-4ad1-9982-471a5f43b0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:21:05 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Volume e37a5e00-c0a4-4c4e-941d-70079c4133df: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e37a5e00-c0a4-4c4e-941d-70079c4133df', 'volume_size': 1, 'snapshot_id': '961301b7-aab9-4420-a88f-d0fb048d477d'} Jun 24 05:21:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:21:05 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-13a0dcbd-f672-4114-abd9-34221a26b84c tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e4fd526-b5dc-4f4d-8854-9578ce8c69eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f2ce93c-c3b2-44c1-88b5-73a787164307', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:21:05 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-13a0dcbd-f672-4114-abd9-34221a26b84c tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76041b97-e9cd-4ffb-b585-fc67d8798f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:21:05 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-08938c09-efd0-4551-a2f4-2f69c0b8b7b9 tempest-CreateVolumesFromSnapshotTest-994771565 None] Acquiring lock "cinder-quobyte-c60c6f5b-7164-42d2-b7fa-b657860dc08c" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:21:05 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-13a0dcbd-f672-4114-abd9-34221a26b84c tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Volume volume-8f2ce93c-c3b2-44c1-88b5-73a787164307 (8f2ce93c-c3b2-44c1-88b5-73a787164307): created successfully Jun 24 05:21:05 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-13a0dcbd-f672-4114-abd9-34221a26b84c tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76041b97-e9cd-4ffb-b585-fc67d8798f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:21:05 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-13a0dcbd-f672-4114-abd9-34221a26b84c tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Flow 'volume_create_manager' (b4430c96-2dfd-40b5-9d4c-38e9cb6cb11a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:21:05 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-08938c09-efd0-4551-a2f4-2f69c0b8b7b9 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "cinder-quobyte-c60c6f5b-7164-42d2-b7fa-b657860dc08c" acquired by "delete_volume" :: waited 0.033s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:21:05 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-13a0dcbd-f672-4114-abd9-34221a26b84c tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Created volume successfully. Jun 24 05:21:05 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[4805fb17-cae0-43eb-88b3-64d1855026c9]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:21:05 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-08938c09-efd0-4551-a2f4-2f69c0b8b7b9 tempest-CreateVolumesFromSnapshotTest-994771565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c60c6f5b-7164-42d2-b7fa-b657860dc08c {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:05 devstack sudo[114834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c60c6f5b-7164-42d2-b7fa-b657860dc08c Jun 24 05:21:05 devstack sudo[114834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:06 devstack sudo[114830]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-bd4c257c-b9d6-40ca-8d07-3a33445c2d93 tempest-CreateVolumesFromSnapshotTest-994771565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.852s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:06 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-bd4c257c-b9d6-40ca-8d07-3a33445c2d93 tempest-CreateVolumesFromSnapshotTest-994771565 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:21:06 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-bd4c257c-b9d6-40ca-8d07-3a33445c2d93 tempest-CreateVolumesFromSnapshotTest-994771565 None] Deleted volume successfully. Jun 24 05:21:06 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-bd4c257c-b9d6-40ca-8d07-3a33445c2d93 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "cinder-9c7b9a34-743d-4f97-ab81-cc5c2d57cdec-delete_volume" released by "delete_volume" :: held 3.302s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:21:06 devstack sudo[114834]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-08938c09-efd0-4551-a2f4-2f69c0b8b7b9 tempest-CreateVolumesFromSnapshotTest-994771565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c60c6f5b-7164-42d2-b7fa-b657860dc08c" returned: 0 in 0.997s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-08938c09-efd0-4551-a2f4-2f69c0b8b7b9 tempest-CreateVolumesFromSnapshotTest-994771565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c60c6f5b-7164-42d2-b7fa-b657860dc08c {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:06 devstack sudo[114832]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fcfab3cc-0c9f-414e-94f1-0d7814741463 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a6aed71a-6ecc-4c04-9e6a-d8bd8a2bf256 1073741824" returned: 0 in 1.220s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:06 devstack sudo[114844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c60c6f5b-7164-42d2-b7fa-b657860dc08c Jun 24 05:21:06 devstack sudo[114844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:06 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fcfab3cc-0c9f-414e-94f1-0d7814741463 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a6aed71a-6ecc-4c04-9e6a-d8bd8a2bf256 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:06 devstack sudo[114846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a6aed71a-6ecc-4c04-9e6a-d8bd8a2bf256 Jun 24 05:21:06 devstack sudo[114846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:07 devstack sudo[114844]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-08938c09-efd0-4551-a2f4-2f69c0b8b7b9 tempest-CreateVolumesFromSnapshotTest-994771565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-c60c6f5b-7164-42d2-b7fa-b657860dc08c" returned: 0 in 0.768s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:07 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-08938c09-efd0-4551-a2f4-2f69c0b8b7b9 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "cinder-quobyte-c60c6f5b-7164-42d2-b7fa-b657860dc08c" released by "delete_volume" :: held 1.840s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:21:07 devstack sudo[114846]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fcfab3cc-0c9f-414e-94f1-0d7814741463 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a6aed71a-6ecc-4c04-9e6a-d8bd8a2bf256" returned: 0 in 0.745s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:07 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-fcfab3cc-0c9f-414e-94f1-0d7814741463 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] <== create_volume: return (2016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:21:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-fcfab3cc-0c9f-414e-94f1-0d7814741463 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.020s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:21:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-c0880c06-2c54-4969-9bdd-e8eef3aaf819 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.288s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:21:07 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-c0880c06-2c54-4969-9bdd-e8eef3aaf819 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-879430008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d87c831-7cb3-43fe-8f7d-a11c1859558b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29c19ed5956f4ae59db533696891afd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:21:00Z,use_quota=True,user_id='a275c448916f496284ab737a12644249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:21:07 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-c0880c06-2c54-4969-9bdd-e8eef3aaf819 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Creating volume 2d87c831-7cb3-43fe-8f7d-a11c1859558b {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:21:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-c0880c06-2c54-4969-9bdd-e8eef3aaf819 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:21:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-c0880c06-2c54-4969-9bdd-e8eef3aaf819 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:21:07 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-c0880c06-2c54-4969-9bdd-e8eef3aaf819 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:21:07 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-c0880c06-2c54-4969-9bdd-e8eef3aaf819 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:21:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-c0880c06-2c54-4969-9bdd-e8eef3aaf819 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:21:07 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-c0880c06-2c54-4969-9bdd-e8eef3aaf819 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:21:07 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-c0880c06-2c54-4969-9bdd-e8eef3aaf819 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:21:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c0880c06-2c54-4969-9bdd-e8eef3aaf819 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-2d87c831-7cb3-43fe-8f7d-a11c1859558b 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:07 devstack sudo[114850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-2d87c831-7cb3-43fe-8f7d-a11c1859558b 1073741824 Jun 24 05:21:07 devstack sudo[114850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fcfab3cc-0c9f-414e-94f1-0d7814741463 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51288cc0-061b-4c1d-b8c2-07dcc6fb20ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6aed71a-6ecc-4c04-9e6a-d8bd8a2bf256', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:21:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fcfab3cc-0c9f-414e-94f1-0d7814741463 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8209f854-4d0a-4fbb-859a-cd8355012925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:21:07 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-fcfab3cc-0c9f-414e-94f1-0d7814741463 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Volume volume-a6aed71a-6ecc-4c04-9e6a-d8bd8a2bf256 (a6aed71a-6ecc-4c04-9e6a-d8bd8a2bf256): created successfully Jun 24 05:21:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fcfab3cc-0c9f-414e-94f1-0d7814741463 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8209f854-4d0a-4fbb-859a-cd8355012925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:21:07 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-fcfab3cc-0c9f-414e-94f1-0d7814741463 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Flow 'volume_create_manager' (a44bc530-c476-4239-a84d-9e5dfe0f4880) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:21:07 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-fcfab3cc-0c9f-414e-94f1-0d7814741463 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Created volume successfully. Jun 24 05:21:07 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-08938c09-efd0-4551-a2f4-2f69c0b8b7b9 tempest-CreateVolumesFromSnapshotTest-994771565 None] Created reservations ['44be717b-a65e-4197-af11-8a22e14e93d0', '5fd8af83-69b2-45cb-b229-486b30fb62d9', '6dfe3315-acaf-43dc-a621-5ede7b4f1e60', '8d881412-1045-4032-8faa-bf2ec07b09a7'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:21:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-08938c09-efd0-4551-a2f4-2f69c0b8b7b9 tempest-CreateVolumesFromSnapshotTest-994771565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:21:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-08938c09-efd0-4551-a2f4-2f69c0b8b7b9 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:21:07 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-08938c09-efd0-4551-a2f4-2f69c0b8b7b9 tempest-CreateVolumesFromSnapshotTest-994771565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:21:07 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-08938c09-efd0-4551-a2f4-2f69c0b8b7b9 tempest-CreateVolumesFromSnapshotTest-994771565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:21:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-08938c09-efd0-4551-a2f4-2f69c0b8b7b9 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:21:07 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-08938c09-efd0-4551-a2f4-2f69c0b8b7b9 tempest-CreateVolumesFromSnapshotTest-994771565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:07 devstack sudo[114852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:21:07 devstack sudo[114852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:08 devstack sudo[114850]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c0880c06-2c54-4969-9bdd-e8eef3aaf819 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-2d87c831-7cb3-43fe-8f7d-a11c1859558b 1073741824" returned: 0 in 1.022s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c0880c06-2c54-4969-9bdd-e8eef3aaf819 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-2d87c831-7cb3-43fe-8f7d-a11c1859558b {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:08 devstack sudo[114862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-2d87c831-7cb3-43fe-8f7d-a11c1859558b Jun 24 05:21:08 devstack sudo[114862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:08 devstack sudo[114852]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-08938c09-efd0-4551-a2f4-2f69c0b8b7b9 tempest-CreateVolumesFromSnapshotTest-994771565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.849s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:08 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-08938c09-efd0-4551-a2f4-2f69c0b8b7b9 tempest-CreateVolumesFromSnapshotTest-994771565 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:21:08 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-08938c09-efd0-4551-a2f4-2f69c0b8b7b9 tempest-CreateVolumesFromSnapshotTest-994771565 None] Deleted volume successfully. Jun 24 05:21:08 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-7ecae509-df4c-4d99-b458-26a0d01f1eac tempest-CreateVolumesFromSnapshotTest-994771565 None] Acquiring lock "cinder-9e77c37e-b60c-42a1-9a9e-c6eaf81777b4-delete_snapshot" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:21:08 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-7ecae509-df4c-4d99-b458-26a0d01f1eac tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "cinder-9e77c37e-b60c-42a1-9a9e-c6eaf81777b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:21:08 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-7ecae509-df4c-4d99-b458-26a0d01f1eac tempest-CreateVolumesFromSnapshotTest-994771565 None] Acquiring lock "cinder-quobyte-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:21:08 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-08938c09-efd0-4551-a2f4-2f69c0b8b7b9 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "cinder-c60c6f5b-7164-42d2-b7fa-b657860dc08c-delete_volume" released by "delete_volume" :: held 3.421s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:21:08 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-7ecae509-df4c-4d99-b458-26a0d01f1eac tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "cinder-quobyte-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04" acquired by "delete_snapshot" :: waited 0.036s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:21:08 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-7ecae509-df4c-4d99-b458-26a0d01f1eac tempest-CreateVolumesFromSnapshotTest-994771565 None] Acquiring lock "cinder-quobyte-9e77c37e-b60c-42a1-9a9e-c6eaf81777b4" by "_delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:21:08 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-7ecae509-df4c-4d99-b458-26a0d01f1eac tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "cinder-quobyte-9e77c37e-b60c-42a1-9a9e-c6eaf81777b4" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:21:08 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-7ecae509-df4c-4d99-b458-26a0d01f1eac tempest-CreateVolumesFromSnapshotTest-994771565 None] Deleting offline snapshot 9e77c37e-b60c-42a1-9a9e-c6eaf81777b4 of volume f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04 {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 05:21:08 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-7ecae509-df4c-4d99-b458-26a0d01f1eac tempest-CreateVolumesFromSnapshotTest-994771565 None] snapshot_file for this snap is: volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04.9e77c37e-b60c-42a1-9a9e-c6eaf81777b4 {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 05:21:08 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda98a5c-0d90-48f8-82aa-93ce7dd5144f]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:21:08 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7ecae509-df4c-4d99-b458-26a0d01f1eac tempest-CreateVolumesFromSnapshotTest-994771565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04.9e77c37e-b60c-42a1-9a9e-c6eaf81777b4 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:09 devstack sudo[114864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04.9e77c37e-b60c-42a1-9a9e-c6eaf81777b4 Jun 24 05:21:09 devstack sudo[114864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:09 devstack sudo[114862]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-c0880c06-2c54-4969-9bdd-e8eef3aaf819 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-2d87c831-7cb3-43fe-8f7d-a11c1859558b" returned: 0 in 0.772s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-c0880c06-2c54-4969-9bdd-e8eef3aaf819 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] <== create_volume: return (1850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:21:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-c0880c06-2c54-4969-9bdd-e8eef3aaf819 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.853s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:21:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-706dd466-c2cb-4720-9fff-bce7f28614e9 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.568s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:21:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-706dd466-c2cb-4720-9fff-bce7f28614e9 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1181495622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96af417b-14fc-417b-bd50-c7e57b8121d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29c19ed5956f4ae59db533696891afd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:21:01Z,use_quota=True,user_id='a275c448916f496284ab737a12644249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:21:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-706dd466-c2cb-4720-9fff-bce7f28614e9 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Creating volume 96af417b-14fc-417b-bd50-c7e57b8121d6 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:21:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-706dd466-c2cb-4720-9fff-bce7f28614e9 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:21:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-706dd466-c2cb-4720-9fff-bce7f28614e9 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:21:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-706dd466-c2cb-4720-9fff-bce7f28614e9 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:21:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-706dd466-c2cb-4720-9fff-bce7f28614e9 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:21:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-706dd466-c2cb-4720-9fff-bce7f28614e9 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:21:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-706dd466-c2cb-4720-9fff-bce7f28614e9 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:21:09 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-706dd466-c2cb-4720-9fff-bce7f28614e9 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:21:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-706dd466-c2cb-4720-9fff-bce7f28614e9 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-96af417b-14fc-417b-bd50-c7e57b8121d6 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:09 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-c0880c06-2c54-4969-9bdd-e8eef3aaf819 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10ece1ee-48ff-4872-99bf-7c774e0514a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d87c831-7cb3-43fe-8f7d-a11c1859558b', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:21:09 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-c0880c06-2c54-4969-9bdd-e8eef3aaf819 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4a43b66-aff4-4282-a903-a0d2ddebf115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:21:09 devstack sudo[114868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-96af417b-14fc-417b-bd50-c7e57b8121d6 1073741824 Jun 24 05:21:09 devstack sudo[114868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:09 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-c0880c06-2c54-4969-9bdd-e8eef3aaf819 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Volume volume-2d87c831-7cb3-43fe-8f7d-a11c1859558b (2d87c831-7cb3-43fe-8f7d-a11c1859558b): created successfully Jun 24 05:21:09 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-c0880c06-2c54-4969-9bdd-e8eef3aaf819 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4a43b66-aff4-4282-a903-a0d2ddebf115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:21:09 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-c0880c06-2c54-4969-9bdd-e8eef3aaf819 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Flow 'volume_create_manager' (8646b483-31f9-4201-ae05-4ed504318637) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:21:09 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-c0880c06-2c54-4969-9bdd-e8eef3aaf819 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Created volume successfully. Jun 24 05:21:09 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 05:21:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:21:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:21:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:21:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:21:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:21:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:09 devstack sudo[114864]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7ecae509-df4c-4d99-b458-26a0d01f1eac tempest-CreateVolumesFromSnapshotTest-994771565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04.9e77c37e-b60c-42a1-9a9e-c6eaf81777b4" returned: 0 in 0.892s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-7ecae509-df4c-4d99-b458-26a0d01f1eac tempest-CreateVolumesFromSnapshotTest-994771565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:21:09 devstack sudo[114873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:21:09 devstack sudo[114873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:09 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28c1492-9a4a-418f-a6c9-6f4ad15232b1]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:21:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7ecae509-df4c-4d99-b458-26a0d01f1eac tempest-CreateVolumesFromSnapshotTest-994771565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:10 devstack sudo[114875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04 Jun 24 05:21:10 devstack sudo[114875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:10 devstack sudo[114868]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-706dd466-c2cb-4720-9fff-bce7f28614e9 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-96af417b-14fc-417b-bd50-c7e57b8121d6 1073741824" returned: 0 in 1.036s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-706dd466-c2cb-4720-9fff-bce7f28614e9 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-96af417b-14fc-417b-bd50-c7e57b8121d6 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:10 devstack sudo[114881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-96af417b-14fc-417b-bd50-c7e57b8121d6 Jun 24 05:21:10 devstack sudo[114881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:10 devstack sudo[114873]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.950s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:10 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:21:10 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager._thread_info {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 05:21:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread count: 29 {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 05:21:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread info: [<_MainThread(MainThread, started 130211312517248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 05:21:10 devstack sudo[114875]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7ecae509-df4c-4d99-b458-26a0d01f1eac tempest-CreateVolumesFromSnapshotTest-994771565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04" returned: 0 in 0.961s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7ecae509-df4c-4d99-b458-26a0d01f1eac tempest-CreateVolumesFromSnapshotTest-994771565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04.9e77c37e-b60c-42a1-9a9e-c6eaf81777b4 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:10 devstack sudo[114889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04.9e77c37e-b60c-42a1-9a9e-c6eaf81777b4 Jun 24 05:21:10 devstack sudo[114889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:11 devstack sudo[114881]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-706dd466-c2cb-4720-9fff-bce7f28614e9 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-96af417b-14fc-417b-bd50-c7e57b8121d6" returned: 0 in 0.814s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:11 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-706dd466-c2cb-4720-9fff-bce7f28614e9 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] <== create_volume: return (1911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:21:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-706dd466-c2cb-4720-9fff-bce7f28614e9 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.914s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:21:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-2ae3ba0e-6373-496a-b1f2-17e81e9bddef tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.014s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:21:11 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-2ae3ba0e-6373-496a-b1f2-17e81e9bddef tempest-CreateVolumesFromSourceVolumeTest-829686924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2029990592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50d84a44-7b1b-4570-8890-42fe7b4913d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29c19ed5956f4ae59db533696891afd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:21:01Z,use_quota=True,user_id='a275c448916f496284ab737a12644249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:21:11 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-2ae3ba0e-6373-496a-b1f2-17e81e9bddef tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Creating volume 50d84a44-7b1b-4570-8890-42fe7b4913d4 {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:21:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-2ae3ba0e-6373-496a-b1f2-17e81e9bddef tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:21:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-2ae3ba0e-6373-496a-b1f2-17e81e9bddef tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:21:11 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-2ae3ba0e-6373-496a-b1f2-17e81e9bddef tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:21:11 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-2ae3ba0e-6373-496a-b1f2-17e81e9bddef tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:21:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-2ae3ba0e-6373-496a-b1f2-17e81e9bddef tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:21:11 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-2ae3ba0e-6373-496a-b1f2-17e81e9bddef tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:21:11 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-2ae3ba0e-6373-496a-b1f2-17e81e9bddef tempest-CreateVolumesFromSourceVolumeTest-829686924 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:21:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2ae3ba0e-6373-496a-b1f2-17e81e9bddef tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-50d84a44-7b1b-4570-8890-42fe7b4913d4 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:11 devstack sudo[114892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-50d84a44-7b1b-4570-8890-42fe7b4913d4 1073741824 Jun 24 05:21:11 devstack sudo[114892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:11 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-706dd466-c2cb-4720-9fff-bce7f28614e9 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (942d3daa-83c1-495a-898c-f70a2be93d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96af417b-14fc-417b-bd50-c7e57b8121d6', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:21:11 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-706dd466-c2cb-4720-9fff-bce7f28614e9 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a9a98b6-dd0f-4604-b2cc-e9f3f65cd8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:21:11 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-706dd466-c2cb-4720-9fff-bce7f28614e9 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Volume volume-96af417b-14fc-417b-bd50-c7e57b8121d6 (96af417b-14fc-417b-bd50-c7e57b8121d6): created successfully Jun 24 05:21:11 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-706dd466-c2cb-4720-9fff-bce7f28614e9 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a9a98b6-dd0f-4604-b2cc-e9f3f65cd8e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:21:11 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-706dd466-c2cb-4720-9fff-bce7f28614e9 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Flow 'volume_create_manager' (ab298736-cb59-4dbc-8aca-c8e02901df68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:21:11 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-706dd466-c2cb-4720-9fff-bce7f28614e9 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Created volume successfully. Jun 24 05:21:11 devstack sudo[114889]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7ecae509-df4c-4d99-b458-26a0d01f1eac tempest-CreateVolumesFromSnapshotTest-994771565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04.9e77c37e-b60c-42a1-9a9e-c6eaf81777b4" returned: 0 in 1.000s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:11 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7ecae509-df4c-4d99-b458-26a0d01f1eac tempest-CreateVolumesFromSnapshotTest-994771565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04.9e77c37e-b60c-42a1-9a9e-c6eaf81777b4 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:11 devstack sudo[114898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04.9e77c37e-b60c-42a1-9a9e-c6eaf81777b4 Jun 24 05:21:11 devstack sudo[114898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:12 devstack sudo[114892]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2ae3ba0e-6373-496a-b1f2-17e81e9bddef tempest-CreateVolumesFromSourceVolumeTest-829686924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-50d84a44-7b1b-4570-8890-42fe7b4913d4 1073741824" returned: 0 in 1.014s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2ae3ba0e-6373-496a-b1f2-17e81e9bddef tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-50d84a44-7b1b-4570-8890-42fe7b4913d4 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:12 devstack sudo[114905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-50d84a44-7b1b-4570-8890-42fe7b4913d4 Jun 24 05:21:12 devstack sudo[114905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:12 devstack sudo[114898]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:12 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7ecae509-df4c-4d99-b458-26a0d01f1eac tempest-CreateVolumesFromSnapshotTest-994771565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04.9e77c37e-b60c-42a1-9a9e-c6eaf81777b4" returned: 0 in 0.721s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:12 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-7ecae509-df4c-4d99-b458-26a0d01f1eac tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "cinder-quobyte-9e77c37e-b60c-42a1-9a9e-c6eaf81777b4" released by "_delete_snapshot" :: held 3.730s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:21:12 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-7ecae509-df4c-4d99-b458-26a0d01f1eac tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "cinder-quobyte-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04" released by "delete_snapshot" :: held 3.756s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:21:12 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-7ecae509-df4c-4d99-b458-26a0d01f1eac tempest-CreateVolumesFromSnapshotTest-994771565 None] Created reservations ['e476a52a-6ce0-481c-8fa3-4b8ab90486e8', '2706bab2-3b8c-449c-bcde-6b80591e89a8', '00183f33-b6aa-429d-a2e2-7778bc7a6864', '6ef9807f-e5b0-41ae-929e-b5effda8ed16'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:21:12 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-7ecae509-df4c-4d99-b458-26a0d01f1eac tempest-CreateVolumesFromSnapshotTest-994771565 None] Delete snapshot completed successfully. Jun 24 05:21:12 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-7ecae509-df4c-4d99-b458-26a0d01f1eac tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "cinder-9e77c37e-b60c-42a1-9a9e-c6eaf81777b4-delete_snapshot" released by "delete_snapshot" :: held 3.936s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:21:13 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-d3d8a21c-eb3a-428c-aaad-10e8118d8139 tempest-CreateVolumesFromSnapshotTest-994771565 None] Acquiring lock "cinder-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:21:13 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-d3d8a21c-eb3a-428c-aaad-10e8118d8139 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "cinder-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:21:13 devstack sudo[114905]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2ae3ba0e-6373-496a-b1f2-17e81e9bddef tempest-CreateVolumesFromSourceVolumeTest-829686924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-50d84a44-7b1b-4570-8890-42fe7b4913d4" returned: 0 in 0.772s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:13 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-2ae3ba0e-6373-496a-b1f2-17e81e9bddef tempest-CreateVolumesFromSourceVolumeTest-829686924 None] <== create_volume: return (1841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:21:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-2ae3ba0e-6373-496a-b1f2-17e81e9bddef tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.844s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:21:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 7.553s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:21:13 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Acquiring lock "cinder-quobyte-961301b7-aab9-4420-a88f-d0fb048d477d-e37a5e00-c0a4-4c4e-941d-70079c4133df" by "_create_volume_from_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:21:13 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-d3d8a21c-eb3a-428c-aaad-10e8118d8139 tempest-CreateVolumesFromSnapshotTest-994771565 None] Acquiring lock "cinder-quobyte-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:21:13 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Lock "cinder-quobyte-961301b7-aab9-4420-a88f-d0fb048d477d-e37a5e00-c0a4-4c4e-941d-70079c4133df" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:21:13 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Creating volume e37a5e00-c0a4-4c4e-941d-70079c4133df from snapshot 961301b7-aab9-4420-a88f-d0fb048d477d {{(pid=93830) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 24 05:21:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:21:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:21:13 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:21:13 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:21:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:21:13 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:21:13 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Acquiring lock "cinder-quobyte-e37a5e00-c0a4-4c4e-941d-70079c4133df" by "_copy_volume_from_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:21:13 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-d3d8a21c-eb3a-428c-aaad-10e8118d8139 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "cinder-quobyte-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04" acquired by "delete_volume" :: waited 0.040s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:21:13 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2ae3ba0e-6373-496a-b1f2-17e81e9bddef tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4aadfc0-785a-4877-98d5-e9fb10277acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50d84a44-7b1b-4570-8890-42fe7b4913d4', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:21:13 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2ae3ba0e-6373-496a-b1f2-17e81e9bddef tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eac99566-4b49-45d7-a2a1-4cfc03b8ef27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:21:13 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[200bf26f-b823-4ba3-99a3-e71e39d71ec6]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:21:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d3d8a21c-eb3a-428c-aaad-10e8118d8139 tempest-CreateVolumesFromSnapshotTest-994771565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:13 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Lock "cinder-quobyte-e37a5e00-c0a4-4c4e-941d-70079c4133df" acquired by "_copy_volume_from_snapshot" :: waited 0.086s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:21:13 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] snapshot: 961301b7-aab9-4420-a88f-d0fb048d477d, volume: e37a5e00-c0a4-4c4e-941d-70079c4133df, {{(pid=93830) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 05:21:13 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-2ae3ba0e-6373-496a-b1f2-17e81e9bddef tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Volume volume-50d84a44-7b1b-4570-8890-42fe7b4913d4 (50d84a44-7b1b-4570-8890-42fe7b4913d4): created successfully Jun 24 05:21:13 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2ae3ba0e-6373-496a-b1f2-17e81e9bddef tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eac99566-4b49-45d7-a2a1-4cfc03b8ef27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:21:13 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2ae3ba0e-6373-496a-b1f2-17e81e9bddef tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Flow 'volume_create_manager' (bc29e219-30a9-4ece-90a0-dd39eb4961ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:21:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:21:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:21:13 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:21:13 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:21:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:21:13 devstack sudo[114910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04 Jun 24 05:21:13 devstack sudo[114910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:13 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-2ae3ba0e-6373-496a-b1f2-17e81e9bddef tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Created volume successfully. Jun 24 05:21:13 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde6b591-87f0-4756-81e6-67ebd94b54e8]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:21:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a.961301b7-aab9-4420-a88f-d0fb048d477d {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:13 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e185b8f7-7239-425f-9848-0d763d216447 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Acquiring lock "cinder-50d84a44-7b1b-4570-8890-42fe7b4913d4-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:21:13 devstack sudo[114912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a.961301b7-aab9-4420-a88f-d0fb048d477d Jun 24 05:21:13 devstack sudo[114912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:13 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e185b8f7-7239-425f-9848-0d763d216447 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "cinder-50d84a44-7b1b-4570-8890-42fe7b4913d4-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:21:13 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e185b8f7-7239-425f-9848-0d763d216447 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Acquiring lock "cinder-quobyte-50d84a44-7b1b-4570-8890-42fe7b4913d4" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:21:13 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e185b8f7-7239-425f-9848-0d763d216447 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "cinder-quobyte-50d84a44-7b1b-4570-8890-42fe7b4913d4" acquired by "delete_volume" :: waited 0.045s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:21:13 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddc73aa-7764-4856-8cc0-387b159787b5]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:21:13 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e185b8f7-7239-425f-9848-0d763d216447 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-50d84a44-7b1b-4570-8890-42fe7b4913d4 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:13 devstack sudo[114914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-50d84a44-7b1b-4570-8890-42fe7b4913d4 Jun 24 05:21:13 devstack sudo[114914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:14 devstack sudo[114910]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:14 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d3d8a21c-eb3a-428c-aaad-10e8118d8139 tempest-CreateVolumesFromSnapshotTest-994771565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04" returned: 0 in 1.003s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:14 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d3d8a21c-eb3a-428c-aaad-10e8118d8139 tempest-CreateVolumesFromSnapshotTest-994771565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:14 devstack sudo[114922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04 Jun 24 05:21:14 devstack sudo[114922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:14 devstack sudo[114912]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:14 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a.961301b7-aab9-4420-a88f-d0fb048d477d" returned: 0 in 1.023s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:14 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4771b250-f68d-4304-9ea4-56b40579eb8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:21:14 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a {{(pid=93830) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 05:21:14 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Creating direct copy from snapshot {{(pid=93830) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 05:21:14 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8a964b-f5dc-4a98-b94d-2ae81f9d78ed]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:21:14 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:14 devstack sudo[114924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a Jun 24 05:21:14 devstack sudo[114924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:14 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e185b8f7-7239-425f-9848-0d763d216447 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-50d84a44-7b1b-4570-8890-42fe7b4913d4" returned: 0 in 0.942s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:14 devstack sudo[114914]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:14 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e185b8f7-7239-425f-9848-0d763d216447 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-50d84a44-7b1b-4570-8890-42fe7b4913d4 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:14 devstack sudo[114929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-50d84a44-7b1b-4570-8890-42fe7b4913d4 Jun 24 05:21:14 devstack sudo[114929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:15 devstack sudo[114922]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d3d8a21c-eb3a-428c-aaad-10e8118d8139 tempest-CreateVolumesFromSnapshotTest-994771565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04" returned: 0 in 0.863s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:15 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-d3d8a21c-eb3a-428c-aaad-10e8118d8139 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "cinder-quobyte-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04" released by "delete_volume" :: held 1.959s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:21:15 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-d3d8a21c-eb3a-428c-aaad-10e8118d8139 tempest-CreateVolumesFromSnapshotTest-994771565 None] Created reservations ['ff30faeb-4d3d-45cb-b0e5-bb00947e2648', 'a308cc80-8020-4a0a-978c-cfc957f8f5b4', '62748ec3-2330-4c50-bc00-2e25ff0e3512', 'bd5fe112-d375-49b7-a141-e1efb743cd24'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:21:15 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:UPDATE=199,cinder:SELECT=140,cinder:DELETE=18,cinder:INSERT=43 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:21:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-d3d8a21c-eb3a-428c-aaad-10e8118d8139 tempest-CreateVolumesFromSnapshotTest-994771565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:21:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-d3d8a21c-eb3a-428c-aaad-10e8118d8139 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:21:15 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-d3d8a21c-eb3a-428c-aaad-10e8118d8139 tempest-CreateVolumesFromSnapshotTest-994771565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:21:15 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-d3d8a21c-eb3a-428c-aaad-10e8118d8139 tempest-CreateVolumesFromSnapshotTest-994771565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:21:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-d3d8a21c-eb3a-428c-aaad-10e8118d8139 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:21:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d3d8a21c-eb3a-428c-aaad-10e8118d8139 tempest-CreateVolumesFromSnapshotTest-994771565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:15 devstack sudo[114935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:21:15 devstack sudo[114935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:15 devstack sudo[114924]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a" returned: 0 in 1.019s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:15 devstack cinder-volume[93830]: DEBUG cinder.utils [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Path /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e37a5e00-c0a4-4c4e-941d-70079c4133df not found in is_blk_device check {{(pid=93830) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 05:21:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e37a5e00-c0a4-4c4e-941d-70079c4133df {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:15 devstack sudo[114938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e37a5e00-c0a4-4c4e-941d-70079c4133df Jun 24 05:21:15 devstack sudo[114938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:15 devstack sudo[114929]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e185b8f7-7239-425f-9848-0d763d216447 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-50d84a44-7b1b-4570-8890-42fe7b4913d4" returned: 0 in 0.862s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:15 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e185b8f7-7239-425f-9848-0d763d216447 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "cinder-quobyte-50d84a44-7b1b-4570-8890-42fe7b4913d4" released by "delete_volume" :: held 1.883s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:21:15 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-e185b8f7-7239-425f-9848-0d763d216447 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Created reservations ['c1efafc5-3a0e-45c1-8740-737cdd4483f4', '22cc2108-37c8-4315-a474-45dabf30e3c9', '5e50da51-a307-4b22-84cc-ff7053b1f1f8', '877d64d9-8a08-4d09-9ab9-6ccd40dbc5e6'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:21:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e185b8f7-7239-425f-9848-0d763d216447 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:21:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e185b8f7-7239-425f-9848-0d763d216447 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:21:15 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e185b8f7-7239-425f-9848-0d763d216447 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:21:15 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-e185b8f7-7239-425f-9848-0d763d216447 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:21:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-e185b8f7-7239-425f-9848-0d763d216447 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:21:15 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e185b8f7-7239-425f-9848-0d763d216447 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:15 devstack sudo[114940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:21:15 devstack sudo[114940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:15 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-4dc96f26-6d5a-4376-ba95-64150cf6faee tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Acquiring lock "cinder-96af417b-14fc-417b-bd50-c7e57b8121d6-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:21:16 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-4dc96f26-6d5a-4376-ba95-64150cf6faee tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "cinder-96af417b-14fc-417b-bd50-c7e57b8121d6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:21:16 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:SELECT=146,cinder:UPDATE=198,cinder:INSERT=57,cinder:DELETE=19 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:21:16 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-4dc96f26-6d5a-4376-ba95-64150cf6faee tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Acquiring lock "cinder-quobyte-96af417b-14fc-417b-bd50-c7e57b8121d6" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:21:16 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-4dc96f26-6d5a-4376-ba95-64150cf6faee tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "cinder-quobyte-96af417b-14fc-417b-bd50-c7e57b8121d6" acquired by "delete_volume" :: waited 0.043s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:21:16 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b6f681-834c-46ab-8a5f-25204226b67c]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:21:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4dc96f26-6d5a-4376-ba95-64150cf6faee tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-96af417b-14fc-417b-bd50-c7e57b8121d6 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:16 devstack sudo[114935]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:16 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-d3d8a21c-eb3a-428c-aaad-10e8118d8139 tempest-CreateVolumesFromSnapshotTest-994771565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.958s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:16 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-d3d8a21c-eb3a-428c-aaad-10e8118d8139 tempest-CreateVolumesFromSnapshotTest-994771565 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:21:16 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-d3d8a21c-eb3a-428c-aaad-10e8118d8139 tempest-CreateVolumesFromSnapshotTest-994771565 None] Deleted volume successfully. Jun 24 05:21:16 devstack sudo[114942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-96af417b-14fc-417b-bd50-c7e57b8121d6 Jun 24 05:21:16 devstack sudo[114942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:16 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-d3d8a21c-eb3a-428c-aaad-10e8118d8139 tempest-CreateVolumesFromSnapshotTest-994771565 None] Lock "cinder-f39f3ab0-bcd7-46bf-a479-cf4fcb68cb04-delete_volume" released by "delete_volume" :: held 3.287s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:21:17 devstack sudo[114940]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:17 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-e185b8f7-7239-425f-9848-0d763d216447 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 1.387s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:17 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-e185b8f7-7239-425f-9848-0d763d216447 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:21:17 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-e185b8f7-7239-425f-9848-0d763d216447 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Deleted volume successfully. Jun 24 05:21:17 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-e185b8f7-7239-425f-9848-0d763d216447 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "cinder-50d84a44-7b1b-4570-8890-42fe7b4913d4-delete_volume" released by "delete_volume" :: held 3.765s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:21:18 devstack sudo[114942]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4dc96f26-6d5a-4376-ba95-64150cf6faee tempest-CreateVolumesFromSourceVolumeTest-829686924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-96af417b-14fc-417b-bd50-c7e57b8121d6" returned: 0 in 1.987s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:18 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4dc96f26-6d5a-4376-ba95-64150cf6faee tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-96af417b-14fc-417b-bd50-c7e57b8121d6 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:18 devstack sudo[114960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-96af417b-14fc-417b-bd50-c7e57b8121d6 Jun 24 05:21:18 devstack sudo[114960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:20 devstack sudo[114960]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4dc96f26-6d5a-4376-ba95-64150cf6faee tempest-CreateVolumesFromSourceVolumeTest-829686924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-96af417b-14fc-417b-bd50-c7e57b8121d6" returned: 0 in 1.862s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:20 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-4dc96f26-6d5a-4376-ba95-64150cf6faee tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "cinder-quobyte-96af417b-14fc-417b-bd50-c7e57b8121d6" released by "delete_volume" :: held 3.967s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:21:20 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-4dc96f26-6d5a-4376-ba95-64150cf6faee tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Created reservations ['6778f903-e56e-45fd-96fb-849d4d16b072', 'a1f0cba0-88b6-47ec-b997-5c1fe3b6b3f0', '579b43d5-cf73-42d4-8dbe-5c1a4e96f390', '9a0b37ca-5280-40bf-81db-e0f05512c0a4'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:21:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4dc96f26-6d5a-4376-ba95-64150cf6faee tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:21:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4dc96f26-6d5a-4376-ba95-64150cf6faee tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:21:20 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-4dc96f26-6d5a-4376-ba95-64150cf6faee tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:21:20 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-4dc96f26-6d5a-4376-ba95-64150cf6faee tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:21:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-4dc96f26-6d5a-4376-ba95-64150cf6faee tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:21:20 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4dc96f26-6d5a-4376-ba95-64150cf6faee tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:20 devstack sudo[114963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:21:20 devstack sudo[114963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:21 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-ebb8e077-0471-4703-9b1f-ce8705a8dd26 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Acquiring lock "cinder-2d87c831-7cb3-43fe-8f7d-a11c1859558b-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:21:21 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-ebb8e077-0471-4703-9b1f-ce8705a8dd26 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "cinder-2d87c831-7cb3-43fe-8f7d-a11c1859558b-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:21:21 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-ebb8e077-0471-4703-9b1f-ce8705a8dd26 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Acquiring lock "cinder-quobyte-2d87c831-7cb3-43fe-8f7d-a11c1859558b" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:21:21 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-ebb8e077-0471-4703-9b1f-ce8705a8dd26 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "cinder-quobyte-2d87c831-7cb3-43fe-8f7d-a11c1859558b" acquired by "delete_volume" :: waited 0.026s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:21:21 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[4497ade6-c5e7-42eb-b5d0-6f484fd1bbbc]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:21:21 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ebb8e077-0471-4703-9b1f-ce8705a8dd26 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-2d87c831-7cb3-43fe-8f7d-a11c1859558b {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:21 devstack sudo[114966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-2d87c831-7cb3-43fe-8f7d-a11c1859558b Jun 24 05:21:21 devstack sudo[114966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:22 devstack sudo[114938]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e37a5e00-c0a4-4c4e-941d-70079c4133df" returned: 0 in 7.074s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:22 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77941dc-ab18-4033-a877-ee562a1794ec]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:21:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:22 devstack sudo[114963]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-4dc96f26-6d5a-4376-ba95-64150cf6faee tempest-CreateVolumesFromSourceVolumeTest-829686924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 2.060s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:22 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-4dc96f26-6d5a-4376-ba95-64150cf6faee tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:21:22 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-4dc96f26-6d5a-4376-ba95-64150cf6faee tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Deleted volume successfully. Jun 24 05:21:22 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-4dc96f26-6d5a-4376-ba95-64150cf6faee tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "cinder-96af417b-14fc-417b-bd50-c7e57b8121d6-delete_volume" released by "delete_volume" :: held 6.642s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:21:22 devstack sudo[114969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a Jun 24 05:21:22 devstack sudo[114969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:22 devstack sudo[114966]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ebb8e077-0471-4703-9b1f-ce8705a8dd26 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-2d87c831-7cb3-43fe-8f7d-a11c1859558b" returned: 0 in 1.386s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:22 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ebb8e077-0471-4703-9b1f-ce8705a8dd26 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-2d87c831-7cb3-43fe-8f7d-a11c1859558b {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:22 devstack sudo[114976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-2d87c831-7cb3-43fe-8f7d-a11c1859558b Jun 24 05:21:22 devstack sudo[114976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:23 devstack sudo[114976]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ebb8e077-0471-4703-9b1f-ce8705a8dd26 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-2d87c831-7cb3-43fe-8f7d-a11c1859558b" returned: 0 in 0.809s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:23 devstack sudo[114969]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a" returned: 0 in 1.179s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:23 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Image conversion details: src /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a, size 1024.00 MB, duration 7.08 sec, destination /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e37a5e00-c0a4-4c4e-941d-70079c4133df {{(pid=93830) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 05:21:23 devstack cinder-volume[93830]: INFO cinder.image.image_utils [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Converted 1024.00 MB image at 144.73 MB/s Jun 24 05:21:23 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e37a5e00-c0a4-4c4e-941d-70079c4133df is being set with open permissions: ugo+rw Jun 24 05:21:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e37a5e00-c0a4-4c4e-941d-70079c4133df {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:23 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-ebb8e077-0471-4703-9b1f-ce8705a8dd26 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "cinder-quobyte-2d87c831-7cb3-43fe-8f7d-a11c1859558b" released by "delete_volume" :: held 2.312s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:21:23 devstack sudo[114982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e37a5e00-c0a4-4c4e-941d-70079c4133df Jun 24 05:21:23 devstack sudo[114982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:23 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-ebb8e077-0471-4703-9b1f-ce8705a8dd26 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Created reservations ['e97ef2e0-f875-462c-b78d-dcf41d5c3700', 'be13ead2-6240-4ddc-a6a7-8722c56ed7e5', 'cded46f5-54f0-4f3c-a780-a7f9625c8d15', '4ef61631-a184-426d-8f4a-402bc6fca357'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:21:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-ebb8e077-0471-4703-9b1f-ce8705a8dd26 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:21:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-ebb8e077-0471-4703-9b1f-ce8705a8dd26 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:21:23 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-ebb8e077-0471-4703-9b1f-ce8705a8dd26 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:21:23 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-ebb8e077-0471-4703-9b1f-ce8705a8dd26 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:21:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-ebb8e077-0471-4703-9b1f-ce8705a8dd26 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:21:23 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ebb8e077-0471-4703-9b1f-ce8705a8dd26 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:23 devstack sudo[114984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:21:23 devstack sudo[114984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:24 devstack sudo[114982]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e37a5e00-c0a4-4c4e-941d-70079c4133df" returned: 0 in 0.982s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:24 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Lock "cinder-quobyte-e37a5e00-c0a4-4c4e-941d-70079c4133df" released by "_copy_volume_from_snapshot" :: held 11.445s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:21:24 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Lock "cinder-quobyte-961301b7-aab9-4420-a88f-d0fb048d477d-e37a5e00-c0a4-4c4e-941d-70079c4133df" released by "_create_volume_from_snapshot" :: held 11.555s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:21:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.584s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:21:24 devstack sudo[114984]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:24 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ebb8e077-0471-4703-9b1f-ce8705a8dd26 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.888s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:24 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-ebb8e077-0471-4703-9b1f-ce8705a8dd26 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:21:24 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-ebb8e077-0471-4703-9b1f-ce8705a8dd26 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Deleted volume successfully. Jun 24 05:21:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c751a75-182d-4ad1-9982-471a5f43b0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e37a5e00-c0a4-4c4e-941d-70079c4133df', 'volume_size': 1, 'snapshot_id': '961301b7-aab9-4420-a88f-d0fb048d477d'}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:21:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e8e7241-03c6-4512-84a3-abc28dd74a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:21:24 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-05ac8cba-ad69-4643-a6ab-189c12d2345f tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Acquiring lock "cinder-a6aed71a-6ecc-4c04-9e6a-d8bd8a2bf256-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:21:24 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Volume volume-e37a5e00-c0a4-4c4e-941d-70079c4133df (e37a5e00-c0a4-4c4e-941d-70079c4133df): created successfully Jun 24 05:21:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e8e7241-03c6-4512-84a3-abc28dd74a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:21:24 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Flow 'volume_create_manager' (e75ea261-0705-49d2-89ab-3e6489187862) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:21:24 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-ebb8e077-0471-4703-9b1f-ce8705a8dd26 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "cinder-2d87c831-7cb3-43fe-8f7d-a11c1859558b-delete_volume" released by "delete_volume" :: held 3.713s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:21:24 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-7d18fb13-c2ea-4291-b7b5-0f665250ca3a tempest-VolumeDependencyTests-1774128313 None] Created volume successfully. Jun 24 05:21:24 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-05ac8cba-ad69-4643-a6ab-189c12d2345f tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "cinder-a6aed71a-6ecc-4c04-9e6a-d8bd8a2bf256-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:21:25 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-05ac8cba-ad69-4643-a6ab-189c12d2345f tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Acquiring lock "cinder-quobyte-a6aed71a-6ecc-4c04-9e6a-d8bd8a2bf256" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:21:25 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-05ac8cba-ad69-4643-a6ab-189c12d2345f tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "cinder-quobyte-a6aed71a-6ecc-4c04-9e6a-d8bd8a2bf256" acquired by "delete_volume" :: waited 0.021s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:21:25 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e718893-6db4-4def-82fb-fc699944ec23]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:21:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-05ac8cba-ad69-4643-a6ab-189c12d2345f tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a6aed71a-6ecc-4c04-9e6a-d8bd8a2bf256 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:25 devstack sudo[114988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a6aed71a-6ecc-4c04-9e6a-d8bd8a2bf256 Jun 24 05:21:25 devstack sudo[114988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:25 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3aff86fd-405d-48ed-a34d-fc8bcbd95c42 tempest-VolumeDependencyTests-1774128313 None] Acquiring lock "cinder-961301b7-aab9-4420-a88f-d0fb048d477d-delete_snapshot" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:21:25 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3aff86fd-405d-48ed-a34d-fc8bcbd95c42 tempest-VolumeDependencyTests-1774128313 None] Lock "cinder-961301b7-aab9-4420-a88f-d0fb048d477d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:21:25 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3aff86fd-405d-48ed-a34d-fc8bcbd95c42 tempest-VolumeDependencyTests-1774128313 None] Acquiring lock "cinder-quobyte-4771b250-f68d-4304-9ea4-56b40579eb8a" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:21:25 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3aff86fd-405d-48ed-a34d-fc8bcbd95c42 tempest-VolumeDependencyTests-1774128313 None] Lock "cinder-quobyte-4771b250-f68d-4304-9ea4-56b40579eb8a" acquired by "delete_snapshot" :: waited 0.032s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:21:25 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3aff86fd-405d-48ed-a34d-fc8bcbd95c42 tempest-VolumeDependencyTests-1774128313 None] Acquiring lock "cinder-quobyte-961301b7-aab9-4420-a88f-d0fb048d477d" by "_delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:21:25 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3aff86fd-405d-48ed-a34d-fc8bcbd95c42 tempest-VolumeDependencyTests-1774128313 None] Lock "cinder-quobyte-961301b7-aab9-4420-a88f-d0fb048d477d" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:21:25 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-3aff86fd-405d-48ed-a34d-fc8bcbd95c42 tempest-VolumeDependencyTests-1774128313 None] Deleting offline snapshot 961301b7-aab9-4420-a88f-d0fb048d477d of volume 4771b250-f68d-4304-9ea4-56b40579eb8a {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 05:21:25 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-3aff86fd-405d-48ed-a34d-fc8bcbd95c42 tempest-VolumeDependencyTests-1774128313 None] snapshot_file for this snap is: volume-4771b250-f68d-4304-9ea4-56b40579eb8a.961301b7-aab9-4420-a88f-d0fb048d477d {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 05:21:25 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[7783df7a-5fd8-432a-9e4d-0e462d91f9d2]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:21:25 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3aff86fd-405d-48ed-a34d-fc8bcbd95c42 tempest-VolumeDependencyTests-1774128313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a.961301b7-aab9-4420-a88f-d0fb048d477d {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:25 devstack sudo[114992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a.961301b7-aab9-4420-a88f-d0fb048d477d Jun 24 05:21:25 devstack sudo[114992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:26 devstack sudo[114988]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-05ac8cba-ad69-4643-a6ab-189c12d2345f tempest-CreateVolumesFromSourceVolumeTest-829686924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a6aed71a-6ecc-4c04-9e6a-d8bd8a2bf256" returned: 0 in 1.045s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-05ac8cba-ad69-4643-a6ab-189c12d2345f tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a6aed71a-6ecc-4c04-9e6a-d8bd8a2bf256 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:26 devstack sudo[114997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a6aed71a-6ecc-4c04-9e6a-d8bd8a2bf256 Jun 24 05:21:26 devstack sudo[114997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:26 devstack sudo[114992]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3aff86fd-405d-48ed-a34d-fc8bcbd95c42 tempest-VolumeDependencyTests-1774128313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a.961301b7-aab9-4420-a88f-d0fb048d477d" returned: 0 in 1.108s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:26 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-3aff86fd-405d-48ed-a34d-fc8bcbd95c42 tempest-VolumeDependencyTests-1774128313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4771b250-f68d-4304-9ea4-56b40579eb8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:21:26 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10ac1f3-2260-4e6f-9275-7c13ed767a98]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:21:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3aff86fd-405d-48ed-a34d-fc8bcbd95c42 tempest-VolumeDependencyTests-1774128313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:26 devstack sudo[115002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a Jun 24 05:21:26 devstack sudo[115002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:26 devstack sudo[114997]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:26 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-05ac8cba-ad69-4643-a6ab-189c12d2345f tempest-CreateVolumesFromSourceVolumeTest-829686924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-a6aed71a-6ecc-4c04-9e6a-d8bd8a2bf256" returned: 0 in 0.807s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:26 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-05ac8cba-ad69-4643-a6ab-189c12d2345f tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "cinder-quobyte-a6aed71a-6ecc-4c04-9e6a-d8bd8a2bf256" released by "delete_volume" :: held 1.910s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:21:27 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-05ac8cba-ad69-4643-a6ab-189c12d2345f tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Created reservations ['2e86e41c-b984-4c04-a330-a65770f01663', '8efd4dd5-7f76-46cd-8aeb-31f9c0247618', '777bc348-e5a7-4777-9a62-3c8c24915531', 'ad10a7ee-fa13-45d8-a738-71ceded82400'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:21:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-05ac8cba-ad69-4643-a6ab-189c12d2345f tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:21:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-05ac8cba-ad69-4643-a6ab-189c12d2345f tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:21:27 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-05ac8cba-ad69-4643-a6ab-189c12d2345f tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:21:27 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-05ac8cba-ad69-4643-a6ab-189c12d2345f tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:21:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-05ac8cba-ad69-4643-a6ab-189c12d2345f tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:21:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-05ac8cba-ad69-4643-a6ab-189c12d2345f tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:27 devstack sudo[115005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:21:27 devstack sudo[115005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:27 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:21:27 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Flow 'volume_create_manager' (83cfd7dc-2e53-4981-a545-719bc35a4a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:21:27 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (581bbed8-9195-43d5-863c-35cb629369e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:21:27 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (581bbed8-9195-43d5-863c-35cb629369e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=794a618b-66a9-4000-9eb9-fc686b84dfee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe04ff00b82444d2a99fc1d363d19552',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:21:27Z,use_quota=True,user_id='48751d378dc8468483a42d4f51e037bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:21:27 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9e08770-6cee-4bf5-9c22-79be9dcee4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:21:27 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9e08770-6cee-4bf5-9c22-79be9dcee4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:21:27 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43a0ce85-1a38-4679-a875-0db3d8f5d8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:21:27 devstack cinder-volume[93830]: DEBUG cinder.image.glance [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Creating Keystone auth plugin from conf {{(pid=93830) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 24 05:21:27 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-ce4a2052-f6b6-4416-ba7e-47c91a71a142 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Acquiring lock "cinder-8f2ce93c-c3b2-44c1-88b5-73a787164307-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:21:27 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-ce4a2052-f6b6-4416-ba7e-47c91a71a142 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "cinder-8f2ce93c-c3b2-44c1-88b5-73a787164307-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:21:27 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-ce4a2052-f6b6-4416-ba7e-47c91a71a142 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Acquiring lock "cinder-quobyte-8f2ce93c-c3b2-44c1-88b5-73a787164307" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:21:27 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-ce4a2052-f6b6-4416-ba7e-47c91a71a142 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "cinder-quobyte-8f2ce93c-c3b2-44c1-88b5-73a787164307" acquired by "delete_volume" :: waited 0.026s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:21:27 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8f8cf0-e612-4516-a009-8a100e42a28e]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:21:27 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ce4a2052-f6b6-4416-ba7e-47c91a71a142 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-8f2ce93c-c3b2-44c1-88b5-73a787164307 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:27 devstack sudo[115007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-8f2ce93c-c3b2-44c1-88b5-73a787164307 Jun 24 05:21:27 devstack sudo[115007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:27 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43a0ce85-1a38-4679-a875-0db3d8f5d8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '794a618b-66a9-4000-9eb9-fc686b84dfee', 'volume_name': 'volume-794a618b-66a9-4000-9eb9-fc686b84dfee', 'volume_size': 1, 'image_id': '649d8684-7d56-44a0-aa67-4d834af0f649', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/649d8684-7d56-44a0-aa67-4d834af0f649', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '71ef2f87e56c117e31732237d36e942d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fe04ff00b82444d2a99fc1d363d19552', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2909a3080191eede0f68c94323ef868cd6ebc2f07d37b770d06aad13e51e97418cfc1267c3e80afc10f91bd8e6f4df132c0c4d3041d522f30b32fd8e897929e3', 'id': '649d8684-7d56-44a0-aa67-4d834af0f649', 'created_at': datetime.datetime(2026, 6, 24, 3, 21, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 3, 21, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/649d8684-7d56-44a0-aa67-4d834af0f649/file', 'properties': {}}, 'image_service': }' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:21:27 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abd81308-d380-40a2-b339-03f9618903a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:21:27 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abd81308-d380-40a2-b339-03f9618903a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:21:27 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98ad4618-2875-4dd9-a535-8bd25e0dcaa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:21:27 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Volume 794a618b-66a9-4000-9eb9-fc686b84dfee: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-794a618b-66a9-4000-9eb9-fc686b84dfee', 'volume_size': 1, 'image_id': '649d8684-7d56-44a0-aa67-4d834af0f649', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/649d8684-7d56-44a0-aa67-4d834af0f649', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '71ef2f87e56c117e31732237d36e942d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fe04ff00b82444d2a99fc1d363d19552', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2909a3080191eede0f68c94323ef868cd6ebc2f07d37b770d06aad13e51e97418cfc1267c3e80afc10f91bd8e6f4df132c0c4d3041d522f30b32fd8e897929e3', 'id': '649d8684-7d56-44a0-aa67-4d834af0f649', 'created_at': datetime.datetime(2026, 6, 24, 3, 21, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 3, 21, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/649d8684-7d56-44a0-aa67-4d834af0f649/file', 'properties': {}}, 'image_service': } Jun 24 05:21:27 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Trying to clone 794a618b-66a9-4000-9eb9-fc686b84dfee from image 649d8684-7d56-44a0-aa67-4d834af0f649 at location (None, [{'url': 'file:///opt/stack/data/glance/images/649d8684-7d56-44a0-aa67-4d834af0f649', 'metadata': {}}]). {{(pid=93830) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 24 05:21:27 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_649d8684-7d56-44a0-aa67-4d834af0f649_148pi2vndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93830) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 24 05:21:27 devstack cinder-volume[93830]: INFO cinder.image.image_utils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Image download 0.00 MB at 0.00 MB/s Jun 24 05:21:28 devstack sudo[115002]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3aff86fd-405d-48ed-a34d-fc8bcbd95c42 tempest-VolumeDependencyTests-1774128313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a" returned: 0 in 1.268s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3aff86fd-405d-48ed-a34d-fc8bcbd95c42 tempest-VolumeDependencyTests-1774128313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a.961301b7-aab9-4420-a88f-d0fb048d477d {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:28 devstack sudo[115013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a.961301b7-aab9-4420-a88f-d0fb048d477d Jun 24 05:21:28 devstack sudo[115013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:28 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54e8f83-960e-47fb-ba2c-3eaa29b7aef8]: (4, 'raw') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:21:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_649d8684-7d56-44a0-aa67-4d834af0f649_148pi2vndevstack@QuobyteHD {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:28 devstack sudo[115005]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-05ac8cba-ad69-4643-a6ab-189c12d2345f tempest-CreateVolumesFromSourceVolumeTest-829686924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.941s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:28 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-05ac8cba-ad69-4643-a6ab-189c12d2345f tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:21:28 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-05ac8cba-ad69-4643-a6ab-189c12d2345f tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Deleted volume successfully. Jun 24 05:21:28 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-05ac8cba-ad69-4643-a6ab-189c12d2345f tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "cinder-a6aed71a-6ecc-4c04-9e6a-d8bd8a2bf256-delete_volume" released by "delete_volume" :: held 3.242s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:21:28 devstack sudo[115015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_649d8684-7d56-44a0-aa67-4d834af0f649_148pi2vndevstack@QuobyteHD Jun 24 05:21:28 devstack sudo[115015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:28 devstack sudo[115007]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ce4a2052-f6b6-4416-ba7e-47c91a71a142 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-8f2ce93c-c3b2-44c1-88b5-73a787164307" returned: 0 in 1.214s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ce4a2052-f6b6-4416-ba7e-47c91a71a142 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-8f2ce93c-c3b2-44c1-88b5-73a787164307 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:28 devstack sudo[115020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-8f2ce93c-c3b2-44c1-88b5-73a787164307 Jun 24 05:21:28 devstack sudo[115020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:28 devstack sudo[115013]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3aff86fd-405d-48ed-a34d-fc8bcbd95c42 tempest-VolumeDependencyTests-1774128313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a.961301b7-aab9-4420-a88f-d0fb048d477d" returned: 0 in 0.955s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:28 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3aff86fd-405d-48ed-a34d-fc8bcbd95c42 tempest-VolumeDependencyTests-1774128313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a.961301b7-aab9-4420-a88f-d0fb048d477d {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:29 devstack sudo[115025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a.961301b7-aab9-4420-a88f-d0fb048d477d Jun 24 05:21:29 devstack sudo[115025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:29 devstack sudo[115015]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_649d8684-7d56-44a0-aa67-4d834af0f649_148pi2vndevstack@QuobyteHD" returned: 0 in 1.025s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_649d8684-7d56-44a0-aa67-4d834af0f649_148pi2vndevstack@QuobyteHD {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:29 devstack sudo[115029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_649d8684-7d56-44a0-aa67-4d834af0f649_148pi2vndevstack@QuobyteHD Jun 24 05:21:29 devstack sudo[115029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:29 devstack sudo[115020]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ce4a2052-f6b6-4416-ba7e-47c91a71a142 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-8f2ce93c-c3b2-44c1-88b5-73a787164307" returned: 0 in 0.776s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:29 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-ce4a2052-f6b6-4416-ba7e-47c91a71a142 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "cinder-quobyte-8f2ce93c-c3b2-44c1-88b5-73a787164307" released by "delete_volume" :: held 2.064s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:21:29 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-ce4a2052-f6b6-4416-ba7e-47c91a71a142 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Created reservations ['c629f708-1fd8-40c5-9fe0-1ff9a6fe5440', '16e34b9e-ebb5-426a-9449-bc5b305830ff', 'f1987643-59e0-42f2-abe5-28062e9818d3', 'f922415f-be08-4251-a625-6518addf0036'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:21:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-ce4a2052-f6b6-4416-ba7e-47c91a71a142 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:21:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-ce4a2052-f6b6-4416-ba7e-47c91a71a142 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:21:29 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-ce4a2052-f6b6-4416-ba7e-47c91a71a142 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:21:29 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-ce4a2052-f6b6-4416-ba7e-47c91a71a142 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:21:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-ce4a2052-f6b6-4416-ba7e-47c91a71a142 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:21:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ce4a2052-f6b6-4416-ba7e-47c91a71a142 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:29 devstack sudo[115033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:21:29 devstack sudo[115033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:29 devstack sudo[115025]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-3aff86fd-405d-48ed-a34d-fc8bcbd95c42 tempest-VolumeDependencyTests-1774128313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a.961301b7-aab9-4420-a88f-d0fb048d477d" returned: 0 in 0.853s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:29 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-958796ce-e580-45fa-b91d-93b4e4f18972 tempest-SnapshotDependencyTests-35630455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:21:29 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-958796ce-e580-45fa-b91d-93b4e4f18972 tempest-SnapshotDependencyTests-35630455 None] Flow 'volume_create_manager' (94d57d7b-1db1-4c30-8b2b-e4fe75b2653f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:21:29 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-958796ce-e580-45fa-b91d-93b4e4f18972 tempest-SnapshotDependencyTests-35630455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (125a2df1-ec41-4159-90bc-78c2747f5851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:21:29 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3aff86fd-405d-48ed-a34d-fc8bcbd95c42 tempest-VolumeDependencyTests-1774128313 None] Lock "cinder-quobyte-961301b7-aab9-4420-a88f-d0fb048d477d" released by "_delete_snapshot" :: held 4.367s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:21:29 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3aff86fd-405d-48ed-a34d-fc8bcbd95c42 tempest-VolumeDependencyTests-1774128313 None] Lock "cinder-quobyte-4771b250-f68d-4304-9ea4-56b40579eb8a" released by "delete_snapshot" :: held 4.413s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:21:29 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-958796ce-e580-45fa-b91d-93b4e4f18972 tempest-SnapshotDependencyTests-35630455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (125a2df1-ec41-4159-90bc-78c2747f5851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-180070361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed628166-3b80-46f6-8e61-52e1e051410a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53efa90b046f4a7a9c7adddc5dc150dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:21:30Z,use_quota=True,user_id='c2bc5fddae764ffa898fd9b6701e1ce3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:21:29 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-958796ce-e580-45fa-b91d-93b4e4f18972 tempest-SnapshotDependencyTests-35630455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4f0b378-4ea2-485c-9ecc-4aba5372a8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:21:29 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-958796ce-e580-45fa-b91d-93b4e4f18972 tempest-SnapshotDependencyTests-35630455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4f0b378-4ea2-485c-9ecc-4aba5372a8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:21:29 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-958796ce-e580-45fa-b91d-93b4e4f18972 tempest-SnapshotDependencyTests-35630455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08f9295c-a2ad-4957-bc87-f9c314c8ecbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:21:29 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-958796ce-e580-45fa-b91d-93b4e4f18972 tempest-SnapshotDependencyTests-35630455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08f9295c-a2ad-4957-bc87-f9c314c8ecbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed628166-3b80-46f6-8e61-52e1e051410a', 'volume_name': 'volume-ed628166-3b80-46f6-8e61-52e1e051410a', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:21:29 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-958796ce-e580-45fa-b91d-93b4e4f18972 tempest-SnapshotDependencyTests-35630455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (952fda85-994c-457a-a780-ffc6b9c950af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:21:29 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-958796ce-e580-45fa-b91d-93b4e4f18972 tempest-SnapshotDependencyTests-35630455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (952fda85-994c-457a-a780-ffc6b9c950af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:21:29 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-958796ce-e580-45fa-b91d-93b4e4f18972 tempest-SnapshotDependencyTests-35630455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9388692a-3646-4812-a855-29438fe0d405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:21:29 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-958796ce-e580-45fa-b91d-93b4e4f18972 tempest-SnapshotDependencyTests-35630455 None] Volume ed628166-3b80-46f6-8e61-52e1e051410a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed628166-3b80-46f6-8e61-52e1e051410a', 'volume_size': 1} Jun 24 05:21:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-958796ce-e580-45fa-b91d-93b4e4f18972 tempest-SnapshotDependencyTests-35630455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:21:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-958796ce-e580-45fa-b91d-93b4e4f18972 tempest-SnapshotDependencyTests-35630455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:21:29 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-958796ce-e580-45fa-b91d-93b4e4f18972 tempest-SnapshotDependencyTests-35630455 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-180070361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed628166-3b80-46f6-8e61-52e1e051410a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53efa90b046f4a7a9c7adddc5dc150dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:21:30Z,use_quota=True,user_id='c2bc5fddae764ffa898fd9b6701e1ce3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:21:29 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-958796ce-e580-45fa-b91d-93b4e4f18972 tempest-SnapshotDependencyTests-35630455 None] Creating volume ed628166-3b80-46f6-8e61-52e1e051410a {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:21:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-958796ce-e580-45fa-b91d-93b4e4f18972 tempest-SnapshotDependencyTests-35630455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:21:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-958796ce-e580-45fa-b91d-93b4e4f18972 tempest-SnapshotDependencyTests-35630455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:21:29 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-958796ce-e580-45fa-b91d-93b4e4f18972 tempest-SnapshotDependencyTests-35630455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:21:29 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-958796ce-e580-45fa-b91d-93b4e4f18972 tempest-SnapshotDependencyTests-35630455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:21:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-958796ce-e580-45fa-b91d-93b4e4f18972 tempest-SnapshotDependencyTests-35630455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:21:29 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-958796ce-e580-45fa-b91d-93b4e4f18972 tempest-SnapshotDependencyTests-35630455 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:21:29 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-958796ce-e580-45fa-b91d-93b4e4f18972 tempest-SnapshotDependencyTests-35630455 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:21:29 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-958796ce-e580-45fa-b91d-93b4e4f18972 tempest-SnapshotDependencyTests-35630455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:30 devstack sudo[115038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a 1073741824 Jun 24 05:21:30 devstack sudo[115038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:30 devstack sudo[115029]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_649d8684-7d56-44a0-aa67-4d834af0f649_148pi2vndevstack@QuobyteHD" returned: 1 in 0.911s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_649d8684-7d56-44a0-aa67-4d834af0f649_148pi2vndevstack@QuobyteHD' failed. Not Retrying. {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 05:21:30 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Temporary image 649d8684-7d56-44a0-aa67-4d834af0f649 is fetched for user 48751d378dc8468483a42d4f51e037bb. {{(pid=93830) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 24 05:21:30 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-3aff86fd-405d-48ed-a34d-fc8bcbd95c42 tempest-VolumeDependencyTests-1774128313 None] Created reservations ['1b05dacb-244f-400d-892f-23b1e5ec46e6', '6730c537-7952-42c8-ab92-0a4a767b28f6', '1e88537b-38e9-4520-9b68-aface7f10c13', '01c7bcfe-61c0-4d14-a768-c55223dcf8f1'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:21:30 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee834e2-baba-4ddd-aece-680d3205c319]: (4, 'raw') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:21:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_649d8684-7d56-44a0-aa67-4d834af0f649_148pi2vndevstack@QuobyteHD {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:30 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-3aff86fd-405d-48ed-a34d-fc8bcbd95c42 tempest-VolumeDependencyTests-1774128313 None] Delete snapshot completed successfully. Jun 24 05:21:30 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-3aff86fd-405d-48ed-a34d-fc8bcbd95c42 tempest-VolumeDependencyTests-1774128313 None] Lock "cinder-961301b7-aab9-4420-a88f-d0fb048d477d-delete_snapshot" released by "delete_snapshot" :: held 4.691s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:21:30 devstack sudo[115040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_649d8684-7d56-44a0-aa67-4d834af0f649_148pi2vndevstack@QuobyteHD Jun 24 05:21:30 devstack sudo[115040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:30 devstack sudo[115033]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-ce4a2052-f6b6-4416-ba7e-47c91a71a142 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.680s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:30 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-ce4a2052-f6b6-4416-ba7e-47c91a71a142 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:21:30 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-ce4a2052-f6b6-4416-ba7e-47c91a71a142 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Deleted volume successfully. Jun 24 05:21:30 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-ce4a2052-f6b6-4416-ba7e-47c91a71a142 tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "cinder-8f2ce93c-c3b2-44c1-88b5-73a787164307-delete_volume" released by "delete_volume" :: held 3.088s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:21:30 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-2d565390-f01c-410a-9536-bb5073096b8a tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Acquiring lock "cinder-f84726a1-bf20-43a4-9f58-387147e41057-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:21:30 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-2d565390-f01c-410a-9536-bb5073096b8a tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "cinder-f84726a1-bf20-43a4-9f58-387147e41057-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:21:30 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-2d565390-f01c-410a-9536-bb5073096b8a tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Acquiring lock "cinder-quobyte-f84726a1-bf20-43a4-9f58-387147e41057" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:21:30 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-72852fa9-b693-4e2b-bf5a-8349f1b55f46 tempest-VolumeDependencyTests-1774128313 None] Acquiring lock "cinder-4771b250-f68d-4304-9ea4-56b40579eb8a-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:21:30 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-2d565390-f01c-410a-9536-bb5073096b8a tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "cinder-quobyte-f84726a1-bf20-43a4-9f58-387147e41057" acquired by "delete_volume" :: waited 0.032s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:21:30 devstack sudo[115040]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_649d8684-7d56-44a0-aa67-4d834af0f649_148pi2vndevstack@QuobyteHD" returned: 0 in 0.787s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_649d8684-7d56-44a0-aa67-4d834af0f649_148pi2vndevstack@QuobyteHD {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:30 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[1422b192-79bb-4c65-a548-8cbfb305db05]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:21:30 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-72852fa9-b693-4e2b-bf5a-8349f1b55f46 tempest-VolumeDependencyTests-1774128313 None] Lock "cinder-4771b250-f68d-4304-9ea4-56b40579eb8a-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:21:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2d565390-f01c-410a-9536-bb5073096b8a tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f84726a1-bf20-43a4-9f58-387147e41057 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:30 devstack sudo[115038]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:30 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-958796ce-e580-45fa-b91d-93b4e4f18972 tempest-SnapshotDependencyTests-35630455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a 1073741824" returned: 0 in 0.980s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:30 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-72852fa9-b693-4e2b-bf5a-8349f1b55f46 tempest-VolumeDependencyTests-1774128313 None] Acquiring lock "cinder-quobyte-4771b250-f68d-4304-9ea4-56b40579eb8a" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:21:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-958796ce-e580-45fa-b91d-93b4e4f18972 tempest-SnapshotDependencyTests-35630455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:31 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-72852fa9-b693-4e2b-bf5a-8349f1b55f46 tempest-VolumeDependencyTests-1774128313 None] Lock "cinder-quobyte-4771b250-f68d-4304-9ea4-56b40579eb8a" acquired by "delete_volume" :: waited 0.027s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:21:31 devstack sudo[115052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a Jun 24 05:21:31 devstack sudo[115052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:31 devstack sudo[115051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f84726a1-bf20-43a4-9f58-387147e41057 Jun 24 05:21:31 devstack sudo[115051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:31 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[159e9b5e-0860-4396-a4f5-aa8a58e91f38]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:21:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-72852fa9-b693-4e2b-bf5a-8349f1b55f46 tempest-VolumeDependencyTests-1774128313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:31 devstack sudo[115050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_649d8684-7d56-44a0-aa67-4d834af0f649_148pi2vndevstack@QuobyteHD Jun 24 05:21:31 devstack sudo[115050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:31 devstack sudo[115056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a Jun 24 05:21:31 devstack sudo[115056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:31 devstack sudo[115052]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-958796ce-e580-45fa-b91d-93b4e4f18972 tempest-SnapshotDependencyTests-35630455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a" returned: 0 in 0.746s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:31 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-958796ce-e580-45fa-b91d-93b4e4f18972 tempest-SnapshotDependencyTests-35630455 None] <== create_volume: return (1780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:21:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-958796ce-e580-45fa-b91d-93b4e4f18972 tempest-SnapshotDependencyTests-35630455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.784s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:21:31 devstack sudo[115051]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2d565390-f01c-410a-9536-bb5073096b8a tempest-CreateVolumesFromSourceVolumeTest-829686924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f84726a1-bf20-43a4-9f58-387147e41057" returned: 0 in 0.832s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2d565390-f01c-410a-9536-bb5073096b8a tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f84726a1-bf20-43a4-9f58-387147e41057 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:31 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-958796ce-e580-45fa-b91d-93b4e4f18972 tempest-SnapshotDependencyTests-35630455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9388692a-3646-4812-a855-29438fe0d405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed628166-3b80-46f6-8e61-52e1e051410a', 'volume_size': 1}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:21:31 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-958796ce-e580-45fa-b91d-93b4e4f18972 tempest-SnapshotDependencyTests-35630455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac9fba23-0bdd-4443-a48a-5c4382492a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:21:31 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-958796ce-e580-45fa-b91d-93b4e4f18972 tempest-SnapshotDependencyTests-35630455 None] Volume volume-ed628166-3b80-46f6-8e61-52e1e051410a (ed628166-3b80-46f6-8e61-52e1e051410a): created successfully Jun 24 05:21:31 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-958796ce-e580-45fa-b91d-93b4e4f18972 tempest-SnapshotDependencyTests-35630455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac9fba23-0bdd-4443-a48a-5c4382492a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:21:31 devstack sudo[115070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f84726a1-bf20-43a4-9f58-387147e41057 Jun 24 05:21:31 devstack sudo[115070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:31 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-958796ce-e580-45fa-b91d-93b4e4f18972 tempest-SnapshotDependencyTests-35630455 None] Flow 'volume_create_manager' (94d57d7b-1db1-4c30-8b2b-e4fe75b2653f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:21:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_649d8684-7d56-44a0-aa67-4d834af0f649_148pi2vndevstack@QuobyteHD" returned: 1 in 0.921s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_649d8684-7d56-44a0-aa67-4d834af0f649_148pi2vndevstack@QuobyteHD' failed. Not Retrying. {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 05:21:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:21:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:21:31 devstack sudo[115050]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:31 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=794a618b-66a9-4000-9eb9-fc686b84dfee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe04ff00b82444d2a99fc1d363d19552',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:21:27Z,use_quota=True,user_id='48751d378dc8468483a42d4f51e037bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)}" {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 05:21:31 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Creating volume 794a618b-66a9-4000-9eb9-fc686b84dfee {{(pid=93830) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 05:21:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:21:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:21:31 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:21:31 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:21:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:21:31 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:21:31 devstack cinder-volume[93830]: INFO cinder.volume.drivers.remotefs [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] casted to osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 Jun 24 05:21:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-794a618b-66a9-4000-9eb9-fc686b84dfee 1073741824 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:31 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-958796ce-e580-45fa-b91d-93b4e4f18972 tempest-SnapshotDependencyTests-35630455 None] Created volume successfully. Jun 24 05:21:31 devstack sudo[115072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-794a618b-66a9-4000-9eb9-fc686b84dfee 1073741824 Jun 24 05:21:31 devstack sudo[115072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:31 devstack sudo[115056]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-72852fa9-b693-4e2b-bf5a-8349f1b55f46 tempest-VolumeDependencyTests-1774128313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a" returned: 0 in 0.867s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:31 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-72852fa9-b693-4e2b-bf5a-8349f1b55f46 tempest-VolumeDependencyTests-1774128313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:31 devstack sudo[115074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a Jun 24 05:21:31 devstack sudo[115074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:32 devstack sudo[115070]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2d565390-f01c-410a-9536-bb5073096b8a tempest-CreateVolumesFromSourceVolumeTest-829686924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-f84726a1-bf20-43a4-9f58-387147e41057" returned: 0 in 0.702s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:32 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-2d565390-f01c-410a-9536-bb5073096b8a tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "cinder-quobyte-f84726a1-bf20-43a4-9f58-387147e41057" released by "delete_volume" :: held 1.618s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:21:32 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-2d565390-f01c-410a-9536-bb5073096b8a tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Created reservations ['cfcbf00e-69a8-49d6-91aa-cac1a7a4c676', '4c310508-6c64-4063-a2e6-bdb2265c9838', '41b13106-be6a-436c-8cc5-fb1262deb992', '3686a4be-cfa2-4d84-9b91-c837c062898c'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:21:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-2d565390-f01c-410a-9536-bb5073096b8a tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:21:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-2d565390-f01c-410a-9536-bb5073096b8a tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:21:32 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-2d565390-f01c-410a-9536-bb5073096b8a tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:21:32 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-2d565390-f01c-410a-9536-bb5073096b8a tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:21:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-2d565390-f01c-410a-9536-bb5073096b8a tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:21:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2d565390-f01c-410a-9536-bb5073096b8a tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:32 devstack sudo[115074]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-72852fa9-b693-4e2b-bf5a-8349f1b55f46 tempest-VolumeDependencyTests-1774128313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-4771b250-f68d-4304-9ea4-56b40579eb8a" returned: 0 in 0.715s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:32 devstack sudo[115082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:21:32 devstack sudo[115082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:32 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-72852fa9-b693-4e2b-bf5a-8349f1b55f46 tempest-VolumeDependencyTests-1774128313 None] Lock "cinder-quobyte-4771b250-f68d-4304-9ea4-56b40579eb8a" released by "delete_volume" :: held 1.669s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:21:32 devstack sudo[115072]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-794a618b-66a9-4000-9eb9-fc686b84dfee 1073741824" returned: 0 in 0.867s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:32 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-72852fa9-b693-4e2b-bf5a-8349f1b55f46 tempest-VolumeDependencyTests-1774128313 None] Created reservations ['acdc7ef6-8cef-4abc-acc5-8b0a40481c7e', 'd735066a-a569-425f-963e-069d8e6dee21', 'fe74bdd3-7ecc-4523-8e1f-5ea74c6f63a5', '6f2ba948-56ea-4c12-9093-129c35e8a497'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:21:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-794a618b-66a9-4000-9eb9-fc686b84dfee {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:32 devstack sudo[115084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-794a618b-66a9-4000-9eb9-fc686b84dfee Jun 24 05:21:32 devstack sudo[115084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-72852fa9-b693-4e2b-bf5a-8349f1b55f46 tempest-VolumeDependencyTests-1774128313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:21:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-72852fa9-b693-4e2b-bf5a-8349f1b55f46 tempest-VolumeDependencyTests-1774128313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:21:32 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-72852fa9-b693-4e2b-bf5a-8349f1b55f46 tempest-VolumeDependencyTests-1774128313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:21:32 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-72852fa9-b693-4e2b-bf5a-8349f1b55f46 tempest-VolumeDependencyTests-1774128313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:21:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-72852fa9-b693-4e2b-bf5a-8349f1b55f46 tempest-VolumeDependencyTests-1774128313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:21:32 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-72852fa9-b693-4e2b-bf5a-8349f1b55f46 tempest-VolumeDependencyTests-1774128313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:32 devstack sudo[115086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:21:32 devstack sudo[115086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:33 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f7531314-1d1f-4af5-9ae7-1c1c4181f834 tempest-VolumeDependencyTests-1774128313 None] Acquiring lock "cinder-e37a5e00-c0a4-4c4e-941d-70079c4133df-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:21:33 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f7531314-1d1f-4af5-9ae7-1c1c4181f834 tempest-VolumeDependencyTests-1774128313 None] Lock "cinder-e37a5e00-c0a4-4c4e-941d-70079c4133df-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:21:33 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f7531314-1d1f-4af5-9ae7-1c1c4181f834 tempest-VolumeDependencyTests-1774128313 None] Acquiring lock "cinder-quobyte-e37a5e00-c0a4-4c4e-941d-70079c4133df" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:21:33 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f7531314-1d1f-4af5-9ae7-1c1c4181f834 tempest-VolumeDependencyTests-1774128313 None] Lock "cinder-quobyte-e37a5e00-c0a4-4c4e-941d-70079c4133df" acquired by "delete_volume" :: waited 0.035s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:21:33 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4b05dc-97b0-48a6-8cd8-f74e89171152]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:21:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f7531314-1d1f-4af5-9ae7-1c1c4181f834 tempest-VolumeDependencyTests-1774128313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e37a5e00-c0a4-4c4e-941d-70079c4133df {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:33 devstack sudo[115088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e37a5e00-c0a4-4c4e-941d-70079c4133df Jun 24 05:21:33 devstack sudo[115088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9895abfb-e302-4752-9169-7255abf5148e tempest-SnapshotDependencyTests-35630455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:21:33 devstack sudo[115086]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-72852fa9-b693-4e2b-bf5a-8349f1b55f46 tempest-VolumeDependencyTests-1774128313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 1.009s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:33 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-72852fa9-b693-4e2b-bf5a-8349f1b55f46 tempest-VolumeDependencyTests-1774128313 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:21:33 devstack sudo[115084]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:33 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-72852fa9-b693-4e2b-bf5a-8349f1b55f46 tempest-VolumeDependencyTests-1774128313 None] Deleted volume successfully. Jun 24 05:21:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-794a618b-66a9-4000-9eb9-fc686b84dfee" returned: 0 in 1.111s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:33 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] <== create_volume: return (2042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'} {{(pid=93830) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 05:21:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.045s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:21:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9895abfb-e302-4752-9169-7255abf5148e tempest-SnapshotDependencyTests-35630455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.094s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:21:33 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-9895abfb-e302-4752-9169-7255abf5148e tempest-SnapshotDependencyTests-35630455 None] Creating offline snapshot 4ad83a41-511e-4fb5-ae2f-3f72cc7f7992 of volume ed628166-3b80-46f6-8e61-52e1e051410a {{(pid=93830) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 05:21:33 devstack cinder-volume[93830]: DEBUG cinder.volume.volume_utils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Attempting download of 649d8684-7d56-44a0-aa67-4d834af0f649 ((None, [{'url': 'file:///opt/stack/data/glance/images/649d8684-7d56-44a0-aa67-4d834af0f649', 'metadata': {}}])) to volume 794a618b-66a9-4000-9eb9-fc686b84dfee. {{(pid=93830) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 24 05:21:33 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee2a197-8c53-45a6-b8b1-96615c544dff]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:21:33 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-72852fa9-b693-4e2b-bf5a-8349f1b55f46 tempest-VolumeDependencyTests-1774128313 None] Lock "cinder-4771b250-f68d-4304-9ea4-56b40579eb8a-delete_volume" released by "delete_volume" :: held 3.011s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:21:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9895abfb-e302-4752-9169-7255abf5148e tempest-SnapshotDependencyTests-35630455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:33 devstack sudo[115082]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:33 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2d565390-f01c-410a-9536-bb5073096b8a tempest-CreateVolumesFromSourceVolumeTest-829686924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 1.331s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:33 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-2d565390-f01c-410a-9536-bb5073096b8a tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:21:33 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-2d565390-f01c-410a-9536-bb5073096b8a tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Deleted volume successfully. Jun 24 05:21:34 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-2d565390-f01c-410a-9536-bb5073096b8a tempest-CreateVolumesFromSourceVolumeTest-829686924 None] Lock "cinder-f84726a1-bf20-43a4-9f58-387147e41057-delete_volume" released by "delete_volume" :: held 3.235s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:21:34 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[85568ca5-cfcf-4008-b814-8a9f1b3fd2cc]: (4, 'raw') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:21:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_649d8684-7d56-44a0-aa67-4d834af0f649_v6nlr_g6 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:34 devstack sudo[115093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a Jun 24 05:21:34 devstack sudo[115093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:34 devstack sudo[115094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_649d8684-7d56-44a0-aa67-4d834af0f649_v6nlr_g6 Jun 24 05:21:34 devstack sudo[115094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:34 devstack sudo[115088]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f7531314-1d1f-4af5-9ae7-1c1c4181f834 tempest-VolumeDependencyTests-1774128313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e37a5e00-c0a4-4c4e-941d-70079c4133df" returned: 0 in 1.266s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f7531314-1d1f-4af5-9ae7-1c1c4181f834 tempest-VolumeDependencyTests-1774128313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e37a5e00-c0a4-4c4e-941d-70079c4133df {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:34 devstack sudo[115100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e37a5e00-c0a4-4c4e-941d-70079c4133df Jun 24 05:21:34 devstack sudo[115100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:34 devstack sudo[115094]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_649d8684-7d56-44a0-aa67-4d834af0f649_v6nlr_g6" returned: 0 in 0.929s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:34 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_649d8684-7d56-44a0-aa67-4d834af0f649_v6nlr_g6 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:35 devstack sudo[115093]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9895abfb-e302-4752-9169-7255abf5148e tempest-SnapshotDependencyTests-35630455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a" returned: 0 in 1.082s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9895abfb-e302-4752-9169-7255abf5148e tempest-SnapshotDependencyTests-35630455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a.4ad83a41-511e-4fb5-ae2f-3f72cc7f7992 1G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:35 devstack sudo[115109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a.4ad83a41-511e-4fb5-ae2f-3f72cc7f7992 1G Jun 24 05:21:35 devstack sudo[115109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:35 devstack sudo[115108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_649d8684-7d56-44a0-aa67-4d834af0f649_v6nlr_g6 Jun 24 05:21:35 devstack sudo[115108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:35 devstack sudo[115100]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f7531314-1d1f-4af5-9ae7-1c1c4181f834 tempest-VolumeDependencyTests-1774128313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-e37a5e00-c0a4-4c4e-941d-70079c4133df" returned: 0 in 0.878s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:35 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f7531314-1d1f-4af5-9ae7-1c1c4181f834 tempest-VolumeDependencyTests-1774128313 None] Lock "cinder-quobyte-e37a5e00-c0a4-4c4e-941d-70079c4133df" released by "delete_volume" :: held 2.279s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:21:35 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-f7531314-1d1f-4af5-9ae7-1c1c4181f834 tempest-VolumeDependencyTests-1774128313 None] Created reservations ['616cd152-37be-44b1-819f-6684d4dd1500', '31f3708e-7526-4f2a-bf22-613e2d9d6259', 'fdfb1971-7520-4a70-846c-8c811f4453e3', '0609b904-6149-46ff-80d8-b60364901199'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:21:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f7531314-1d1f-4af5-9ae7-1c1c4181f834 tempest-VolumeDependencyTests-1774128313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:21:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f7531314-1d1f-4af5-9ae7-1c1c4181f834 tempest-VolumeDependencyTests-1774128313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:21:35 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f7531314-1d1f-4af5-9ae7-1c1c4181f834 tempest-VolumeDependencyTests-1774128313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:21:35 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-f7531314-1d1f-4af5-9ae7-1c1c4181f834 tempest-VolumeDependencyTests-1774128313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:21:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-f7531314-1d1f-4af5-9ae7-1c1c4181f834 tempest-VolumeDependencyTests-1774128313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:21:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f7531314-1d1f-4af5-9ae7-1c1c4181f834 tempest-VolumeDependencyTests-1774128313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:35 devstack sudo[115108]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_649d8684-7d56-44a0-aa67-4d834af0f649_v6nlr_g6" returned: 1 in 0.890s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_649d8684-7d56-44a0-aa67-4d834af0f649_v6nlr_g6' failed. Not Retrying. {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 05:21:35 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[0408984d-c4ea-42af-9476-1f1eaee3e11b]: (4, 'raw') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:21:35 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_649d8684-7d56-44a0-aa67-4d834af0f649_148pi2vndevstack@QuobyteHD {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:35 devstack sudo[115118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:21:35 devstack sudo[115118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:35 devstack sudo[115119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_649d8684-7d56-44a0-aa67-4d834af0f649_148pi2vndevstack@QuobyteHD Jun 24 05:21:35 devstack sudo[115119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:36 devstack sudo[115109]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9895abfb-e302-4752-9169-7255abf5148e tempest-SnapshotDependencyTests-35630455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a.4ad83a41-511e-4fb5-ae2f-3f72cc7f7992 1G" returned: 0 in 0.972s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9895abfb-e302-4752-9169-7255abf5148e tempest-SnapshotDependencyTests-35630455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed628166-3b80-46f6-8e61-52e1e051410a -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a.4ad83a41-511e-4fb5-ae2f-3f72cc7f7992 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:36 devstack sudo[115123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed628166-3b80-46f6-8e61-52e1e051410a -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a.4ad83a41-511e-4fb5-ae2f-3f72cc7f7992 Jun 24 05:21:36 devstack sudo[115123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:36 devstack sudo[115118]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-f7531314-1d1f-4af5-9ae7-1c1c4181f834 tempest-VolumeDependencyTests-1774128313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.651s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:36 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-f7531314-1d1f-4af5-9ae7-1c1c4181f834 tempest-VolumeDependencyTests-1774128313 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:21:36 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-f7531314-1d1f-4af5-9ae7-1c1c4181f834 tempest-VolumeDependencyTests-1774128313 None] Deleted volume successfully. Jun 24 05:21:36 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-f7531314-1d1f-4af5-9ae7-1c1c4181f834 tempest-VolumeDependencyTests-1774128313 None] Lock "cinder-e37a5e00-c0a4-4c4e-941d-70079c4133df-delete_volume" released by "delete_volume" :: held 3.222s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:21:36 devstack sudo[115119]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_649d8684-7d56-44a0-aa67-4d834af0f649_148pi2vndevstack@QuobyteHD" returned: 0 in 0.748s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_649d8684-7d56-44a0-aa67-4d834af0f649_148pi2vndevstack@QuobyteHD {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:36 devstack sudo[115123]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9895abfb-e302-4752-9169-7255abf5148e tempest-SnapshotDependencyTests-35630455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed628166-3b80-46f6-8e61-52e1e051410a -F qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a.4ad83a41-511e-4fb5-ae2f-3f72cc7f7992" returned: 0 in 0.720s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:36 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-9895abfb-e302-4752-9169-7255abf5148e tempest-SnapshotDependencyTests-35630455 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a.4ad83a41-511e-4fb5-ae2f-3f72cc7f7992 is being set with open permissions: ugo+rw Jun 24 05:21:36 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9895abfb-e302-4752-9169-7255abf5148e tempest-SnapshotDependencyTests-35630455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a.4ad83a41-511e-4fb5-ae2f-3f72cc7f7992 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:36 devstack sudo[115131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_649d8684-7d56-44a0-aa67-4d834af0f649_148pi2vndevstack@QuobyteHD Jun 24 05:21:36 devstack sudo[115131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:36 devstack sudo[115133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a.4ad83a41-511e-4fb5-ae2f-3f72cc7f7992 Jun 24 05:21:36 devstack sudo[115133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:37 devstack sudo[115133]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9895abfb-e302-4752-9169-7255abf5148e tempest-SnapshotDependencyTests-35630455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a.4ad83a41-511e-4fb5-ae2f-3f72cc7f7992" returned: 0 in 0.654s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:37 devstack sudo[115131]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_649d8684-7d56-44a0-aa67-4d834af0f649_148pi2vndevstack@QuobyteHD" returned: 1 in 0.802s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_649d8684-7d56-44a0-aa67-4d834af0f649_148pi2vndevstack@QuobyteHD' failed. Not Retrying. {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 05:21:37 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] 649d8684-7d56-44a0-aa67-4d834af0f649 was raw, converting to raw {{(pid=93830) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 24 05:21:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_649d8684-7d56-44a0-aa67-4d834af0f649_148pi2vndevstack@QuobyteHD /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-794a618b-66a9-4000-9eb9-fc686b84dfee {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:37 devstack sudo[115139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_649d8684-7d56-44a0-aa67-4d834af0f649_148pi2vndevstack@QuobyteHD /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-794a618b-66a9-4000-9eb9-fc686b84dfee Jun 24 05:21:37 devstack sudo[115139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:37 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9895abfb-e302-4752-9169-7255abf5148e tempest-SnapshotDependencyTests-35630455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:37 devstack sudo[115141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a.info Jun 24 05:21:37 devstack sudo[115141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:38 devstack sudo[115139]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_649d8684-7d56-44a0-aa67-4d834af0f649_148pi2vndevstack@QuobyteHD /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-794a618b-66a9-4000-9eb9-fc686b84dfee" returned: 0 in 0.812s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:38 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_649d8684-7d56-44a0-aa67-4d834af0f649_148pi2vndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-794a618b-66a9-4000-9eb9-fc686b84dfee {{(pid=93830) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 05:21:38 devstack cinder-volume[93830]: INFO cinder.image.image_utils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Converted 0.00 MB image at 0.00 MB/s Jun 24 05:21:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-794a618b-66a9-4000-9eb9-fc686b84dfee 1G {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:38 devstack sudo[115141]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9895abfb-e302-4752-9169-7255abf5148e tempest-SnapshotDependencyTests-35630455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a.info" returned: 0 in 0.802s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:38 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-9895abfb-e302-4752-9169-7255abf5148e tempest-SnapshotDependencyTests-35630455 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a.info is being set with open permissions: ugo+rw Jun 24 05:21:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9895abfb-e302-4752-9169-7255abf5148e tempest-SnapshotDependencyTests-35630455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a.info {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:38 devstack sudo[115147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-794a618b-66a9-4000-9eb9-fc686b84dfee 1G Jun 24 05:21:38 devstack sudo[115147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:38 devstack sudo[115148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a.info Jun 24 05:21:38 devstack sudo[115148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:38 devstack sudo[115148]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-9895abfb-e302-4752-9169-7255abf5148e tempest-SnapshotDependencyTests-35630455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a.info" returned: 0 in 0.679s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-9895abfb-e302-4752-9169-7255abf5148e tempest-SnapshotDependencyTests-35630455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.049s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:21:38 devstack sudo[115147]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-794a618b-66a9-4000-9eb9-fc686b84dfee 1G" returned: 0 in 0.726s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:38 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[7204a838-670b-4b12-a02c-32b3d1a88e61]: (4, 'raw') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:21:38 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-794a618b-66a9-4000-9eb9-fc686b84dfee {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:39 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-9895abfb-e302-4752-9169-7255abf5148e tempest-SnapshotDependencyTests-35630455 None] Create snapshot completed successfully Jun 24 05:21:39 devstack sudo[115170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-794a618b-66a9-4000-9eb9-fc686b84dfee Jun 24 05:21:39 devstack sudo[115170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:39 devstack sudo[115170]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-794a618b-66a9-4000-9eb9-fc686b84dfee" returned: 0 in 0.790s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:39 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-794a618b-66a9-4000-9eb9-fc686b84dfee {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:39 devstack sudo[115196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-794a618b-66a9-4000-9eb9-fc686b84dfee Jun 24 05:21:39 devstack sudo[115196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:40 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93830) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 05:21:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Flow 'volume_create_manager' (5052af6c-6cbf-4bf8-bffc-e760c6c2d880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:21:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5752900-de43-4bcf-b47b-71a7a7df7832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:21:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5752900-de43-4bcf-b47b-71a7a7df7832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T03:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5727c9a-0eb9-45d6-982d-0960703a21fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53efa90b046f4a7a9c7adddc5dc150dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T03:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4ad83a41-511e-4fb5-ae2f-3f72cc7f7992,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T03:21:40Z,use_quota=True,user_id='c2bc5fddae764ffa898fd9b6701e1ce3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d753046-419c-40e5-b528-d268d999719c),volume_type_id=5d753046-419c-40e5-b528-d268d999719c)' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:21:40 devstack sudo[115196]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe65733-d23e-4a11-a6fa-9713d367ef3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:21:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe65733-d23e-4a11-a6fa-9713d367ef3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:21:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19c9e397-de85-4df0-b0d4-27473d0d7b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:21:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19c9e397-de85-4df0-b0d4-27473d0d7b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd5727c9a-0eb9-45d6-982d-0960703a21fd', 'volume_name': 'volume-d5727c9a-0eb9-45d6-982d-0960703a21fd', 'volume_size': 1, 'snapshot_id': '4ad83a41-511e-4fb5-ae2f-3f72cc7f7992'}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:21:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6b09361-bd50-4122-8135-fc3ab5007947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:21:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6b09361-bd50-4122-8135-fc3ab5007947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:21:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3058de4-5a7c-4693-bfc3-18064e3156c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:21:40 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Volume d5727c9a-0eb9-45d6-982d-0960703a21fd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d5727c9a-0eb9-45d6-982d-0960703a21fd', 'volume_size': 1, 'snapshot_id': '4ad83a41-511e-4fb5-ae2f-3f72cc7f7992'} Jun 24 05:21:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-794a618b-66a9-4000-9eb9-fc686b84dfee" returned: 1 in 0.790s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-794a618b-66a9-4000-9eb9-fc686b84dfee' failed. Not Retrying. {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 05:21:40 devstack cinder-volume[93830]: DEBUG cinder.volume.volume_utils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Downloaded image 649d8684-7d56-44a0-aa67-4d834af0f649 ((None, [{'url': 'file:///opt/stack/data/glance/images/649d8684-7d56-44a0-aa67-4d834af0f649', 'metadata': {}}])) to volume 794a618b-66a9-4000-9eb9-fc686b84dfee successfully. {{(pid=93830) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 24 05:21:40 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Temporary image 649d8684-7d56-44a0-aa67-4d834af0f649 for user 48751d378dc8468483a42d4f51e037bb is deleted. {{(pid=93830) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 24 05:21:40 devstack cinder-volume[93830]: DEBUG cinder.volume.volume_utils [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Marking volume 794a618b-66a9-4000-9eb9-fc686b84dfee as bootable. {{(pid=93830) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 24 05:21:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:21:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:21:40 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Acquiring lock "cinder-quobyte-4ad83a41-511e-4fb5-ae2f-3f72cc7f7992-d5727c9a-0eb9-45d6-982d-0960703a21fd" by "_create_volume_from_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:21:40 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Copying metadata from image 649d8684-7d56-44a0-aa67-4d834af0f649 to 794a618b-66a9-4000-9eb9-fc686b84dfee. {{(pid=93830) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 24 05:21:40 devstack cinder-volume[93830]: DEBUG cinder.volume.flows.manager.create_volume [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Creating volume glance metadata for volume 794a618b-66a9-4000-9eb9-fc686b84dfee backed by image 649d8684-7d56-44a0-aa67-4d834af0f649 with: {'image_id': '649d8684-7d56-44a0-aa67-4d834af0f649', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '71ef2f87e56c117e31732237d36e942d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93830) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 24 05:21:40 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Lock "cinder-quobyte-4ad83a41-511e-4fb5-ae2f-3f72cc7f7992-d5727c9a-0eb9-45d6-982d-0960703a21fd" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:21:40 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Creating volume d5727c9a-0eb9-45d6-982d-0960703a21fd from snapshot 4ad83a41-511e-4fb5-ae2f-3f72cc7f7992 {{(pid=93830) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 24 05:21:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:21:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:21:40 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:21:40 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:21:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:21:40 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Selected osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05 as target Quobyte volume. {{(pid=93830) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 05:21:40 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Acquiring lock "cinder-quobyte-d5727c9a-0eb9-45d6-982d-0960703a21fd" by "_copy_volume_from_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:21:40 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Lock "cinder-quobyte-d5727c9a-0eb9-45d6-982d-0960703a21fd" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:21:40 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] snapshot: 4ad83a41-511e-4fb5-ae2f-3f72cc7f7992, volume: d5727c9a-0eb9-45d6-982d-0960703a21fd, {{(pid=93830) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 05:21:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:21:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:21:40 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:21:40 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:21:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:21:40 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef2ea1f-ef68-4f0e-bf25-31afaf2d869a]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:21:40 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a.4ad83a41-511e-4fb5-ae2f-3f72cc7f7992 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98ad4618-2875-4dd9-a535-8bd25e0dcaa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-794a618b-66a9-4000-9eb9-fc686b84dfee', 'volume_size': 1, 'image_id': '649d8684-7d56-44a0-aa67-4d834af0f649', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/649d8684-7d56-44a0-aa67-4d834af0f649', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '71ef2f87e56c117e31732237d36e942d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fe04ff00b82444d2a99fc1d363d19552', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2909a3080191eede0f68c94323ef868cd6ebc2f07d37b770d06aad13e51e97418cfc1267c3e80afc10f91bd8e6f4df132c0c4d3041d522f30b32fd8e897929e3', 'id': '649d8684-7d56-44a0-aa67-4d834af0f649', 'created_at': datetime.datetime(2026, 6, 24, 3, 21, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 3, 21, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/649d8684-7d56-44a0-aa67-4d834af0f649/file', 'properties': {}}, 'image_service': }' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:21:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f529ab7-0d55-4519-bcb4-7dd23684947a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:21:40 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Volume volume-794a618b-66a9-4000-9eb9-fc686b84dfee (794a618b-66a9-4000-9eb9-fc686b84dfee): created successfully Jun 24 05:21:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f529ab7-0d55-4519-bcb4-7dd23684947a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:21:40 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Flow 'volume_create_manager' (83cfd7dc-2e53-4981-a545-719bc35a4a01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:21:40 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-863df3c8-4065-4303-8aee-0c32ca506fde tempest-VolumeImageDependencyTests-1557332470 None] Created volume successfully. Jun 24 05:21:40 devstack sudo[115201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a.4ad83a41-511e-4fb5-ae2f-3f72cc7f7992 Jun 24 05:21:40 devstack sudo[115201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:41 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-6c20bdac-5a12-4f18-bb50-683b3392fcbc tempest-VolumeImageDependencyTests-1557332470 None] Acquiring lock "cinder-794a618b-66a9-4000-9eb9-fc686b84dfee-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:21:41 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-6c20bdac-5a12-4f18-bb50-683b3392fcbc tempest-VolumeImageDependencyTests-1557332470 None] Lock "cinder-794a618b-66a9-4000-9eb9-fc686b84dfee-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:21:41 devstack sudo[115201]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a.4ad83a41-511e-4fb5-ae2f-3f72cc7f7992" returned: 0 in 0.766s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:41 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed628166-3b80-46f6-8e61-52e1e051410a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:21:41 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a {{(pid=93830) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 05:21:41 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Creating direct copy from snapshot {{(pid=93830) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 05:21:41 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[941f807d-bcae-4b55-84f1-66dc39b417c1]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:21:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:41 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-6c20bdac-5a12-4f18-bb50-683b3392fcbc tempest-VolumeImageDependencyTests-1557332470 None] Acquiring lock "cinder-quobyte-794a618b-66a9-4000-9eb9-fc686b84dfee" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:21:41 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-6c20bdac-5a12-4f18-bb50-683b3392fcbc tempest-VolumeImageDependencyTests-1557332470 None] Lock "cinder-quobyte-794a618b-66a9-4000-9eb9-fc686b84dfee" acquired by "delete_volume" :: waited 0.018s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:21:41 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d482c0a-9ec4-4d06-9474-78a2d8a4c4c3]: (4, 'raw') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:21:41 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6c20bdac-5a12-4f18-bb50-683b3392fcbc tempest-VolumeImageDependencyTests-1557332470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-794a618b-66a9-4000-9eb9-fc686b84dfee {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:41 devstack sudo[115208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a Jun 24 05:21:41 devstack sudo[115208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:41 devstack sudo[115209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-794a618b-66a9-4000-9eb9-fc686b84dfee Jun 24 05:21:41 devstack sudo[115209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:42 devstack sudo[115208]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a" returned: 0 in 0.768s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:42 devstack cinder-volume[93830]: DEBUG cinder.utils [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Path /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d5727c9a-0eb9-45d6-982d-0960703a21fd not found in is_blk_device check {{(pid=93830) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 05:21:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d5727c9a-0eb9-45d6-982d-0960703a21fd {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:42 devstack sudo[115217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d5727c9a-0eb9-45d6-982d-0960703a21fd Jun 24 05:21:42 devstack sudo[115217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:42 devstack sudo[115209]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6c20bdac-5a12-4f18-bb50-683b3392fcbc tempest-VolumeImageDependencyTests-1557332470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-794a618b-66a9-4000-9eb9-fc686b84dfee" returned: 0 in 0.772s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:42 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6c20bdac-5a12-4f18-bb50-683b3392fcbc tempest-VolumeImageDependencyTests-1557332470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-794a618b-66a9-4000-9eb9-fc686b84dfee {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:42 devstack sudo[115219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-794a618b-66a9-4000-9eb9-fc686b84dfee Jun 24 05:21:42 devstack sudo[115219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:43 devstack sudo[115219]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6c20bdac-5a12-4f18-bb50-683b3392fcbc tempest-VolumeImageDependencyTests-1557332470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-794a618b-66a9-4000-9eb9-fc686b84dfee" returned: 1 in 0.901s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6c20bdac-5a12-4f18-bb50-683b3392fcbc tempest-VolumeImageDependencyTests-1557332470 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-794a618b-66a9-4000-9eb9-fc686b84dfee' failed. Not Retrying. {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 05:21:43 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6c20bdac-5a12-4f18-bb50-683b3392fcbc tempest-VolumeImageDependencyTests-1557332470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-794a618b-66a9-4000-9eb9-fc686b84dfee {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:43 devstack sudo[115235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-794a618b-66a9-4000-9eb9-fc686b84dfee Jun 24 05:21:43 devstack sudo[115235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:44 devstack sudo[115235]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6c20bdac-5a12-4f18-bb50-683b3392fcbc tempest-VolumeImageDependencyTests-1557332470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-794a618b-66a9-4000-9eb9-fc686b84dfee" returned: 0 in 1.099s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:44 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-6c20bdac-5a12-4f18-bb50-683b3392fcbc tempest-VolumeImageDependencyTests-1557332470 None] Lock "cinder-quobyte-794a618b-66a9-4000-9eb9-fc686b84dfee" released by "delete_volume" :: held 2.857s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:21:44 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-6c20bdac-5a12-4f18-bb50-683b3392fcbc tempest-VolumeImageDependencyTests-1557332470 None] Created reservations ['4aa62b6f-4921-4f12-9c2d-02695c149b22', '944ac031-43c0-4f3f-a450-48c36741fb37', 'b8b26e20-bfdf-4e07-9f8b-235acf73a424', '70076458-fa3c-42ec-859f-dc4b22dff3fa'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:21:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-6c20bdac-5a12-4f18-bb50-683b3392fcbc tempest-VolumeImageDependencyTests-1557332470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:21:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-6c20bdac-5a12-4f18-bb50-683b3392fcbc tempest-VolumeImageDependencyTests-1557332470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:21:44 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-6c20bdac-5a12-4f18-bb50-683b3392fcbc tempest-VolumeImageDependencyTests-1557332470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:21:44 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-6c20bdac-5a12-4f18-bb50-683b3392fcbc tempest-VolumeImageDependencyTests-1557332470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:21:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-6c20bdac-5a12-4f18-bb50-683b3392fcbc tempest-VolumeImageDependencyTests-1557332470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:21:44 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6c20bdac-5a12-4f18-bb50-683b3392fcbc tempest-VolumeImageDependencyTests-1557332470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:44 devstack sudo[115238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:21:44 devstack sudo[115238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:45 devstack sudo[115238]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:45 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-6c20bdac-5a12-4f18-bb50-683b3392fcbc tempest-VolumeImageDependencyTests-1557332470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.987s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:45 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-6c20bdac-5a12-4f18-bb50-683b3392fcbc tempest-VolumeImageDependencyTests-1557332470 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:21:45 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-6c20bdac-5a12-4f18-bb50-683b3392fcbc tempest-VolumeImageDependencyTests-1557332470 None] Deleted volume successfully. Jun 24 05:21:45 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-6c20bdac-5a12-4f18-bb50-683b3392fcbc tempest-VolumeImageDependencyTests-1557332470 None] Lock "cinder-794a618b-66a9-4000-9eb9-fc686b84dfee-delete_volume" released by "delete_volume" :: held 4.284s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:21:47 devstack sudo[115217]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d5727c9a-0eb9-45d6-982d-0960703a21fd" returned: 0 in 5.153s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:47 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bebdd1-9bcf-441f-b529-83231c1768c1]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:21:47 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:47 devstack sudo[115241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a Jun 24 05:21:47 devstack sudo[115241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:48 devstack sudo[115241]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a" returned: 0 in 0.957s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:48 devstack cinder-volume[93830]: DEBUG cinder.image.image_utils [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Image conversion details: src /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a, size 1024.00 MB, duration 5.15 sec, destination /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d5727c9a-0eb9-45d6-982d-0960703a21fd {{(pid=93830) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 05:21:48 devstack cinder-volume[93830]: INFO cinder.image.image_utils [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Converted 1024.00 MB image at 198.68 MB/s Jun 24 05:21:48 devstack cinder-volume[93830]: WARNING cinder.volume.drivers.remotefs [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d5727c9a-0eb9-45d6-982d-0960703a21fd is being set with open permissions: ugo+rw Jun 24 05:21:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d5727c9a-0eb9-45d6-982d-0960703a21fd {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:48 devstack sudo[115246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d5727c9a-0eb9-45d6-982d-0960703a21fd Jun 24 05:21:48 devstack sudo[115246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:48 devstack sudo[115246]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:48 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d5727c9a-0eb9-45d6-982d-0960703a21fd" returned: 0 in 0.616s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:49 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Lock "cinder-quobyte-d5727c9a-0eb9-45d6-982d-0960703a21fd" released by "_copy_volume_from_snapshot" :: held 8.371s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:21:49 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Lock "cinder-quobyte-4ad83a41-511e-4fb5-ae2f-3f72cc7f7992-d5727c9a-0eb9-45d6-982d-0960703a21fd" released by "_create_volume_from_snapshot" :: held 8.405s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:21:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.425s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:21:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3058de4-5a7c-4693-bfc3-18064e3156c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5727c9a-0eb9-45d6-982d-0960703a21fd', 'volume_size': 1, 'snapshot_id': '4ad83a41-511e-4fb5-ae2f-3f72cc7f7992'}' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:21:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe84ea56-4e89-416e-aa7c-29dbfb77ef6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 05:21:49 devstack cinder-volume[93830]: INFO cinder.volume.flows.manager.create_volume [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Volume volume-d5727c9a-0eb9-45d6-982d-0960703a21fd (d5727c9a-0eb9-45d6-982d-0960703a21fd): created successfully Jun 24 05:21:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe84ea56-4e89-416e-aa7c-29dbfb77ef6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93830) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 05:21:49 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Flow 'volume_create_manager' (5052af6c-6cbf-4bf8-bffc-e760c6c2d880) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93830) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 05:21:49 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-2cc06902-796d-4f14-bbd8-24ef0b86dfe0 tempest-SnapshotDependencyTests-35630455 None] Created volume successfully. Jun 24 05:21:49 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-fd77a756-7751-419e-b3f1-d3a0819a3875 tempest-SnapshotDependencyTests-35630455 None] Acquiring lock "cinder-4ad83a41-511e-4fb5-ae2f-3f72cc7f7992-delete_snapshot" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:21:49 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-fd77a756-7751-419e-b3f1-d3a0819a3875 tempest-SnapshotDependencyTests-35630455 None] Lock "cinder-4ad83a41-511e-4fb5-ae2f-3f72cc7f7992-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:21:49 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-fd77a756-7751-419e-b3f1-d3a0819a3875 tempest-SnapshotDependencyTests-35630455 None] Acquiring lock "cinder-quobyte-ed628166-3b80-46f6-8e61-52e1e051410a" by "delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:21:49 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-fd77a756-7751-419e-b3f1-d3a0819a3875 tempest-SnapshotDependencyTests-35630455 None] Lock "cinder-quobyte-ed628166-3b80-46f6-8e61-52e1e051410a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:21:49 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-fd77a756-7751-419e-b3f1-d3a0819a3875 tempest-SnapshotDependencyTests-35630455 None] Acquiring lock "cinder-quobyte-4ad83a41-511e-4fb5-ae2f-3f72cc7f7992" by "_delete_snapshot" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:21:49 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-fd77a756-7751-419e-b3f1-d3a0819a3875 tempest-SnapshotDependencyTests-35630455 None] Lock "cinder-quobyte-4ad83a41-511e-4fb5-ae2f-3f72cc7f7992" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:21:49 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-fd77a756-7751-419e-b3f1-d3a0819a3875 tempest-SnapshotDependencyTests-35630455 None] Deleting offline snapshot 4ad83a41-511e-4fb5-ae2f-3f72cc7f7992 of volume ed628166-3b80-46f6-8e61-52e1e051410a {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 05:21:49 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-fd77a756-7751-419e-b3f1-d3a0819a3875 tempest-SnapshotDependencyTests-35630455 None] snapshot_file for this snap is: volume-ed628166-3b80-46f6-8e61-52e1e051410a.4ad83a41-511e-4fb5-ae2f-3f72cc7f7992 {{(pid=93830) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 05:21:49 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0b878a-c508-4bf0-9c05-cd6af41ac57a]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:21:49 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fd77a756-7751-419e-b3f1-d3a0819a3875 tempest-SnapshotDependencyTests-35630455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a.4ad83a41-511e-4fb5-ae2f-3f72cc7f7992 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:49 devstack sudo[115249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a.4ad83a41-511e-4fb5-ae2f-3f72cc7f7992 Jun 24 05:21:49 devstack sudo[115249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:50 devstack sudo[115249]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fd77a756-7751-419e-b3f1-d3a0819a3875 tempest-SnapshotDependencyTests-35630455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a.4ad83a41-511e-4fb5-ae2f-3f72cc7f7992" returned: 0 in 0.719s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:50 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.remotefs [None req-fd77a756-7751-419e-b3f1-d3a0819a3875 tempest-SnapshotDependencyTests-35630455 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed628166-3b80-46f6-8e61-52e1e051410a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93830) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 05:21:50 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c040ba4-3a00-4274-92c4-6dca5a608041]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:21:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fd77a756-7751-419e-b3f1-d3a0819a3875 tempest-SnapshotDependencyTests-35630455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:50 devstack sudo[115254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a Jun 24 05:21:50 devstack sudo[115254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:50 devstack sudo[115254]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fd77a756-7751-419e-b3f1-d3a0819a3875 tempest-SnapshotDependencyTests-35630455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a" returned: 0 in 0.716s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:50 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fd77a756-7751-419e-b3f1-d3a0819a3875 tempest-SnapshotDependencyTests-35630455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a.4ad83a41-511e-4fb5-ae2f-3f72cc7f7992 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:50 devstack sudo[115260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a.4ad83a41-511e-4fb5-ae2f-3f72cc7f7992 Jun 24 05:21:50 devstack sudo[115260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:51 devstack sudo[115260]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fd77a756-7751-419e-b3f1-d3a0819a3875 tempest-SnapshotDependencyTests-35630455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a.4ad83a41-511e-4fb5-ae2f-3f72cc7f7992" returned: 0 in 0.693s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:51 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fd77a756-7751-419e-b3f1-d3a0819a3875 tempest-SnapshotDependencyTests-35630455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a.4ad83a41-511e-4fb5-ae2f-3f72cc7f7992 {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:51 devstack sudo[115265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a.4ad83a41-511e-4fb5-ae2f-3f72cc7f7992 Jun 24 05:21:51 devstack sudo[115265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:52 devstack sudo[115265]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-fd77a756-7751-419e-b3f1-d3a0819a3875 tempest-SnapshotDependencyTests-35630455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a.4ad83a41-511e-4fb5-ae2f-3f72cc7f7992" returned: 0 in 0.609s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:52 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-fd77a756-7751-419e-b3f1-d3a0819a3875 tempest-SnapshotDependencyTests-35630455 None] Lock "cinder-quobyte-4ad83a41-511e-4fb5-ae2f-3f72cc7f7992" released by "_delete_snapshot" :: held 2.829s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:21:52 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-fd77a756-7751-419e-b3f1-d3a0819a3875 tempest-SnapshotDependencyTests-35630455 None] Lock "cinder-quobyte-ed628166-3b80-46f6-8e61-52e1e051410a" released by "delete_snapshot" :: held 2.851s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:21:52 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-fd77a756-7751-419e-b3f1-d3a0819a3875 tempest-SnapshotDependencyTests-35630455 None] Created reservations ['0d902008-55c5-499c-8a0d-b01a9755c6b5', 'dd660979-2955-48ae-b506-c2f007035262', '54300128-ca7c-4268-b074-51946929565a', 'cb885722-7696-4317-9af1-d34dd2785bee'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:21:52 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-fd77a756-7751-419e-b3f1-d3a0819a3875 tempest-SnapshotDependencyTests-35630455 None] Delete snapshot completed successfully. Jun 24 05:21:52 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-fd77a756-7751-419e-b3f1-d3a0819a3875 tempest-SnapshotDependencyTests-35630455 None] Lock "cinder-4ad83a41-511e-4fb5-ae2f-3f72cc7f7992-delete_snapshot" released by "delete_snapshot" :: held 2.983s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:21:52 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-29587239-2e7c-456a-ba68-2f7fa51078c6 tempest-SnapshotDependencyTests-35630455 None] Acquiring lock "cinder-ed628166-3b80-46f6-8e61-52e1e051410a-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:21:52 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-29587239-2e7c-456a-ba68-2f7fa51078c6 tempest-SnapshotDependencyTests-35630455 None] Lock "cinder-ed628166-3b80-46f6-8e61-52e1e051410a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:21:52 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-29587239-2e7c-456a-ba68-2f7fa51078c6 tempest-SnapshotDependencyTests-35630455 None] Acquiring lock "cinder-quobyte-ed628166-3b80-46f6-8e61-52e1e051410a" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:21:52 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-29587239-2e7c-456a-ba68-2f7fa51078c6 tempest-SnapshotDependencyTests-35630455 None] Lock "cinder-quobyte-ed628166-3b80-46f6-8e61-52e1e051410a" acquired by "delete_volume" :: waited 0.014s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:21:52 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7b1901-8f4c-488a-93dc-ae69ad1ad851]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:21:52 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-29587239-2e7c-456a-ba68-2f7fa51078c6 tempest-SnapshotDependencyTests-35630455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:52 devstack sudo[115268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a Jun 24 05:21:52 devstack sudo[115268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:53 devstack sudo[115268]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-29587239-2e7c-456a-ba68-2f7fa51078c6 tempest-SnapshotDependencyTests-35630455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a" returned: 0 in 0.714s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-29587239-2e7c-456a-ba68-2f7fa51078c6 tempest-SnapshotDependencyTests-35630455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:53 devstack sudo[115273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a Jun 24 05:21:53 devstack sudo[115273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:53 devstack sudo[115273]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:53 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-29587239-2e7c-456a-ba68-2f7fa51078c6 tempest-SnapshotDependencyTests-35630455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-ed628166-3b80-46f6-8e61-52e1e051410a" returned: 0 in 0.608s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:53 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-29587239-2e7c-456a-ba68-2f7fa51078c6 tempest-SnapshotDependencyTests-35630455 None] Lock "cinder-quobyte-ed628166-3b80-46f6-8e61-52e1e051410a" released by "delete_volume" :: held 1.373s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:21:53 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-29587239-2e7c-456a-ba68-2f7fa51078c6 tempest-SnapshotDependencyTests-35630455 None] Created reservations ['b2197811-7292-4a3f-a86a-52a84d8a3ecd', '485109ae-cfbe-41b3-90f1-eb367fc875b2', 'cb8b842e-93f6-4249-9960-53c8ce985a5a', 'bf3b8ce8-9238-477a-9feb-1aa6e324afb4'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:21:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-29587239-2e7c-456a-ba68-2f7fa51078c6 tempest-SnapshotDependencyTests-35630455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:21:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-29587239-2e7c-456a-ba68-2f7fa51078c6 tempest-SnapshotDependencyTests-35630455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:21:54 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-29587239-2e7c-456a-ba68-2f7fa51078c6 tempest-SnapshotDependencyTests-35630455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:21:54 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-29587239-2e7c-456a-ba68-2f7fa51078c6 tempest-SnapshotDependencyTests-35630455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:21:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-29587239-2e7c-456a-ba68-2f7fa51078c6 tempest-SnapshotDependencyTests-35630455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:21:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-29587239-2e7c-456a-ba68-2f7fa51078c6 tempest-SnapshotDependencyTests-35630455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:54 devstack sudo[115276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:21:54 devstack sudo[115276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:54 devstack sudo[115276]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:54 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-be9efe86-13b4-48c3-89e1-593d4a8cf3e0 tempest-SnapshotDependencyTests-35630455 None] Acquiring lock "cinder-d5727c9a-0eb9-45d6-982d-0960703a21fd-delete_volume" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:21:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-29587239-2e7c-456a-ba68-2f7fa51078c6 tempest-SnapshotDependencyTests-35630455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.628s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:54 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-29587239-2e7c-456a-ba68-2f7fa51078c6 tempest-SnapshotDependencyTests-35630455 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:21:54 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-29587239-2e7c-456a-ba68-2f7fa51078c6 tempest-SnapshotDependencyTests-35630455 None] Deleted volume successfully. Jun 24 05:21:54 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-be9efe86-13b4-48c3-89e1-593d4a8cf3e0 tempest-SnapshotDependencyTests-35630455 None] Lock "cinder-d5727c9a-0eb9-45d6-982d-0960703a21fd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:21:54 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-29587239-2e7c-456a-ba68-2f7fa51078c6 tempest-SnapshotDependencyTests-35630455 None] Lock "cinder-ed628166-3b80-46f6-8e61-52e1e051410a-delete_volume" released by "delete_volume" :: held 2.248s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:21:54 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-be9efe86-13b4-48c3-89e1-593d4a8cf3e0 tempest-SnapshotDependencyTests-35630455 None] Acquiring lock "cinder-quobyte-d5727c9a-0eb9-45d6-982d-0960703a21fd" by "delete_volume" {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 05:21:54 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-be9efe86-13b4-48c3-89e1-593d4a8cf3e0 tempest-SnapshotDependencyTests-35630455 None] Lock "cinder-quobyte-d5727c9a-0eb9-45d6-982d-0960703a21fd" acquired by "delete_volume" :: waited 0.013s {{(pid=93830) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 05:21:54 devstack cinder-volume[93830]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b30a67-df4a-4964-9f41-6c115d747a96]: (4, 'qcow2') {{(pid=95352) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 05:21:54 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-be9efe86-13b4-48c3-89e1-593d4a8cf3e0 tempest-SnapshotDependencyTests-35630455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d5727c9a-0eb9-45d6-982d-0960703a21fd {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:54 devstack sudo[115279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d5727c9a-0eb9-45d6-982d-0960703a21fd Jun 24 05:21:54 devstack sudo[115279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:55 devstack sudo[115279]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-be9efe86-13b4-48c3-89e1-593d4a8cf3e0 tempest-SnapshotDependencyTests-35630455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d5727c9a-0eb9-45d6-982d-0960703a21fd" returned: 0 in 0.725s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:55 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-be9efe86-13b4-48c3-89e1-593d4a8cf3e0 tempest-SnapshotDependencyTests-35630455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d5727c9a-0eb9-45d6-982d-0960703a21fd {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:55 devstack sudo[115284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d5727c9a-0eb9-45d6-982d-0960703a21fd Jun 24 05:21:55 devstack sudo[115284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:56 devstack sudo[115284]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-be9efe86-13b4-48c3-89e1-593d4a8cf3e0 tempest-SnapshotDependencyTests-35630455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e/volume-d5727c9a-0eb9-45d6-982d-0960703a21fd" returned: 0 in 0.604s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:56 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-be9efe86-13b4-48c3-89e1-593d4a8cf3e0 tempest-SnapshotDependencyTests-35630455 None] Lock "cinder-quobyte-d5727c9a-0eb9-45d6-982d-0960703a21fd" released by "delete_volume" :: held 1.365s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:21:56 devstack cinder-volume[93830]: DEBUG cinder.quota [None req-be9efe86-13b4-48c3-89e1-593d4a8cf3e0 tempest-SnapshotDependencyTests-35630455 None] Created reservations ['5f7abeb6-0a5f-4ebd-b01c-87ada2bb1637', 'fd9e3c69-2255-41f2-a92a-1bd2e0e81908', '33de1f51-ff4f-41f6-9e0d-5f23e139cb63', 'a3577cc8-d937-4e8e-95d3-1fba7b6a2071'] {{(pid=93830) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 05:21:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-be9efe86-13b4-48c3-89e1-593d4a8cf3e0 tempest-SnapshotDependencyTests-35630455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:21:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-be9efe86-13b4-48c3-89e1-593d4a8cf3e0 tempest-SnapshotDependencyTests-35630455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:21:56 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-be9efe86-13b4-48c3-89e1-593d4a8cf3e0 tempest-SnapshotDependencyTests-35630455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:21:56 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-be9efe86-13b4-48c3-89e1-593d4a8cf3e0 tempest-SnapshotDependencyTests-35630455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:21:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-be9efe86-13b4-48c3-89e1-593d4a8cf3e0 tempest-SnapshotDependencyTests-35630455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:21:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-be9efe86-13b4-48c3-89e1-593d4a8cf3e0 tempest-SnapshotDependencyTests-35630455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:21:56 devstack sudo[115287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:21:56 devstack sudo[115287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:21:56 devstack sudo[115287]: pam_unix(sudo:session): session closed for user root Jun 24 05:21:56 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-be9efe86-13b4-48c3-89e1-593d4a8cf3e0 tempest-SnapshotDependencyTests-35630455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.601s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:21:56 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-be9efe86-13b4-48c3-89e1-593d4a8cf3e0 tempest-SnapshotDependencyTests-35630455 None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:21:56 devstack cinder-volume[93830]: INFO cinder.volume.manager [None req-be9efe86-13b4-48c3-89e1-593d4a8cf3e0 tempest-SnapshotDependencyTests-35630455 None] Deleted volume successfully. Jun 24 05:21:56 devstack cinder-volume[93830]: DEBUG cinder.coordination [None req-be9efe86-13b4-48c3-89e1-593d4a8cf3e0 tempest-SnapshotDependencyTests-35630455 None] Lock "cinder-d5727c9a-0eb9-45d6-982d-0960703a21fd-delete_volume" released by "delete_volume" :: held 2.157s {{(pid=93830) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 05:22:06 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:SELECT=93,cinder:UPDATE=101,cinder:INSERT=31,cinder:DELETE=8 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:22:06 devstack cinder-volume[93830]: DEBUG dbcounter [-] [93830] Writing DB stats cinder:DELETE=9,cinder:SELECT=69,cinder:INSERT=31,cinder:UPDATE=111 {{(pid=93830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 05:22:09 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 05:22:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 05:22:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 05:22:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05': None} {{(pid=93830) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 05:22:09 devstack cinder-volume[93830]: DEBUG cinder.volume.drivers.quobyte [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a509bff3-43c9-46fb-8281-f1f9b49fca05'] {{(pid=93830) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 05:22:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.lockutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93830) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 05:22:09 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 05:22:09 devstack sudo[115305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e Jun 24 05:22:09 devstack sudo[115305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 05:22:10 devstack sudo[115305]: pam_unix(sudo:session): session closed for user root Jun 24 05:22:10 devstack cinder-volume[93830]: DEBUG oslo_concurrency.processutils [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6a5dcddee8175a89bd7f59cbd1aa396e" returned: 0 in 0.607s {{(pid=93830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 05:22:10 devstack cinder-volume[93830]: DEBUG cinder.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Notifying Schedulers of capabilities ... {{(pid=93830) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 05:22:10 devstack cinder-volume[93830]: DEBUG oslo_service.periodic_task [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] Running periodic task VolumeManager._thread_info {{(pid=93830) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 05:22:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread count: 29 {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 05:22:10 devstack cinder-volume[93830]: DEBUG cinder.volume.manager [None req-01e0a656-ff52-4cdd-a800-79bb6408bb5a None None] thread info: [<_MainThread(MainThread, started 130211312517248)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93830) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}